Adding a path to pandas to_csv function

Question

I have a small chunk of code using Pandas that reads an incoming CSV, performs some simple computations, adds a column, and then turns the dataframe into a CSV using to_csv.

I was running it all in a Jupyter notebook and it worked great, the output csv file would be there right in the directory when I ran it. I have now changed my code to be run from the command line, and when I run it, I don't see the output CSV files anywhere. The way that I did this was saving the file as a .py, saving it into a folder right on my desktop, and putting the incoming csv in the same folder.

From similar questions on stackoverflow I am gathering that right before I use to_csv at the end of my code I might need to add the path into that line as a variable, such as this.

path = 'C:\Users\ab\Desktop\conversion'

final2.to_csv(path, 'Combined Book.csv', index=False)

However after adding this, I am still not seeing this output CSV file in the directory anywhere after running my pretty simple .py code from the command line.

Does anyone have any guidance? Let me know what other information I could add for clarity. I don't think sample code of the pandas computations is necessary, it is as simple as adding a column with data based on one of my incoming columns.

@ Warthog1, what is the purpose of adding a path , does it referring to Combined Book.csv — Karn Kumar
– Karn Kumar, Commented Sep 26, 2018 at 15:47
are you looking for something ` final2.to_csv('C:\Users\ab\Desktop\conversion\Combined Book.csv', index=False) — Karn Kumar
– Karn Kumar, Commented Sep 26, 2018 at 15:48
The path is the desired output folder, which is the folder that my .py and csv file are in. I want to add the path because right now the code doesn't output any CSV files, let alone into the desired folder. From research it looks like adding a path would remove that problem — Warthog1
– Warthog1, Commented Sep 26, 2018 at 15:49
@ w-m I am running it from the command line by calling convertbook.py and it executes without error — Warthog1
– Warthog1, Commented Sep 26, 2018 at 15:50

T Burgis · Accepted Answer · 2018-09-26 15:55:54Z

3

Join the path and the filename together and pass that to pd.to_csv:

import os
path = 'C:\Users\ab\Desktop\conversion'
output_file = os.path.join(path,'Combined Book.csv')

final2.to_csv(output_file, index=False)

answered Sep 26, 2018 at 15:55

T Burgis

1,4359 silver badges9 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

fhi · Accepted Answer · 2018-09-26 15:53:23Z

1

Im pretty sure that you have mixed up the arguments, as shown here. The path should include the filename in it.

path = 'C:\Users\ab\Desktop\conversion\Combined_Book.csv'

final2.to_csv(path, index=False)

Otherwise you are trying to overwrite the whole folder 'conversions' and add a complicated value separator.

answered Sep 26, 2018 at 15:53

fhi

437 bronze badges

Comments

Karn Kumar · Accepted Answer · 2018-09-26 16:00:03Z

1

I think below is what you are looking for , absolute path

import pandas as pd
.....
final2.to_csv('C:\Users\ab\Desktop\conversion\Combined Book.csv', index=False)

OR for an example:

path_to_file = "C:\Users\ab\Desktop\conversion\Combined Book.csv"
final2.to_csv(path_to_file, encoding="utf-8")

edited Sep 26, 2018 at 16:00

answered Sep 26, 2018 at 15:53

Karn Kumar

8,8343 gold badges32 silver badges61 bronze badges

Comments

vinsinraw · Accepted Answer · 2022-03-27 18:27:03Z

1

Though late answer but would be useful for someone facing similar issues. It is better to dynamically get the csv folder path instead of hardcoding it. We can do so using os.getcwd(). Later join the csv folder path with csv file name using os.path.join(os.getcwd(),'csvFileName')

Example:

import os
path = os.getcwd()
export_path = os.path.join(path,'Combined Book.csv')
final2.to_csv(export_path, index=False, header=True)

answered Mar 27, 2022 at 18:27

vinsinraw

2,1631 gold badge18 silver badges18 bronze badges

Collectives™ on Stack Overflow

Adding a path to pandas to_csv function

4 Answers 4

Comments

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related