Read csv files from multiple folders using a for loop

Question

My code will read from a csv file and perform multiple operations/calculations then create another csv file, i have 8 folders to read/write from and i want my code to iterate through them one by one

lets say i have folders named Folder1 to Folder8, first of all how do i specify my code to read from a different directory instead of the default one where the python script exists?

this is part of my code

#read the columns from CSV
MAXCOLS = Number_Of_Buses + 1
Bus_Vol = [[] for _ in range(MAXCOLS)]
with open('p_voltage_table_output.csv', 'rb') as input:
    for row in csv.reader(input, delimiter=','):
        for i in range(MAXCOLS):
            Bus_Vol[i].append(row[i] if i < len(row) else '')

for i in xrange(1,MAXCOLS):
    dummy=0
    #print('Bus_Vol[{}]: {}'.format(i, Bus_Vol[i]))

i want to be able to specify the directory folder to folder1 and also iterate through folder1 to folder8 which all have the same csv file with the same name

Lost · Accepted Answer · 2018-02-11 18:42:10Z

1

To read a directory other than where your script is located, you need to provide python the absolute path to the directory.

Windows style: c:\path\to\directory

*nix style: /path/to/directory

In either case it'll be a string.

You didn't specify if your target folders were in the same directory or not. If they are, it's a bit easier.

import os
path_to_parent = "/path/to/parent"

for folder in os.listdir(path_to_parent):
    for csv_file in os.listdir(os.path.join(path_to_parent, folder)):
        # Do whatever to your csv file here

If your folders are spread out on your system, then you have to provide an absolute path to each one:

import os
paths_to_folders = ['/path/to/folder/one', '/path/to/folder/two']

for folder in paths_to_folders:
   for csv_file in os.listdir(folder):
        # Do whatever to your csv file

answered Feb 11, 2018 at 18:42

Lost

1,00811 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Lost Over a year ago

Awesome! Good luck on the rest of the project

Collectives™ on Stack Overflow

Read csv files from multiple folders using a for loop

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related