how to write output from python in different columns in CSV?

Question

I have the output of list1 in 1st column and I want list2 in 2nd column. How can I do this? Or does anyone has a better solution? list1 is for all folders (about 200+) in directory which are automatically generated with os.mkdir(directory). Now I want in 2nd column to check each folder for a file with .raw.txt and print Yes/No in the 2nd column. here you can see my output in csv

´   
    for list1 in fieldnames:
        for path, dir_folder, files in os.walk(path):
            for files in dir_folder:
                w.writerow(files.split())

    for list2 in fieldnames:
        for files in os.listdir(path):
            try:
                if os.path.exists("*\\raw.txt"):
                    print("Yes")
                else:
                    print("No")
            except:
                continue`

list1 is name of folder in 1st column and list2 is 2nd column with Y/N — Volcano
– Volcano, Commented Sep 14, 2022 at 9:59
Got confused after looking at the other answer, and thought maybe list1 is file names, I have added my answer — Hassan Jalil
– Hassan Jalil, Commented Sep 14, 2022 at 11:22

Hassan Jalil · Accepted Answer · 2022-09-15 06:53:29Z

1

This should be able to solve the problem.

You can always create a list of dictionary, store values in it and then write it to csv.

Here is a code that does that

import os
import csv
result_list = []
for path, dir_folder, files in os.walk('./test_folder'):
    raw_exists = "No"
    for file_name in files:
        if file_name.endswith('raw.txt'):
            raw_exists="Yes"
            break  
    row_dict={
        "Folder Name": os.path.basename(path),
        "Raw exists": raw_exists
    }
    result_list.append(row_dict)

with open('test.csv', 'w', encoding='utf8', newline='') as output_file:
    fc = csv.DictWriter(output_file, fieldnames=result_list[0].keys())
    fc.writeheader()
    fc.writerows(result_list)

edited Sep 15, 2022 at 6:53

answered Sep 14, 2022 at 9:39

Hassan Jalil

1,2034 gold badges16 silver badges36 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Volcano Over a year ago

one last question, how can I remove the path in the folder name and just leave the name of the folder, not the path?

Hassan Jalil Over a year ago

row_dict={ "Folder Name": os.path.basename(path), "Raw exists": raw_exists } Updated the answer as well

Volcano Over a year ago

one last thing. In CSV there is the main folder(path) listed in the 1st place. is there any way to stop listing the main folder in csv??

Hassan Jalil Over a year ago

@Volcano that I am not really sure about. Will have to dig in a bit. Also updated the code a bit to make the if condition simpler since we already get a list of files from the os.walk so we dont need extract them separately

Ryo Suzuki · Accepted Answer · 2022-09-14 10:19:03Z

1

Does this do what you're looking for?:

for path, dir_folder, files in os.walk(path):
    for file in files:
        w.writerow([dir_folder, "Yes" if file[-8:] == ".raw.txt" else "No"])

edited Sep 14, 2022 at 10:19

answered Sep 14, 2022 at 9:25

Ryo Suzuki

1328 bronze badges

2 Comments

Volcano Over a year ago

thanks, that helped a little. It adds the file xxxxx.raw.txt in column 1 (below the folder name) and shows "Yes" in column 2. How can I change it so that it doesn't add the .raw.txt file in Column1 and just shows Y/N next to the folder names?

Ryo Suzuki Over a year ago

I've updated my answer but basically just replace files with dir_folder

Martin Evans · Accepted Answer · 2022-09-14 10:30:19Z

0

To create a CSV file showing which folders contain a file ending raw.txt you could do the following:

import csv
import os

path = '/'

with open('output.csv', 'w', newline='') as f_output:
    csv_output = csv.writer(f_output)
    
    for dirpath, dirnames, filenames in os.walk(path):
        for filename in filenames:
            if filename.endswith("raw.txt"):
                csv_output.writerow([dirpath, "Yes"])
                break
        else:
            csv_output.writerow([dirpath, "No"])

answered Sep 14, 2022 at 10:30

Martin Evans

46.9k17 gold badges88 silver badges104 bronze badges

Collectives™ on Stack Overflow

how to write output from python in different columns in CSV?

3 Answers 3

4 Comments

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

4 Comments

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related