For loop in Python with merging by rows pandas dataframe

Question

I have a function (function_from_xml_pddataframe) that takes xml files from data folder and transform to pandas dataframe called df_xml.

After this I need to create only one pandas dataframe (all_dfs) by merging them all by row.

This is what I did so far with a for loop:

import os
all_dfs = pd.DataFrame()

for file in tqdm("/data"):

    if file.endswith(".xml"):
      function_from_xml_pddataframe(xmlfile)
      
      df_created = df_xml

Create a list of dataframes by appending df_xml to the list inside the for loop, then pd.concat that list after the for loop. — Scott Boston
– Scott Boston, Commented Mar 29, 2022 at 14:27
@ScottBoston, thanks for your time. This is exactly the idea. How I append df_xml to the list inside the loop? — Laura
– Laura, Commented Mar 29, 2022 at 14:32

Titouan L · Accepted Answer · 2022-03-29 14:32:28Z

2

Considering that all your DataFrames have the same columns, you can build a list in the for loop.

import os
list_of_dataframes = []

for file in tqdm("/data"):

    if file.endswith(".xml"):
        df_xml = function_from_xml_pddataframe(xmlfile)
        list_of_dataframes.append(df_xml)
      
all_dfs = pd.concat(list_of_dataframes)

answered Mar 29, 2022 at 14:32

Titouan L

1,1731 gold badge11 silver badges27 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

For loop in Python with merging by rows pandas dataframe

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related