add column with incrementing integer to multiple csv files

Question

I have a directory with thousands of csv files, each with 64 columns and 700+ lines. I would like to combine for importing into database tables.

Using cat, combining the files is no problem. However, each file represents a separate event, so when querying the database I would like to be able to extract just the lines from an individual file.

Is there a way to add an incrementing integer to each file before combing them?

for example:

log_file1

a, b, c, d,...
a, b, c, d,...
a, b, c, d,...

log_file2

a, b, c, d,...
a, b, c, d,...
a, b, c, d,...

to

log_file1

1, a, b, c, d...
1, a, b, c, d...
1, a, b, c, d...

log_file2

2, a, b, c, d...
2, a, b, c, d...
2, a, b, c, d...

Thanks

Ed Morton · Accepted Answer · 2014-10-08 15:40:32Z

2

Using GNU awk:

awk '{print ARGIND "," $0}' *.csv

answered Oct 8, 2014 at 15:40

Ed Morton

209k18 gold badges90 silver badges212 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

glenn jackman · Accepted Answer · 2014-10-08 15:30:05Z

1

With awk, you could write:

awk 'FNR==1 {count++} {print count "," $0}' *.csv

That increments the "count" variable when the first record of each file is being processed.

answered Oct 8, 2014 at 15:30

glenn jackman

249k42 gold badges233 silver badges362 bronze badges

Collectives™ on Stack Overflow

add column with incrementing integer to multiple csv files

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related