Recursive search using awk command

Question

I have 100 log files and I want awk to search for a given pattern between a given timestamp recursively. Log files look something like this

2010-03-24 07:00:01 ZZZZC941948879 RUFFLES 222.222.222.222 GET / - 80 - 220.181.7.113 HTTP/1.1       
2010-03-24 07:00:23 ZZZZC941948879 RUFFLES 222.222.222.222 GET

Code is

 awk -v "b=$date1" -v "e=$date2" '$1 >= b && $1 <= e' log.txt > output
 grep -i "21things" output

I am able to search for the pattern but for single file only. Is it possible using awk command to search recursively?

Thanks for the help..!!

Can you clarify what you mean by "recursive" here? It seems like you might just mean you want to run the awk command on a bunch of files. Also, why are you using -F ',' when there are no commas in the log files? Please edit your question to make it more clear what you're trying to do. — Tom Fenech
– Tom Fenech, Commented Jan 4, 2015 at 20:43

Haribk · Accepted Answer · 2022-07-08 07:34:52Z

5

You can use find command to course through all files recursively in a directory and pass the file into awk. The following will show all the files where a match occurred. Change the <PATTERN> with required:

find . -type f -exec awk '/<PATTERN>/{print FILENAME; nextfile}' '{}' \;

The following will print out all lines matched along with filename:

find . -type f -exec awk '/<PATTERN>/{print FILENAME ":\t" $0;}' '{}' \;

edited Jul 8, 2022 at 7:34

answered Oct 6, 2020 at 5:08

Haribk

3193 silver badges8 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

glenn jackman · Accepted Answer · 2015-01-04 20:46:27Z

4

If your logs are all in the same directory, use a shell wildcard:

awk -v "b=$date1" -v "e=$date2" '$1 >= b && $1 <= e' *.log

Note that awk can do what grep does, so you don't need the temp file:

awk -v "b=$date1" -v "e=$date2" -v patt="21things" '
    $1 >= b && $1 <= e && tolower($0) ~ patt
' *.log

If you have GNU awk, use -v IGNORECASE=1 and remove the tolower function.

answered Jan 4, 2015 at 20:46

glenn jackman

249k42 gold badges233 silver badges362 bronze badges

1 Comment

Jotne Over a year ago

I have always used -v b="$date1", but it seems to works your way too.

Collectives™ on Stack Overflow

Recursive search using awk command

2 Answers 2

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related