Export filtered rows from log file using batch commands

Question

I have a huge log file (approx 10MB - 20000 rows) which contains the following sample data rows

081741.397 : Received:[8=FIX.4.4     9=68     35=0     34=157     49=CALUAT     52=20131216-08:17:41.239     56=FAUAT     10=232     ]
081749.587 : Send:[8=FIX.4.4     9=64     35=0     49=FAUAT     56=CALUAT     34=158     52=20131216-08:17:49     10=033     ]
081806.623 : Send:[8=FIX.4.4     9=583     35=AE     49=FAUAT     56=CALUAT     34=159     52=20131216-08:18:06     571=7CG8I6220131216     487=2     150=F]
081811.396 : Received:[8=FIX.4.4     9=68     35=0     34=158     49=CALUAT     52=20131216-08:18:11.239     56=FAUAT     10=231     ]
081815.920 : Send:[8=FIX.4.4     9=626     35=AE     49=FAUAT     56=CALUAT     34=160     52=20131216-08:18:15     571=9CG8IF220131216     487=2     150=F]
081824.173 : Send:[8=FIX.4.4     9=558     35=AE     49=FAUAT     56=CALUAT     34=161     52=20131216-08:18:24     571=11CG8I220131216     487=0     150=F]
081841.395 : Received:[8=FIX.4.4     9=68     35=0     34=159     49=CALUAT     52=20131216-08:18:41.239     56=FAUAT     10=235     ]
081858.539 : Send:[8=FIX.4.4     9=64     35=0     49=FAUAT     56=CALUAT     34=169     52=20131216-08:18:58     10=036     ]
081911.394 : Received:[8=FIX.4.4     9=68     35=0     34=160     49=CALUAT     52=20131216-08:19:11.239     56=FAUAT     10=225     ]
081919.303 : Send:[8=FIX.4.4     9=640     35=AE     49=FAUAT     56=CALUAT     34=170     52=20131216-08:19:19     571=27CG8J220131216     487=2     150=F]
081941.393 : Received:[8=FIX.4.4     9=68     35=0     34=161     49=CALUAT     52=20131216-08:19:41.239     56=FAUAT     10=229     ]

I want to fetch only those rows which contains Send: and 35=AE. What sort of regex should I use in batch file to extract only the filtered rows and export them in a separate log file.

you want to remove the send or only want to see the send - I can do a regex for you when you clarify — user2046117
– user2046117, Commented Jan 15, 2014 at 12:34
@owen79 - Just want to filter out the send and export it to text file — Pankaj Jaju
– Pankaj Jaju, Commented Jan 15, 2014 at 13:07

Pankaj Jaju · Accepted Answer · 2014-01-15 15:52:20Z

1

This will find the string "Send:" followed by any squence of characters and the string "35=AE", reading the indicated input file and sending output to the indicated output file

findstr /r /c:"Send:.*35=AE" inputFile > outputFile

To get all the lines except the indicated, the add /v to the list of parameters of findstr to invert the match

EDIT: Removed < redirector dbenham's explanation (bug in FINDSTR)

edited Jan 15, 2014 at 15:52

Pankaj Jaju

5,5112 gold badges29 silver badges43 bronze badges

answered Jan 15, 2014 at 12:39

MC ND

71.1k8 gold badges95 silver badges136 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

MC ND Over a year ago

@PankajJaju, not really needed in this case. Just an habit. Instead of asking findstr to open the file to read, ask cmd to open the file and feed it into findstr.

Pankaj Jaju Over a year ago

Was asking because when I tried it, the records are directed to a new file correctly. However the command is not finishing.

dbenham Over a year ago

@PankajJaju - There is a FINDSTR bug on XP and Windows 7 that causes it to hang if searching redirected input and the last line is misssing a new line character. Pass the name of the file as a parameter and let FINDSTR open it instead of using redirection. See What are the undocumented features and limitations of the Windows FINDSTR command? for a long list of FINDSTR "peculiarities"

MC ND Over a year ago

@dbenham, i forget about it. Thanks

Magoo · Accepted Answer · 2014-01-15 12:42:39Z

1

Your question isn't clear.

If you want to get those lines that contain BOTH of these strings, then

find "Send:" filename|find "35=AE" >a_new_file.txt

If you want to get those lines that EITHER of these strings, then

findstr /L "Send: 35=AE" filename >a_new_file.txt

In either case, add a /i switch to make the search case-insensitive if desired.

answered Jan 15, 2014 at 12:42

Magoo

80.8k8 gold badges68 silver badges92 bronze badges

Comments

Matt Williamson · Accepted Answer · 2014-01-15 12:43:15Z

1

Try this

 findstr /R /I Send:\[.*35=AE.* search.log >> new.log

answered Jan 15, 2014 at 12:43

Matt Williamson

7,1691 gold badge27 silver badges39 bronze badges

Comments

ratavar · Accepted Answer · 2014-01-15 12:49:22Z

1

You could use the following to find the rows and send it to new file

FINDSTR Send.*35=AE a.txt > b.txt

answered Jan 15, 2014 at 12:49

ratavar

514 bronze badges

Comments

foxidrive · Accepted Answer · 2014-01-15 13:14:52Z

1

This is another option, based upon the comments where 35=AE is a unique term.

find "35=AE" <"file.log" >"out.txt"

answered Jan 15, 2014 at 13:14

foxidrive

41.4k11 gold badges61 silver badges71 bronze badges

Comments

user2046117 · Accepted Answer · 2014-01-15 12:39:43Z

0

To only get the rows with Send and 35=AE use

^\d{6}.\d{3} : Send.*35=AE.*

answered Jan 15, 2014 at 12:39

user2046117

Collectives™ on Stack Overflow

Export filtered rows from log file using batch commands

6 Answers 6

4 Comments

Comments

Comments

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

6 Answers 6

4 Comments

Comments

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related