Extract string based on pattern in shell script

Question

I am writing a script and stuck at a point where I have to extract a string based on the pattern. I have tried using awk and cut but not be able to get the correct outcome.

These are 3 lines in my file and I am looking to extract 2nd last column

expected output

MxMonitor_Marvel_PI49
alert_manager
MxMonitor_Marvel_PI49

I tried the below one which is the closest I get but it extracts only for few lines not all of them.

awk  -F"," '{print $10}' Filename.txt

File Content

./subsearch_nested_fa89eeb0810630b9_1626351940.6/metadata.csv:2:"read : [ admin ], write : [ admin ]",admin,"MxMonitor_Marvel_PI49",300
./scheduler__nobody_YWxlcnRfbWFuYWdlcg__RMD5922da96313b0bb40_at_1626282000_20762/metadata.csv:2:"read : [ splunk-system-user ], write : [ splunk-system-user ]","splunk-system-user","alert_manager",86400
./subsearch_admin__admin_TXhNb25pdG9yX01hcnZlbF9QSTQ5__search12_1626351937.20757776_1626351938.1/metadata.csv:2:"read : [ admin ], write : [ admin ]",admin,"MxMonitor_Marvel_PI49",300

Ed Morton · Accepted Answer · 2021-07-16 12:36:16Z

5

$ awk -F'"' '{print $(NF-1)}' file
MxMonitor_Marvel_PI49
alert_manager
MxMonitor_Marvel_PI49

answered Jul 16, 2021 at 12:36

Ed Morton

209k18 gold badges90 silver badges212 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

anubhava · Accepted Answer · 2021-07-16 10:39:55Z

3

You may try this shorter awk:

awk '{gsub(/^.*,"|",.*/, "")} 1' file

MxMonitor_Marvel_PI49
alert_manager
MxMonitor_Marvel_PI49

So similar sed:

sed -E 's/^.*,"|",.*//g' file

answered Jul 16, 2021 at 10:39

anubhava

790k67 gold badges603 silver badges671 bronze badges

Comments

RavinderSingh13 · Accepted Answer · 2021-07-16 10:35:49Z

3

With your shown samples, please try following code. Set field separator as , and remove starting, ending " from 2nd last field and finally print it.

awk -F, '{gsub(/^"|"$/,"",$(NF-1));print $(NF-1)}' Input_file

answered Jul 16, 2021 at 10:35

RavinderSingh13

135k14 gold badges61 silver badges100 bronze badges

Comments

The fourth bird · Accepted Answer · 2021-07-16 14:57:07Z

1

If the field separator is a comma and the values can be optionally wrapped in double quotes, for the example data you might set the field separator to a comma between optional double quotes using "?,"?

awk -F '"?,"?' '{print $(NF-1)}' file

Output

MxMonitor_Marvel_PI49
alert_manager
MxMonitor_Marvel_PI49

answered Jul 16, 2021 at 14:57

The fourth bird

165k16 gold badges61 silver badges75 bronze badges

Collectives™ on Stack Overflow

Extract string based on pattern in shell script

4 Answers 4

Comments

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related