string parsing & date formatting unix

Question

I am looking for unix command to parse the below strings to the desired format as below.

Connected to Integration Service: [is_infa01]. Integration Service status: [Running] Integration Service startup time: [Mon May 09 10:27:22 2016] Integration Service current time: [Sun Jun 05 21:57:33 2016] Folder: [TEST] Workflow: [wf_MASTER_DAILY] version [2]. Workflow run status: [Succeeded] Workflow run error code: [0] Workflow run error message: [Completed successfully.] Workflow run id [425197]. Start time: [Sat Jun 04 13:14:11 2016] End time: [Sat Jun 04 13:20:37 2016] Workflow log file: [/informatica/pc961/server/infa_shared/Working/infa01/WorkflowLogs/wf_MASTER_DAILY.log]

I am looking to parse the above string and get the below output (with date format as YYYY-MM-DD HH:MM:DD)

Workflow run status|Start time|End time
Succeeded|2016-06-04 13:14:11|2016-06-04 13:20:37

I can get the value of individual values like below

grep "Workflow run status:" | cut -d'[' -f2 | cut -d']' -f1
grep "Start time:" | cut -d'[' -f2 | cut -d']' -f1
grep "End time:" | cut -d'[' -f2 | cut -d']' -f1

but how to make the desired output with date formatting?

It would help if you format the input properly. It's unclear where the line starts & where it ends. Do not format logs using block-quote. Use pre for formatting them. — anishsane
– anishsane, Commented Jun 6, 2016 at 5:48

Rahul · Accepted Answer · 2016-06-06 05:22:18Z

2

If you can get the "start time" value using your grep expression, you can use below date command to convert it into desired timestamp if you have -d option, like :

date -d 'Sat Jun 04 13:14:11 2016' +'%Y-%m-%d %T'

edited Jun 6, 2016 at 5:22

answered Jun 6, 2016 at 5:19

Rahul

4183 gold badges9 silver badges25 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

glenn jackman · Accepted Answer · 2016-06-06 14:55:41Z

0

Assuming GNU grep, you can wrap it all up like this:

string="Connected to Integration Service: [is_infa01]. Integration Service status: [Running] Integration Service startup time: [Mon May 09 10:27:22 2016] Integration Service current time: [Sun Jun 05 21:57:33 2016] Folder: [TEST] Workflow: [wf_MASTER_DAILY] version [2]. Workflow run status: [Succeeded] Workflow run error code: [0] Workflow run error message: [Completed successfully.] Workflow run id [425197]. Start time: [Sat Jun 04 13:14:11 2016] End time: [Sat Jun 04 13:20:37 2016] Workflow log file: [/informatica/pc961/server/infa_shared/Working/infa01/WorkflowLogs/wf_MASTER_DAILY.log]"
w="Workflow run status" s="Start time" e="End time"
{ 
    printf "%s\n" "$w" "$s" "$e"
    grep -oP "$w: \\[\\K.*?(?=\\])" <<<"$string" 
    date -d "$(grep -oP "$s: \\[\\K.*?(?=\\])" <<<"$string")" "+%F %T"
    date -d "$(grep -oP "$e: \\[\\K.*?(?=\\])" <<<"$string")" "+%F %T"
} | paste -d'|' - - -

outputs

Workflow run status|Start time|End time
Succeeded|2016-06-04 13:14:11|2016-06-04 13:20:37

answered Jun 6, 2016 at 14:55

glenn jackman

249k42 gold badges233 silver badges362 bronze badges

1 Comment

rkj Over a year ago

I think I will go with your code ,works fine as well. @glenn jackman

rkj · Accepted Answer · 2016-06-06 14:40:06Z

0

Here is the final working code to grep & format the date

grep "Start time:" | cut -d'[' -f2 | cut -d']' -f1 | read dt ; date -d "$dt" +'%Y-%m-%d %T'

answered Jun 6, 2016 at 14:40

rkj

7115 gold badges14 silver badges28 bronze badges

Collectives™ on Stack Overflow

string parsing & date formatting unix

3 Answers 3

Comments

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related