Filter an array of JSON objects using a regex test condition

Question

I often get sent HAR files (which are JSON) sent to me that look like this:

{
    "log": {
        "entries" : [
            {
                "request" : {
                    "url" : "test.css"
                }
            },
            {
                "request" : {
                    "url" : "test.ok"
                }
            },
            {
                "request" : {
                    "url" : "test.font"
                }
            },
            {
                "request" : {
                    "url" : "ok"
                }
            }
        ]
    }
}

I don't care about requests that contain URLs for fonts, CSS, or JavaScript. So, I'd like to remove these requests using jq. Given the answer from @iain-samuel-mclean-elder about filtering and maintaining the JSON structure of the input, I would expect something like this to work:

This, however, produces the error:

jq: error (at <stdin>:25): Cannot iterate over null (null)

What am I doing wrong? How can I create a valid HAR file excluding requests for these certain matching URLs using jq?

Inian · Accepted Answer · 2020-04-06 11:30:01Z

4

You should be really careful where and how select statements are used. Avoiding the error of incorrect parent path .[] in your original filter

[select(.log.entries[].request.url | test("\\.(js|css|font)") | not)]

will produce the whole input twice because the filter asserts true for two of your objects because select() replicates the entire input on true condition.

By virtue of doing .log.entries|=, your input is now only on the array of objects which when asserted true through regex are retained and the others excluded.

jq '.log.entries |= ( map ( select ( .request.url | test("\\.(js|css|font)") |not ) ) )'

edited Apr 6, 2020 at 11:30

answered Apr 6, 2020 at 11:05

Inian

87k15 gold badges166 silver badges183 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Travis Spencer Over a year ago

Very much appreciated, @inian! I removed the extra ( before map to try to keep it as simple as possible. Works perfectly though. Thanks for the explanation and help.

Collectives™ on Stack Overflow

Filter an array of JSON objects using a regex test condition

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related