Combine multiple JSON array in same file into one JSON array using JQ

Question

I have a file which has multiple individual JSON arrays, which I want to combine (and remove empty arrays) into a single JSON array

Input

[]
[]
[
    [
        [
            "asdfsdfsdf",
            "CCsdfnceR1",
            "running",
            "us-east-1a",
            "34.6X.7X.2X",
            "10.75.170.118"
        ]
    ]
]
[]
[]
[
    [
        [
            "tyutyut",
            "CENTOS-BASE",
            "stopped",
            "us-west-2b",
            null,
            "10.87.159.249"
        ]
    ],
    [
        [
            "tyutyut",
            "dfgdfg-TEST",
            "stopped",
            "us-west-2b",
            "54.2X.8.X8",
            "10.87.159.247"
        ]
    ]
]

Required output

[
    [
        "asdfsdfsdf",
        "CCsdfnceR1",
        "running",
        "us-east-1a",
        "34.6X.7X.2X",
        "10.75.170.118"
    ],
    [
        "tyutyut",
        "CENTOS-BASE",
        "stopped",
        "us-west-2b",
        null,
        "10.87.159.249"
    ],
    [
        "tyutyut",
        "dfgdfg-TEST",
        "stopped",
        "us-west-2b",
        "54.2X.8.X8",
        "10.87.159.247"
    ]
]

I have a file which has multiple individual JSON arrays, which I want to combine (and remove empty arrays) into a single JSON array

Thanks in advance

Are you calling jq from a bash/shell script? That kind of complex munging will get messy fast. I'd write a little Python script in cases like this. — MarkHu
– MarkHu, Commented Oct 3, 2019 at 22:24
the same JSON query alternatively could be achieved using a walk-path unix utility jtc: <input.json jtc -w'<>i:><a[-1]' -J If you like I can elaborate on it in a separate answer. PS. I'm a developer of the jtc unix tool for JSON processing. — Dmitry
– Dmitry, Commented Oct 4, 2019 at 9:51

oguz ismail · Accepted Answer · 2019-10-03 21:46:37Z

1

This selects only non-empty arrays none of whose elements is an array, and puts them into an array:

jq -n '[ inputs | .. | select(type=="array" and .!=[] and all(.[]; type!="array")) ]' file

answered Oct 3, 2019 at 21:46

oguz ismail

51.8k16 gold badges64 silver badges83 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

peak · Accepted Answer · 2019-10-03 22:52:54Z

0

The exact requirements aren't too clear to me but using the following def produces the expected result and might be of interest as it is recursive:

def peel:
  if type == "array"
  then if length == 0 then empty
       elif length == 1 and (.[0] | type) == "array" then .[0] | peel
       elif all(.[]; type=="array") then .[] | peel
       else [.[] | peel]
       end
  else .
  end;

With this def, and the following "main" program:

[inputs | peel]

an invocation of jq using the -n option produces the expected result.

answered Oct 3, 2019 at 22:52

peak

119k21 gold badges185 silver badges218 bronze badges

Collectives™ on Stack Overflow

Combine multiple JSON array in same file into one JSON array using JQ

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related