Using jq to split a string into nested objects

Question

I'm trying to export data from consul kv into json with a nested object for each level of depth in consul.

Example json returned from consul:

[
  {
    "LockIndex": 0,
    "Key": "foobar/testing",
    "Flags": 0,
    "Value": "xxxxx",
    "CreateIndex": 833,
    "ModifyIndex": 833
  },
  {
    "LockIndex": 0,
    "Key": "foobar/bazbar",
    "Flags": 0,
    "Value": "xxxxx",
    "CreateIndex": 833,
    "ModifyIndex": 833
  }
]

Desired JSON:

[
  {
    "foobar": {
      "testing": "xxxxx",
      "bazbar": "xxxxx"
    }
  }
]

I'm sort of close with jq '.[] | objects | {Key: .Key | split("/"), Value: .Value}' but I'm just not understanding how I can recurse based on a split() of .Key and create nested objects. I think I'll also need to sort_by(.Key) to handle out of order data, unless I can | add arbitrarily and have jq resolve the structure.

I realize xxxxx is base64 encoded, and hopefully, base64d will get merged soon but until then I think I can handle decoding this with shell post-processing.

peak · Accepted Answer · 2016-03-22 06:33:52Z

10

The following produces the JSON object of interest in the particular case you give, but also provides a reasonable generalization in case there is more than one "foobar" prefix:

map( . as $o | .Key | split("/") | {(.[0]): {(.[1]): ($o|.Value) }} )
| reduce .[] as $o
    ( {};
      ($o|keys[0]) as $key | . + { ($key): (.[$key] + $o[$key]) } )

Output:

{
  "foobar": {
    "testing": "xxxxx",
    "bazbar": "xxxxx"
  }
}

edited Mar 22, 2016 at 6:33

answered Mar 22, 2016 at 6:25

peak

119k21 gold badges185 silver badges218 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

jq170727 · Accepted Answer · 2017-08-26 15:41:58Z

1

Here is a solution that uses reduce, split and setpath

[
  reduce (.[] | [(.Key | split("/")), .Value]) as [$p,$v] (
    {}
  ; setpath($p; $v)
  )
]

answered Aug 26, 2017 at 15:41

jq170727

15k6 gold badges52 silver badges61 bronze badges

Comments

Stephen · Accepted Answer · 2018-07-15 00:39:29Z

0

This simple solution uses setpath to handle any depth and works great for parsing Consul KV responses:

    reduce .[] as $item ({}; setpath($item.Key | split("/"); $item.Value))

answered Jul 15, 2018 at 0:39

Stephen

1011 silver badge2 bronze badges

Collectives™ on Stack Overflow

Using jq to split a string into nested objects

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related