JOLT transform JSON merge array, but values from another fields

Question

I need to extract values from primary_keys array and join them into one string. But I'm having troubles with values extraction.

Simplified input json:

{
  "primary_keys": [
    "ITEM",
    "LOC",
    "COMP_ID"
  ],
  "ITEM": "ID158",
  "LOC": 41,
  "COMP_ID": "BPF",
  "VALUE": 0.78
}

Expected output:

{
  "PK": "ID158|41|BPF",
  "ITEM": "ID158",
  "LOC": 41,
  "COMP_ID": "BPF",
  "VALUE": 0.78
}

Content of primary_keys array may differ from one flowfile to another. I appreciate any input. thanks!

Barbaros Özhan · Accepted Answer · 2021-09-11 00:03:23Z

1

You can use modify-overwrite-beta transformation along with join function after deriving an array(PK) composed of the respective values for the each members of primary_keys array through use of shift transformations such as

[
  {
    "operation": "shift",
    "spec": {
      "*": "&",
      "primary_keys": {
        "*": {
          "*": { "$": "PK.@(4,&)" }
        }
      }
    }
  },
  {
    "operation": "shift",
    "spec": {
      "*": "&",
      "PK": {
        "*": {
          "$": "&2"
        }
      }
    }
  },
  {
    "operation": "modify-overwrite-beta",
    "spec": {
      "PK": "=join('|',@(1,&))"
    }
  }
]

edited Sep 11, 2021 at 0:03

answered Sep 10, 2021 at 21:38

Barbaros Özhan

65.9k11 gold badges36 silver badges64 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

JOLT transform JSON merge array, but values from another fields

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related