Elasticsearch: remove/update field inside nested object

Question

{
  "_index" : "test",
  "_type" : "test",
  "_id" : "1212",
  "_version" : 5,
  "found" : true,
  "_source" : {
    "count" : 42,
    "list_data" : [ {
      "list_id" : 11,
      "timestamp" : 1469125397
    }, {
      "list_id" : 122,
      "timestamp" : 1469050965
    } ]
  }
}

This is my document schema.list_data is nested object. I have requirement to update/delete particular filed inside list_data. I am able to update count field using groovy script.

$ curl -XPOST 'localhost:9200/index/type/1212/_update?pretty' -d '
{
    "script" : "ctx._source.count = 41"
}'

But don't know how to update nested object.

For example i want to add this into list_data.

{
   "list_id" : 121,
   "timestamp" : 1469050965
}

and my document should change to:

{
  "_index" : "test",
  "_type" : "test",
  "_id" : "1212",
  "_version" : 6,
  "found" : true,
  "_source" : {
    "count" : 41,
    "list_data" : [ {
      "list_id" : 11,
      "timestamp" : 1469125397
    }, {
      "list_id" : 121,
      "timestamp" : 1469050965
    }, {
      "list_id" : 122,
      "timestamp" : 1469050965
    } ]
  }
}

and if i perform delete based on list_id = 122 my record should look like

{
  "_index" : "test",
  "_type" : "test",
  "_id" : "1212",
  "_version" : 7,
  "found" : true,
  "_source" : {
    "count" : 41,
    "list_data" : [ {
      "list_id" : 11,
      "timestamp" : 1469125397
    }, {
      "list_id" : 121,
      "timestamp" : 1469050965
    }]
  }
}

For add, this may be a better answer: stackoverflow.com/questions/42009778/… @Priyesh — Yun Li
– Yun Li, Commented Jul 3, 2019 at 2:33
What worked for me was the instructions in the following link. Perhaps it is the version of ES. — Amaresh Kulkarni
– Amaresh Kulkarni, Commented Feb 26, 2020 at 0:06

Val · Accepted Answer · 2016-08-03 11:25:20Z

8

To add a new element to your nested field you can proceed like this:

$ curl -XPOST 'localhost:9200/index/type/1212/_update?pretty' -d '
{
    "script" : "ctx._source.list_data += newElement",
    "params": {
        "newElement": {
           "list_id" : 121,
           "timestamp" : 1469050965
        }
    }
}'

To remove an existing element from your nested field list, you can proceed like this:

$ curl -XPOST 'localhost:9200/index/type/1212/_update?pretty' -d '
{
    "script" : "ctx._source.list_data.removeAll{it.list_id == remove_id}",
    "params": {
        "remove_id" : 122
    }
}'

answered Aug 3, 2016 at 11:25

Val

218k14 gold badges377 silver badges384 bronze badges

Sign up to request clarification or add additional context in comments.

11 Comments

Nishant Kumar Over a year ago

Thanks a lot @Val. Is it supported through Elastic java client ? If you can provide Java client code for same operations that will be great.

Nishant Kumar Over a year ago

The add method keep adding values even if it's already present. I want to check if list_id is already present then only update timestamp value otherwise add it. If you can provide some link to learn this script part it will be helpful for me in future.

Val Over a year ago

You can do it simply by modifying the script with an if/else case accordingly.

Qin Dong Liang Over a year ago

@Val how to update list_id's timestamp for example list_id=121 ?

Val Over a year ago

@QinDongLiang Your script needs to iterate over the list and find the right one to edit

|

vikasrajputin · Accepted Answer · 2021-12-31 02:25:08Z

4

I was getting the error [UpdateRequest] unknown field [params] as I was using the latest version of ElasticSearch 7.9.0 (When wrote this answer 7.9.0 was the latest), seems like the syntax is changed a bit.

Following should work for newer versions of ElasticSearch:

$ curl -XPOST 'localhost:9200/<index-name>/_update/1212'
{
  "script": {
    "source": "ctx._source.list_data.removeIf(list_item -> list_item.list_id == params.remove_id);",
    "params": {
      "remove_id": 122
    }
  }
}

edited Dec 31, 2021 at 2:25

answered Oct 30, 2020 at 12:44

vikasrajputin

911 silver badge5 bronze badges

Comments

barbsan · Accepted Answer · 2019-07-05 10:30:36Z

1

I don't know why, but I find that

ctx._source.list_data.removeAll{it.list_id == remove_id}

can't work. Instead I use removeIf like this:

ctx._source.list_data.removeIf{list_item -> list_item.list_id == remove_id}

where list_item could be arbitrary string.

edited Jul 5, 2019 at 10:30

barbsan

3,46811 gold badges23 silver badges29 bronze badges

answered Jul 5, 2019 at 10:18

Yun Li

251 gold badge2 silver badges7 bronze badges

2 Comments

Suraj Dalvi Over a year ago

how we can add multiple conditions over here?

Yun Li Over a year ago

ctx._source.list_data.removeIf{list_item -> list_item.list_id == remove_id && list_item.list_id != ID012} just a hint.

Collectives™ on Stack Overflow

Elasticsearch: remove/update field inside nested object

3 Answers 3

11 Comments

Comments

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

11 Comments

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related