Wrong values returned by Elasticsearch's script_field for array.values

Question

I've tried to retrieve array values from my data by using script_fields, but I received inconsistent results.

My mapping:

curl -XPUT localhost:9200/test/user/_mapping -d '
{
  "user": {
    "properties": {
      "id": {
        "type": "string",
        "index": "not_analyzed"
      },
      "other_ids": {
        "type": "string",
        "index": "not_analyzed"
      }
    }
  }
}
'

Some test data:

curl -XPUT localhost:9200/test/user/id1 -d '
{
  "id": "id1",
  "other_ids": [
    "id2",
    "id3"
  ]
}
'

curl -XPUT localhost:9200/test/user/id2 -d '
{
  "id": "id2",
  "other_ids": [
    "id1"
  ]
}
'

curl -XPUT localhost:9200/test/user/id3 -d '
{
  "id": "id3",
  "other_ids": [
    "id1",
    "id2"
  ]
}
'

The "simplified" query:

curl -XGET 'localhost:9200/test/user/_search?pretty=1'  -d '
{
  "fields": [
    "_source"
  ],
  "query": {
    "match_all": {}
  },
  "script_fields": {
    "other_id_script": {
      "lang": "groovy",
      "script": "doc[\"other_ids\"].values"
    }
  }
}
'

The relevant parts from the answer:

  "hits" : {
    "total" : 3,
    "max_score" : 1.0,
    "hits" : [ {
      "_source":{"id":"id1","other_ids":["id2","id3"]},
      "fields" : {
        "other_id_script" : [ [ "id1", "id2" ] ]
      }
    }, {
      "_source":{"id":"id2","other_ids":["id1"]},
      "fields" : {
        "other_id_script" : [ [ "id1", "id2" ] ]
      }
    }, {
      "_source":{"id":"id3","other_ids":["id1","id2"]},
      "fields" : {
        "other_id_script" : [ [ "id1", "id2" ] ]
      }
    } ]
  }

As we can see the values of other_id_script are different from the current doc's other_ids values in the first two cases.

Is it an error, or am I missed something?

(The whole script can be found here: https://gist.github.com/baloghz/c27e39ad419a6f4684ab)

i'm unable to replicate it in elasticsearch version 1.3.0 , java 1.7.0_65 — keety
– keety, Commented Nov 10, 2014 at 19:56
Thanks for trying! I have elasticsearch version 1.3.0 , java 1.7.0_67-b01. What kind of settings can cause this kind of strange results (some kind of cache related maybe)? — Zoltan Balogh
– Zoltan Balogh, Commented Nov 11, 2014 at 9:58
I'm noticing the same problem. Were you able to figure out how to fix this? — Swaraj
– Swaraj, Commented May 2, 2015 at 0:39

user161107 · Accepted Answer · 2015-05-04 21:22:55Z

2

It looks like this problem was addressed in Elasticsearch issue #8576, was fixed by commit d22645c, and is live in versions 1.3.6, 1.4.1, and 1.5.0.

The author of the issue also gave a workaround:

"script": "doc[\"other_ids\"].values.take(100)"

answered May 4, 2015 at 21:22

user161107

4113 silver badges6 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Wrong values returned by Elasticsearch's script_field for array.values

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related