Elasticsearch scroll not working

Question

I am running the following elasticsearch aggregation query

curl -XPOST 'http://localhost:9200/ae2015/_search/?scroll=1m' -d '{
            "size" : 0,
            "query":{"constant_score":{"filter": {"geo_bounding_box" : {"location": {"top_left" : [-180, 85],"bottom_right" : [180, -85]}}}}},
            "aggs":{
                "grid": {
                    "geohash_grid": {"field":"location","precision": 3},
                    "aggs": {
                        "count":{"sum":{"field":"count"}}
                    }
                }
            }
        }'

This returns a scroll_id as expected, but when I use it, the response is "empty", ie

{"_scroll_id":"xxx","took":936,"timed_out":false,"_shards":{"total":5,"successful":5,"failed":0},"hits":{"total":13238893,"max_score":0.0,"hits":[]}}

It's as if scrolling doesn't work with aggregations.

Any suggestion would be very much appreciated.

Val · Accepted Answer · 2016-09-29 15:02:23Z

4

From the official documentation on scrolling:

If the request specifies aggregations, only the initial search response will contain the aggregations results.

answered Sep 29, 2016 at 15:02

Val

218k14 gold badges377 silver badges384 bronze badges

Sign up to request clarification or add additional context in comments.

10 Comments

Thomas Over a year ago

awwww, I missed that somehow. Thanks. I'm stuck then??? I tried raising the max_result_window on my index but it doesn't seem to change anything... still stuck on 10000

Val Over a year ago

With scrolling you can retrieve all your millions of document (i.e. the hits), but aggregations are a different thing and you cannot "scroll" over them like you'd do with documents. max_result_window is only for documents/hits, not aggregations.

Thomas Over a year ago

OK, yet the 10000 default limit seems to apply, any idea? maybe there is a different parameter for this?

Val Over a year ago

Oh, indeed, the geohash_grid has a default size of 10000, so you can increase the size as you see fit.

Val Over a year ago

No worries, glad we figured it out!

|

Collectives™ on Stack Overflow

Elasticsearch scroll not working

1 Answer 1

10 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

10 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related