Elasticsearch java api get average of terms aggregation

Question

I'm using elasticsearch with java api and I'm trying to get average value of lowest record from each bucket of term aggregation. One solution I found is to get results like this

AggregationBuilders.terms("group_by_flights").field("flight_id)
    .subAggregation(AggregationBuilders.min("minimum").field("duration")))

and then count average on the code side. The problem is that if there will be lot of result, it will allocate a lot of memory to count it. I would like to do this on elastic side. I found, that there is something like avg bucket pipeline aggregation, which can be add as sibling aggregation to terms (and others)

"the average": {
  "avg_bucket": {
    "buckets_path": "some_bucket_path" 
  }
}

Problem is that in java api you can add pipeline aggregation only as subaggregation. So if we construct our aggregation like this our terms aggregation won't be seen

AggregationBuilders.terms("group_by_flights").field("flight_id")
    .subAggregation(PipelineAggregatorBuilders.avgBucket("avg", "group_by_flights.duration" *<- this wont't be seen because its subaggregation*))

I was thinking about making some empty top aggregation and then add all aggregations as subaggregations, but it seems like silly walk-around, and I'm not understanding something correctly. Any ideas?

Paweł Sosnowski · Accepted Answer · 2018-11-06 15:22:28Z

1

The only solution I found so far is to make aggregations as sub aggregation of "empty aggregation"

AggregationBuilders.global("global_aggregation")
    .subAggregation((AggregationBuilders.terms("group_by_flights").field("flight_id"))
        .subAggregation(AggregationBuilders.min("min").field("duration")))
    .subAggregation(PipelineAggregatorBuilders.avgBucket("avg_bucket_aggs","group_by_flights>min"))

edited Nov 6, 2018 at 15:22

answered Nov 6, 2018 at 15:17

Paweł Sosnowski

1724 silver badges14 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Lakhwinder Singh · Accepted Answer · 2018-12-19 06:49:58Z

1

My solution is use FilterAggregationBuilder to do it, this one can filtering data.The first sub aggregation to make data bucket, the second sub aggregation to merge bucket data.

AggregationBuilders.filter("global_aggregation", bool)
    .subAggregation((AggregationBuilders.terms("group_by_flights").field("flight_id"))
    .subAggregation(AggregationBuilders.min("min").field("duration")))
    .subAggregation(PipelineAggregatorBuilders.avgBucket("avg_bucket_aggs", "group_by_flights>min"));

edited Dec 19, 2018 at 6:49

Lakhwinder Singh

5,5825 gold badges30 silver badges52 bronze badges

answered Dec 19, 2018 at 5:57

SuperPirate

1461 silver badge5 bronze badges

Collectives™ on Stack Overflow

Elasticsearch java api get average of terms aggregation

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related