Elasticsearch : aggregation "existing" fields

Question

I'm quite new to ElasticSearch aggregations. I want to be able to count how many documents are retrieved with a not null field.

Here's what I do to count how many documents don't have a name field.

{
  "size": 3,
  "query": {
    "query_string": {
      "query": "martin"
    }
  },
  "aggs": {
    "results_without_mb_id": {
      "missing": {
        "field": "name"
      }
    }
  }
}

It works but I want to do the exact opposite. Is there an existing aggregation?

Noumenon · Accepted Answer · 2022-04-19 08:06:32Z

16

Do this by passing an 'exists' filter to a filter aggregation. Like above, just replace 'missing' with 'exists', and also add 'filter' key, so:

{ "size": 3, 
  "query": {
    "query_string": {
      "query" : "martin"
    } 
  }, 
  "aggs": {
    "results_without_mb_id": { 
       "filter": { 
          "exists": { 
            "field": "name" 
          }  
       } 
    } 
}

edited Apr 19, 2022 at 8:06

Noumenon

6,6424 gold badges67 silver badges85 bronze badges

answered Oct 12, 2015 at 7:38

emaxi

1,8091 gold badge17 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

jhilden · Accepted Answer · 2014-10-31 14:49:40Z

3

You want to use the "exists" filter.

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-exists-filter.html

Here is a sample that finds all the documents where authResult.codeID exists, and then runs an aggregation on it.:

GET prodstarbucks/authEvent/_search
{
  "size": 0,
  "query": {
    "filtered": {
      "query": {
        "match_all": {}
      },
      "filter": {
        "exists": {
          "field": "authResult.codeID"
        }
      }
    }
  },
  "aggs": {
    "users": {
      "terms": {
        "field": "authInput.userName.userNameNotAnalyzed",
        "size": 5
      }
    }
  }
}

}

Note: If you only want to count the documents you don't even need an aggregation, just use the "total" number of hits returned.

answered Oct 31, 2014 at 14:49

jhilden

12.5k5 gold badges56 silver badges77 bronze badges

2 Comments

litil Over a year ago

actually I don't want to change my query. I just want to count the number of documents with a not null "name" (and "age", and ... ).

jhilden Over a year ago

"exists" (aka not null) is only valid as a filter option, you can't put it in your query node. You can combine filters and queries together as I did in my example above. So you would have "Name" in the exists filter, and your query_string stuff in the query portion.

Collectives™ on Stack Overflow

Elasticsearch : aggregation "existing" fields

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related