how to query with python elasticseach module over multiple indexes?

Question

just for testing, I have a single elasticsearch node containing indexes like:

service-log-17032020 service-log-20032020 service-log-21032020

I am trying to build a query for searching on all indexes with service-log-* pattern. This query works perfectly with the full index name, how can I search on all indexes?

index = INDEX_NAME
query_body = {
            "from":0,
            "size":100,
            "query": {  
              "bool": {
                "must": [
                  {
                    "match" : {
                      "field": "text"
                    }
                  },
                  {                       
                    "range": {
                      "@timestamp": {
                        "gt":str(date)
                      }
                    }
                  }
                ]
              }               
            }
        }

result = elastic_client.search(index=INDEX_NAME, body=query_body)

sethmlarson · Accepted Answer · 2020-06-25 14:45:10Z

7

Since you're using the Python client you can do the following:

from elasticsearch import Elasticsearch

es = Elasticsearch()

# Queries all indices in the cluster.
es.search(index="*", body=...)

# Queries all indices that start with 'logs-'
es.search(index="logs-*", body=...)

# Queries 'logs-1', 'logs-2', and 'logs-5'.
# Serializes to 'logs-1,logs-2,logs-5' in the URL. 
es.search(index=["logs-1", "logs-2", "logs-5"], body=...)

<disclosure: I maintain the Python Elasticsearch client and am employed by Elastic>

answered Jun 25, 2020 at 14:45

sethmlarson

9511 gold badge8 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Mohamed Elzarei · Accepted Answer · 2020-06-25 08:06:14Z

1

You can pass * as the index name.

answered Jun 25, 2020 at 8:06

Mohamed Elzarei

5544 silver badges21 bronze badges

Comments

Javad Bahoosh · Accepted Answer · 2020-06-25 08:09:58Z

1

According to ES docs:

Most APIs that refer to an index parameter support execution across multiple indices, using simple test1,test2,test3 notation (or _all for all indices). It also supports wildcards, for example test* or test or tet or test, and the ability to "exclude" (-), for example test*,-test3.

answered Jun 25, 2020 at 8:09

Javad Bahoosh

4781 gold badge4 silver badges17 bronze badges

Collectives™ on Stack Overflow

how to query with python elasticseach module over multiple indexes?

3 Answers 3

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related