how to log or print python elasticsearch-dsl query that gets invoked

Question

I am using elasticsearch-dsl for my python application to query elastic search.

To debug what query is actually getting generated by elasticsearch-dsl library, I am unable to log or print the final query that goes to elasticsearch.

For example, like to see the request body sent to elasticsearch like this :

{
    "query": {
        "query_string": {
           "query": "Dav*",
           "fields": ["name", "short_code"],
           "analyze_wildcard": true
        }
    }
}

Tried to bring the elasticsearch log level to TRACE. Even then, unable to see the queries that got executed.

Andrei Stefan · Accepted Answer · 2015-10-29 09:55:14Z

4

Take a look at my blog post here, "Slowlog settings at index level" section. Basically, you can use slowlog to print in a separate log file Elasticsearch generates, the queries. I suggest using a very low threshold to be able to see all the queries.

For example, something like this, for a specific index:

PUT /test_index/_settings
{
  "index": {
    "search.slowlog.level": "trace",
    "search.slowlog.threshold.query.trace": "1ms"
  }
}

Or

PUT /_settings
{
  "index": {
    "search.slowlog.level": "trace",
    "search.slowlog.threshold.query.trace": "1ms"
  }
}

as a cluster-wide setting, for all the indices.

And the queries will be logged in your /logs location, a file called [CLUSTER_NAME]_index_search_slowlog.log.

answered Oct 29, 2015 at 9:55

Andrei Stefan

52.5k6 gold badges102 silver badges92 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Sairam Krish Over a year ago

Thanks Andrei for your answer. This satisfies my current debugging needs.,

Anupam Over a year ago

Thanks - this helped. For others' reference, there are some additional ideas here

Anupam Over a year ago

I wonder how to turn the slow log off. "-1" does not work

Collectives™ on Stack Overflow

how to log or print python elasticsearch-dsl query that gets invoked

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related