Delete specific docs in elasticsearch using python

Question

I am new to ElasticSearch. I am trying to delete a group of data from http://localhost:9200/es_index/es_type using python.

suppose x=['a','b','c','d','e','f'] is a list of _ids that I want to delete

Code:

from elasticsearch import Elasticsearch 
es = Elasticsearch()
request_body = {
        "query": {
            "ids": {
                "values": ['a','b','c','d','e','f']
            }
        }
    }
es.delete_by_query(index=es_index, body=request_body)

But when I check http://localhost:9200/es_index/es_type the data is still there.

Which version of ES are you running?

Val
– Val

2017-12-30 11:01:38 +00:00
Commented Dec 30, 2017 at 11:01 — Val
– Val, Commented Dec 30, 2017 at 11:01
the version is 6.1.0

prem chopra
– prem chopra

2017-12-30 11:04:11 +00:00
Commented Dec 30, 2017 at 11:04 — prem chopra
– prem chopra, Commented Dec 30, 2017 at 11:04
And which version of elasticsearch-py?

Val
– Val

2017-12-30 11:31:40 +00:00
Commented Dec 30, 2017 at 11:31 — Val
– Val, Commented Dec 30, 2017 at 11:31

MCMZL · Accepted Answer · 2018-01-04 10:38:16Z

2

Please specify your ES and elasticsearch-py version in comments. Also you forgot to mention the value of es_index in your code, so make sure to pass the right one.

If the index is properly set, issue with delete_by_query usually comes from the query itself. Try to run a simple search with the same body and check that you get the desired results. It is always wise to do so to prevent mistakes.

In your case you know the id, so it is more appropriate to use es.delete and pass the id value :

for id in ids:
    es.delete(es_index=index, doc_type=_type, id=id)

With many documents you should consider using bulk helper to improve performance. See the answer here.

answered Jan 4, 2018 at 10:38

MCMZL

1,1569 silver badges23 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Sachin · Accepted Answer · 2023-08-10 12:21:48Z

1

Another option would be delete_by_query, where you can directly pass a list of ids.

es = Elasticsearch()

def delete_by_id(index, ids):
    query = {"query": {"terms": {"Id":ids}}}
    es.delete_by_query(index=index, body=query)

edited Aug 10, 2023 at 12:21

answered Jun 23, 2022 at 14:13

Sachin

1138 bronze badges

Comments

Maria Clara Bezerra · Accepted Answer · 2023-06-06 21:21:59Z

0

We can follow the Delete by Query section on documentation and make a simple POST request to your index:

let's say that your index is named 'index_test'. So, you can send a POST request to your index_url + '_delete_by_query', so the content (document) of your index will be deleted but the index itself will be preserved:

curl -X POST http://elasticAddress:9200/index_test/_delete_by_query

With this, you will not lose your visualization content as the index is preserved, but the document (content) is updated.

answered Jun 6, 2023 at 21:21

Maria Clara Bezerra

9519 silver badges7 bronze badges

Collectives™ on Stack Overflow

Delete specific docs in elasticsearch using python

3 Answers 3

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related