User authentication in Elasticsearch query using python

Question

I'm using elastisearch using Python. My code looks somewhat like this:-

from elasticsearch import Elasticsearch

if __name__ == '__main__': 
    index="IndexPosition"
    es=Elasticsearch(['https://localhost:8080'])
    res = es.search(index='{0}'.format(index), doc_type="log",size=1000, from_=0, body={ "query": {
    "match": {
      
        ...Match condition
      }
    }
  }})

Now, due to changes in architecture user authentication has been added in the elasticsearch.Let's assume username-user and password-pass.How do I pass the username and password in the query..?

fiveclubs · Accepted Answer · 2023-11-17 22:30:58Z

69

You need to pass the username and password to the Elasticsearch object as shown below:

es = Elasticsearch(['http://localhost:8080'], basic_auth=('user', 'pass'))

You could also use http_auth, but that parameter is deprecated, and should be avoided.

edited Nov 17, 2023 at 22:30

fiveclubs

2,4392 gold badges20 silver badges29 bronze badges

answered Nov 7, 2017 at 10:06

Girish kumar

8257 silver badges8 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

GeneticsGuy Over a year ago

How did you figure this out/find the http_auth parameter?

hp77 Over a year ago

Please look into this: stackoverflow.com/a/77505322/7116645 for the latest version.

Abhinav Keshri · Accepted Answer · 2020-07-07 10:59:27Z

26

You can pass username, password in url:

ex:

username: elastic

password: changeme

es = Elasticsearch(hosts="http://elastic:changeme@localhost:9200/")

using CURL

curl -X GET "elastic:changeme@localhost:9200/"

edited Jul 7, 2020 at 10:59

Abhinav Keshri

6451 gold badge7 silver badges23 bronze badges

answered Dec 2, 2019 at 6:21

faisal burhanudin

1,18813 silver badges17 bronze badges

2 Comments

Guy Over a year ago

Why does this solution work for me, but not the one above (http_auth=(user,pwd))? Also, saving passwords in clear text is fine for proof-of-concept, but I can't do this for the long term. Suggestions as to how to hide the password?

Jonáš Jančařík Over a year ago

@Guy A common way of avoiding hardcoding credentials in the code is using environment variables. pypi.org/project/python-dotenv allows you to put credentials in a .env file and load them from there as environment variables

buddemat · Accepted Answer · 2022-07-22 11:42:14Z

6

In Elasticsearch 8.x, the http_auth parameter is deprecated, use basic_auth or bearer_auth respectively instead.

Elasticsearch >= 8.x basic auth example:

es = Elasticsearch(['https://localhost:8080'], basic_auth=('user', 'pass'))

Elasticseach < 8.x basic auth example:

es = Elasticsearch(['http://localhost:8080'], http_auth=('user', 'pass'))

edited Jul 22, 2022 at 11:42

answered Jul 22, 2022 at 10:24

buddemat

5,33016 gold badges37 silver badges61 bronze badges

Comments

em0t · Accepted Answer · 2020-09-04 03:36:14Z

3

yes, use es = Elasticsearch(hosts="http://username:password@es-endpoint:es-port/")

Test success in es version 7.7.1

answered Sep 4, 2020 at 3:36

em0t

613 bronze badges

1 Comment

Yuva Over a year ago

hi, am getting an authentication error while trying to see if indices exists? Can you pls provide some sample code. Am using "res = esClient.indices.exists('metadata-store')" after creating esClient object with username/ password

user2514157 · Accepted Answer · 2023-09-22 23:32:21Z

3

I am running ElasticSearch on Docker. ElasticSearch v8.10 automatically enables additional security (e.g., use of certificates). The certificate can be copied to the local machine by running:

docker cp elasticsearch:/usr/share/elasticsearch/config/certs/http_ca.crt .

or, if not on Docker:

cp /usr/share/elasticsearch/config/certs/http_ca.crt .

See: Verifying HTTPS with CA certificates & Run Elasticsearch in Docker - Start a single-node cluster (7-8)

from elasticsearch import Elasticsearch

# Password for the 'elastic' user generated by Elasticsearch
ELASTIC_PASSWORD = "<elastic_password>"

es = Elasticsearch(
    "https://localhost:9200",
    ca_certs="/path/to/http_ca.crt",
    basic_auth=("elastic", ELASTIC_PASSWORD)
)

# Successful response!
es.info()

answered Sep 22, 2023 at 23:32

user2514157

69112 silver badges30 bronze badges

1 Comment

Fahad Vadakkumpadatah Over a year ago

this worked for me elasticsearch in docker

ZeQun · Accepted Answer · 2020-04-03 09:51:53Z

2

es = Elasticsearch([{'host': 'localhost', 'port': '8080'}], http_auth=('user', 'pass'))

answered Apr 3, 2020 at 9:51

ZeQun

371 bronze badge

Comments

Hariharan AR · Accepted Answer · 2020-02-20 13:26:28Z

1

you can connect the elasticsearch with below Host url config

es = Elasticsearch(hosts="http://user:pass@localhost:9200/")

answered Feb 20, 2020 at 13:26

Hariharan AR

1,55614 silver badges22 bronze badges

Comments

hp77 · Accepted Answer · 2023-11-18 01:11:59Z

Girish Kumar's answer works if you have a elastic-search running without https locally. But if it is started with security(which is the default behaviour in ElasticSearch >=8.0) then you will have to also pass in more details about the ca certificate. user2514157 has tried to mention this is their answer but it is only for Docker container. For a local instance of ElasticSearch, you also have an option to pass SHA-256 fingerprint which you can copy when the ElasticSearch runs for the first time or else you can follow from here to regenerate it. Once you have the SHA-256 fingerprint you can simply do:

es_obj = Elasticsearch([{'host': 'localhost', 'port' : 9200, 'scheme': 'https'}], ssl_assert_fingerprint=_es_ca_cert, basic_auth=(_es_username, _es_passkey), timeout=10)

print(es_obj.info()) # To verify the connection

Add your instance's fingerprint using ssl_assert_fingerprint option.

Referenced from here

Collectives™ on Stack Overflow

User authentication in Elasticsearch query using python

8 Answers 8

2 Comments

2 Comments

Comments

1 Comment

1 Comment

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

8 Answers 8

2 Comments

2 Comments

Comments

1 Comment

1 Comment

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related