Elastic search not inserting the record using Nodejs?

Question

We are doing some manipulation and after that we are trying to insert data in to elastic DB. My problem is, few records are getting inserted into the index and few are missing. I can see the data in my log file, and i have no elastic error also. Since there is no error , I could not debug also. Even without inserting , customers are getting the response. Below is my code.

 file.js
 async function InsertModelES() {
    var objn= {
        PID: ID,
        TID: MID,
        UserID:userID,
        HID: HrID,
    };
    await elasticClient.index({
        index: 'scrn', 
        type: '_doc',
        id: ID ,
        body: objn
    }, function (err, data) { 
    if (err) {
        console.log("err ", err)
    }
    else {
    } 
 })  

 app.js
 
 app.post('/allrequest', async function(req, res){ 
  let result = await file1.allrequest(data,urn);
  await file1.InsertModelES()
  res.send(result);  
 }

This problem only happens, when the load is high. What could be the reason?

Shay Ashkenazi · Accepted Answer · 2021-02-15 12:59:38Z

2

It is erratic, and as you said "it happens when the load is high". It will probably fix the problem if you will set refresh=true when indexing the new document.

From Index API:

refresh (Optional, enum) If true, Elasticsearch refreshes the affected shards to make this operation visible to search, if wait_for then wait for a refresh to make this operation visible to search, if false do nothing with refreshes. Valid values: true, false, wait_for. Default: false.

answered Feb 15, 2021 at 12:59

Shay Ashkenazi

4771 gold badge4 silver badges11 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Y.Lu · Accepted Answer · 2023-05-18 20:37:15Z

1

The bulk API makes it possible to perform many index/delete operations in a single API call. This can greatly increase the indexing speed. https://www.elastic.co/guide/en/elasticsearch/client/javascript-api/current/bulk_examples.html

answered May 18, 2023 at 20:37

Y.Lu

914 bronze badges

Collectives™ on Stack Overflow

Elastic search not inserting the record using Nodejs?

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related