Passing only few data to the JSON.parse() into Elasticsearch

Question

Here I only have to allow few data coming from JSON and index in Elasticsearch. So what is the perfect way to do it, rather than delete each separately?

var elasticData= JSON.parse(result.body);
        elasticData = elasticData.res;
        elasticData["id"] = elasticData._id;
        delete elasticData["__v"];
        delete elasticData["_id"];
        delete elasticData["addressee"];
        delete elasticData["abbreviation"];
        delete elasticData["care_of"];
        delete elasticData["address_1"];
        delete elasticData["address_2"];
        delete elasticData["company_id_legacy"];        
        elasticSearch_common.createCompanyIndex(elasticData);

For Example: I only have to pass ("name","id","address") and rest of them I don't want to pass it. But there's lots of other data(s) are available in same JSON.

{
    "userId":"34234234234gjgjg894734g",
  "company":{ 
  "id" : "21", 
  "addressee" : {
      "addressee" : "EXAMPLE", 
      "title_name" : "", 
      "salutation" : "Dear:", 
      "comments" : "", 
      "email" : "[email protected]", 
      "phone" : "", 
      "fax" : "", 
      "extention_group" : "", 
      "ext" : ""
  }, 
  "abbreviation" : "", 
  "care_of" : "", 
  "address_1" : "2", 
  "address_2" : "", 
  "address_3" : "", 
  "state" : "CA", 
  "zip" : "90024", 
  "is_deleted" : false, 
  "company_code" : "sdas", 
  "parent_company" : null, 
  "name" : "NIOE", 
  "createdBy" : "Dat", 
  "modifiedBy" : "Dat", 
  "createdDate" : "2019-08-22T19:10:50.000+0000", 
  "modifiedDate" : "2019-08-22T19:10:50.000+0000", 
}

This is the actual JSON, And I want below as the elasticsearch index data to be pushed.

{ name: 'NIOE',
  id: '21' }

Val · Accepted Answer · 2019-09-25 13:32:12Z

1

How about whitelisting?

// raw data you get from wherever
const elasticData = JSON.parse(result.body);

// object to index into ES
const toIndex = {};

// whitelist of fields to index
["name", "id", "address"].forEach(field => {
  toIndex[field] = elasticData.company ? elasticData.company[field] : null;
});

// assert: toIndex now contains only the fields you want to index
elasticSearch_common.createCompanyIndex(toIndex);

edited Sep 25, 2019 at 13:32

answered Sep 25, 2019 at 12:58

Val

218k14 gold badges377 silver badges384 bronze badges

Sign up to request clarification or add additional context in comments.

14 Comments

XFW Over a year ago

still getting the whole data

Val Over a year ago

Very doubtful... can you update your question with the actual code you now have?

XFW Over a year ago

Updated, but not major change, added JSON

Val Over a year ago

The problem is that everything is nested under the company field. so simply replace elasticData[field]; by elasticData.company[field];

XFW Over a year ago

var elasticData= JSON.parse(result.body);         elasticData = elasticData.res;         elasticData["id"] = elasticData._id;         const toIndex = {};          ["name", "id","address"].forEach(field => {         toIndex[field] = elasticData.company[field];         });         console.log(elasticData);            elasticSearch_common.createCompanyIndex(elasticData);

|

Collectives™ on Stack Overflow

Passing only few data to the JSON.parse() into Elasticsearch

1 Answer 1

14 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

14 Comments

Your Answer

Sign up or log in

Post as a guest

Related