Get all non-full fields in Spring Data Elasticsearch Query using source filtering

Question

We are using native search query builder as follows:

 String[] includeFields = new String[]{"idDl", "clientName"};
 String[] excludeFields = new String[]{"Address"};
 Query searchQuery = new NativeSearchQueryBuilder()
                .withQuery(matchAllQuery())
                .withSourceFilter(new FetchSourceFilter(includeFields, excludeFields))
                 .build();
return elasticsearchRestTemplate.queryForObject((StringQuery) searchQuery, User.class);

I am able to get all the response data but first response object is all null fields, i want to exclude all null fields object in the final response. We are using we're using spring-data-elasticsearch 3.2.6.RELEASE and here is the sample response:

   [{
        "idDl": null,
        "clientName": null,
        "Address": null
    },
    {
        "idDl": 19810008,
        "clientName": "ABC",
        "Address": "NYC"
        
    }]

Val · Accepted Answer · 2020-07-03 14:47:00Z

1

What you should do is to create a query that will exclude the documents with those fields having null values instead of doing a match_all. Change your query with this instead:

            ...
            .withQuery(existsQuery("idDl"))
            ...

Also worth noting that source filtering alone will not look at the values of your fields to check if they are null or not, it simply returns the field by name if it's present in the source document.

answered Jul 3, 2020 at 14:47

Val

218k14 gold badges377 silver badges384 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

implosivesilence Over a year ago

Hi @val, if I made changes like this then ElasticsearchRepository's findAll() is also getting affected, It is also returning first object as All null fields, I just want it to return all objects with non-null fields, it's expected behavior, do i need to make any changes? I have posted separate question for it, would you be kind enough to answer it stackoverflow.com/questions/62771342/…

implosivesilence Over a year ago

Hi @val, I just wanted to know whether this custom field filtering method is interfering with implementation of ElasticsearchRepository's findAll() method, as requested in previous comment. Any suggestions will be really helpful.

Collectives™ on Stack Overflow

Get all non-full fields in Spring Data Elasticsearch Query using source filtering

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related