Elasticsearch array property must contain given array items

Question

I have documents that look like:

{
    "tags" => [
        "tag1",
        "tag2",
    ],
    "name" => "Example 1"
}

{
    "tags" => [
        "tag1",
        "tag3",
        "tag4"
    ],
    "name" => "Example 2"
}

What I now want is to do a terms search where given array might look like:

[tag1, tag3]

where expected hit should be:

{
    "tags" => [
        "tag1",
        "tag3",
        "tag4"
    ],
    "name" => "Example 2"
}

However, when I do a query like:

GET _search
{
    "query": {
        "filtered": {
           "query": {
               "match_all": {}
           },
           "filter": {
               "bool": {
                   "must": [
                      {
                          "terms": {
                             "tags": [
                                "tag1",
                                "tag3"
                             ]
                          }
                      }
                   ]
               }
           }
       }
    }
}

I get both "Example 1" and "Example 2" as hits since both Example 1 and Example 2 contains either tag1 or tag3. By looking at the documentation for terms I figured out that terms is actually a contains query.

How can I in this case make sure that Example 2 is the only hit when querying with tag1 and tag3?

You need at least particular 2 elements, or docs with that exact array? — Slam
– Slam, Commented Aug 10, 2015 at 10:37

Abdul Vajid · Accepted Answer · 2020-09-19 02:20:23Z

6

For those who are looking at this in 2020, you might have noticed that minimum_should_match is deprecated long back.

There is an alternative currently available, which is to use terms_set.

For eg:

{
  "query": {
    "terms_set": {
      "programming_languages": {
        "terms": [ "c++", "java", "php" ],
        "minimum_should_match_field": "required_matches"
      }
    }
  }
}

The above example assumes a field required_matches exists which contains an integer, that defines how many matches should be there.

What is more useful is the alternative field minimum_should_match_script.

See the example below:

{
  "query": {
    "terms_set": {
      "programming_languages": {
        "terms": [ "c++", "java", "php" ],
        "minimum_should_match_script": {
          "source": "2"
        },
      }
    }
  }
}

You can always use the inside a filter context to make it works a filter.

1 Comment

Noumenon Over a year ago

I'm not sure in what context minimum_should_match might be deprecated, but Google will only show me that happening to minimum_number_should_match.

Russ Cam · Accepted Answer · 2015-08-10 10:26:21Z

4

You need to set the execution mode to "and" by adding "execution": "and" to the terms filter so that all terms must be contained within a document to be considered a match

GET _search
{
   "query": {
      "filtered": {
         "query": {
            "match_all": {}
         },
         "filter": {
            "terms": {
               "tags": [
                  "tag1",
                  "tag3"
               ],
               "execution": "and"
            }
         }
      }
   }
}

This is effectively the same as building a bool must filter with the conjunction of all terms, but in a more compact form.

answered Aug 10, 2015 at 10:26

Russ Cam

126k34 gold badges211 silver badges275 bronze badges

2 Comments

Louis Over a year ago

this should now be written with a must query because filtered queries are deprecated since ES v5.0 as stated here

Russ Cam Over a year ago

@Louis entire query needs to be written quite differently for 5 onwards as execution mode on terms query is gone as well

chengpohi · Accepted Answer · 2015-08-10 10:33:19Z

0

You can set minimum_should_match to match your array:

{
    "query": {
        "filtered": {
           "query": {
               "match_all": {}
           },
           "filter": {
               "bool": {
                   "must": [
                      {
                          "terms": {
                             "tags": ["tag1","tag3"],
                             "minimum_should_match": 2
                          }
                      }
                   ]
               }
           }
       }
    }
}

answered Aug 10, 2015 at 10:33

chengpohi

14.2k1 gold badge28 silver badges43 bronze badges

Comments

masikkk · Accepted Answer · 2024-06-13 04:22:56Z

0

{
  "query": {
    "terms_set": {
      "tags": {
        "terms": [ "tag1", "tag2", "tag3" ],
        "minimum_should_match_script": {
          "source": "params.num_terms"
        }
      }
    }
  }
}

params.num_terms is the size of terms, or specific num "source": "3"，and more tag matched，return score is higher

answered Jun 13, 2024 at 4:22

masikkk

616 bronze badges

Collectives™ on Stack Overflow

Elasticsearch array property must contain given array items

4 Answers 4

1 Comment

2 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

1 Comment

2 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related