elasticsearch-dsl-py Sorting by Text() field

Question

I have problem with .sort() method. For example I have Index with Text() field:

FILTER = token_filter(
    'FILTER', 'edge_ngram', min_gram=3, max_gram=40)
ANALYZER = analyzer(
    'ANALYZER', tokenizer='standard', type='custom', filter=[
        'standard', 'lowercase', 'stop', 'asciifolding',FILTER])

class Article(DocType):
    title = Text(analyzer=ANALYZER)
    body = Text(analyzer='snowball')
    tags = Keyword()

search = Article.search().sort('title')
search.execute()

when I try to execute search query with sort I get an error:

elasticsearch.exceptions.RequestError: TransportError(400, 'search_phase_execution_exception', 'Fielddata is disabled on text fields by default. Set fielddata=true on [title] in order to load fielddata in memory by uninverting the inverted index. Note that this can however use significant memory.')

How can I sort by title field properly in this case without setting fieldata=true?

Honza Král · Accepted Answer · 2017-07-20 19:29:30Z

4

You cannot sort on a text field, that is a limitation in elasticsearch. It needs to be a type keyword.

Unfortunately type keyword cannot have an analyzer, it can, however, have a normalizer which performs similar, albeit a bit limited, function. Essentially the difference is that you cannot specify a tokenizer since then any sorting would not make much sense (which token would you use for sorting when you have multiple?)

hope this helps

answered Jul 20, 2017 at 19:29

Honza Král

3,03216 silver badges11 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

pkisztelinski Over a year ago

how about String() field? Can I sort on a string field?

Honza Král Over a year ago

String is deprecated, String(index="not_analyzed") was replaced by keyword and all other String instances are analogous to text so same restrictions apply.

Honza Král Over a year ago

Note that you don't have to choose, you can use both field types (text and keyword) by using the fields parameter - elastic.co/guide/en/elasticsearch/reference/current/…

Collectives™ on Stack Overflow

elasticsearch-dsl-py Sorting by Text() field

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related