Elasticsearch parse date field in different format

Question

I create an index in ES7.8 with date format "yyyy-MM-dd"

"mappings": {
    "_doc": {
      "properties": {
        "BaseLine": {
          "type": "date",
          "format": "yyyy-MM-dd"
        },

However, when I click the "Baseline" field on the map, the actual value passed on Filter is yyyy-MM-dd00:00:00.000Z.

Can anyone advise how can I get the correct date format "yyyy-MM-dd" in the filter?

Thanks.

Here is the sample document from a request

"hits" : [ { "_index" : "program_b", "_type" : "_doc", "_id" : "2137SD19.1", "_score" : 0.0, "_source" : { "SiteID" : 2137, "BaseLine" : "2020-04-26", "uk" : "2137SD19.1" } },

Can you show a sample document that you have indexed. Ideally the one you clicked on on the map — Val
– Val, Commented Aug 11, 2020 at 6:02
@Val I have edited the post with a response in Dev tool. Hope that works. The original documents are in .csv format — Scorpioooooon21
– Scorpioooooon21, Commented Aug 11, 2020 at 7:11

Val · Accepted Answer · 2020-08-11 07:24:46Z

2

The role of the "format": "yyyy-MM-dd" in your mapping is only to tell ES in which format your date values will be present in your source document.

As you can see, your source document contains "BaseLine" : "2020-04-26" which is exactly in the format that you've instructed ES to expect. When you index your document, ES will properly parse your BaseLine date field and index a long value representing that point in time.

The value you see in the tooltip (i.e. Apr 26, 2020) is just how Kibana formats your dates, you can change that in "Stack Management > Advanced settings" if needed.

Finally, the filter value you see in your filter (i.e. 2020-04-26T00:00:00.000Z) is the ISO8601 representation of your BaseLine field and what ES use in the query filter.

Everything looks perfectly correct as far as I can tell.

answered Aug 11, 2020 at 7:24

Val

218k14 gold badges377 silver badges384 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Scorpioooooon21 Over a year ago

Thanks for your feedback. But the problem is when I click the "Baseline" filed from the map, the Timelion Chart of the same Dashboard will report this error: [parse_exception] failed to parse date field [2020-04-26T00:00:00.000Z] with format [yyyy-MM-dd]: [failed to parse date field [2020-04-26T00:00:00.000Z] with format [yyyy-MM-dd]]

Val Over a year ago

Well, you didn't mention Timelion in your initial question :-) Can you tell a bit more how your Timelion expression looks like?

Val Over a year ago

What you can do, is to change the format to date_optional_time instead of yyyy-MM-dd so both 2020-04-26 and 2020-04-26T00:00:00.000Z would be allowed

Scorpioooooon21 Over a year ago

Yes, the error is gone after I change the format to "date_optional_time". Thanks, headps~

Collectives™ on Stack Overflow

Elasticsearch parse date field in different format

1 Answer 1

4 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related