Specify Elasticsearch Ingest Pipeline in Spring Data Elasticsearch

Question

I am using the Elasticsearch's 8.x Java API client for indexing documents to Elasticsearch. While indexing, I'm specifying an ingest pipeline to be executed during data ingestion.

public Mono<IndexResponse> addContent(RequestDoc requestDoc) {
        IndexRequest<ContentTransformedModel> indexRequest = IndexRequest.of(request -> request
                .index("test-index")
                .document(requestDoc)
                .pipeline("test-ingest-pipeline"));
        return reactiveElasticsearchClient.index(indexRequest)
                .onErrorResume(IOException.class,
                        e -> Mono.error(new ElasticsearchPublishException(ES_INDEX_INTERNAL_SERVER_ERROR, e)));
    }

I want to move this implementation to Spring data elasticsearch. Is it possible to configure ingest pipelines for indexing documents in Spring data elasticsearch?

Rather than considering about ingest pipeline you can use default.ingest_pipeline in index settings and it will affect each new indexing request. After put this settings, you just need to push the data. elastic.co/guide/en/elasticsearch/reference/current/… — Musab Dogan
– Musab Dogan, Commented Jun 11, 2024 at 10:51

Musab Dogan · Accepted Answer · 2024-07-24 19:08:42Z

1

Rather than considering about ingest pipeline you can use default.ingest_pipeline in index settings and it will affect each new indexing request. After put this settings, you just need to push the data. https://www.elastic.co/guide/en/elasticsearch/reference/current/ingest.html#set-default-pipeline

PUT your_index_name/_settings
{
  "index.default_pipeline": "your_ingest_pipeline_name"
}

answered Jul 24, 2024 at 19:08

Musab Dogan

3,8611 gold badge8 silver badges18 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Hamza AlAjlouni · Accepted Answer · 2024-06-11 13:18:39Z

1

I am not so sure but you can probably do it using the ElasticsearchRestTemplate, I believe that it should work, you can find it here:

https://docs.spring.io/spring-data/elasticsearch/docs/3.2.3.RELEASE/api/org/springframework/data/elasticsearch/core/ElasticsearchTemplate.html

if it didn't work check the ElasticsearchOperations:

https://docs.spring.io/spring-data/elasticsearch/docs/current/api/org/springframework/data/elasticsearch/core/ElasticsearchOperations.html

but if you arrived at a dead end maybe this is the only way to do it:

https://www.elastic.co/guide/en/elasticsearch/client/java-rest/current/java-rest-high-ingest-put-pipeline.html

answered Jun 11, 2024 at 13:18

Hamza AlAjlouni

3382 silver badges11 bronze badges

Collectives™ on Stack Overflow

Specify Elasticsearch Ingest Pipeline in Spring Data Elasticsearch

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related