Skip to main content
We’ve updated our Terms of Service. A new AI Addendum clarifies how Stack Overflow utilizes AI interactions.
Software Engineering

Questions tagged [elasticsearch]

Ask Question

Elasticsearch is an Open Source (Apache 2), Distributed, RESTful, Search Engine built on top of Lucene.

46 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
0 votes
1 answer
57 views

I have a scenario where I have 2 sets of data: All possible products Products carried by a store Dataset 2 is a subset of dataset 1. If a user searches for a product that the store doesn't carry, I'...
Steven Evers's user avatar
  • 28.2k
0 votes
1 answer
95 views

I have a lot of data that I would like to enable end-users to search on. I plan to use ElasticSearch (but am open to other technologies). This would also be an AWS native solution. For simplicity, let'...
alex's user avatar
  • 101
-2 votes
1 answer
798 views

Our organization is into Health Care RCM business. In that, we use to receive medical records (called as accounts, which is a business phrase) and our staff (Medical coders) use to do medical coding, ...
Senthil's user avatar
  • 9
0 votes
1 answer
808 views

Suppose we have a resource which uses either MySQL or ElasticSearch, depending on whether the query params require full-text search or not. For example the possible query filters are: fk_id which is a ...
Bugs Buggy's user avatar
  • 121
1 vote
0 answers
137 views

So, one of the backend system, having 5 resource types (tables) and some foreign keys as well, requires full text support for two of the tables. Also, for some use-cases, we require inner-joins for ...
Bugs Buggy's user avatar
  • 121
2 votes
2 answers
2k views

I need to stream changes from my MongoDB instance to Elasticsearch. I also need to perform complex transformations on changed documents. After doing some research I narrowed my options down to 2: ...
Yos's user avatar
  • 167
0 votes
1 answer
378 views

I was under the impression that Filebeat is only necessary if I wish to provide a constant, paced, fresh input to logstash. But the tutorial here starts with configuring Filebeat to send log lines to ...
ih8ie8's user avatar
  • 119
2 votes
1 answer
154 views

I am building an eCommerce website and there is a Category table in my MongoDB database which has a field called path. This field is used to store category hierarchy e.g Boots category will have /...
Irfan's user avatar
  • 129
0 votes
0 answers
51 views

I've a list of items in my ElasticSearch. User enters a query and I fetch the results from elastic search. Now, I've a requirement where I don't want to show the user the items which he has already ...
Avi Yadav's user avatar
  • 1
2 votes
1 answer
122 views

I read both this thread Elasticsearch and PostgreSQL combination and this one Elasticsearch and relational database combination, but I could not come to an answer. Let's say I have to re-create a ...
Mazzespazze's user avatar
  • 29
1 vote
0 answers
206 views

I have many continuously growing (through scrapping) collections in MongoDB Atlas. The documents in each collection follows the following schema: { "source_url": "<some url on the web>", "html":...
inquilabee's user avatar
  • 111
5 votes
1 answer
466 views

I want some advice regarding my architecture and hosting options. I'm attempting to build an e-commerce site for e-books. It will use NestJS for the backend and ReactJS+Typescript for the frontend. ...
Ketra's user avatar
  • 51
0 votes
0 answers
247 views

I have gone through Elastic working and understands how inverted index(faster look up) and index( storing actual document disk in ES). My understanding is that inverted index has most of the required ...
user3198603's user avatar
  • 1,896
2 votes
1 answer
2k views

I have a marketplace application and I stored data in a PostgreSQL. I have performance problem for product search, I know I can improve search performance if I use Elasticsearch instead of PostgreSQL ...
zblash's user avatar
  • 53
0 votes
0 answers
331 views

This is a problem related to a typical e-commerce requirement. I am using ElasticSearch for all the below use cases. I am confused about whether or not to use MongoDB for the sorting part. I have the ...
rohanagarwal's user avatar
  • 153
1 vote
0 answers
323 views

I'm considering using the ELK stack for logging within our company. To comply with our data retention policy, we would like to anonymize data after one year so it cannot be traced back to an ...
Umair's user avatar
  • 185
0 votes
1 answer
140 views

I want to understand the difference between AWS Elasticsearch service vs on-premise version. Does AWS provides a fully managed service for Elasticsearch (like DynamoDB, SQS etc) Do we have to manage ...
Manjula Piyumal's user avatar
  • 9
11 votes
6 answers
21k views

I'm designing an API and have reached the topic of logging. I'm going to store my logs in Elasticsearch. I'm certainly going to do some logging at the time the HTTP response is sent back to the ...
Jan Żankowski's user avatar
  • 297
1 vote
1 answer
525 views

I am prototyping a social network as part of a project I am working on and want to learn the right way to do it as if it were for an industry leading company. I've decided on implementing the social ...
lvoelk's user avatar
  • 71
-2 votes
1 answer
414 views

I have an in-house built job scheduling application that accepts Job configurations in form of Apache Config files (something similar to XML). There are tons of configurations (for example a way to ...
user avatar
1 vote
1 answer
451 views

I would like some guidance in setting up my document structure Elasticsearch. The company I work for has an app that stores around 20,000 new phone records each day in a SQL database. And we feel we ...
Matt Spinks's user avatar
  • 159
1 vote
1 answer
2k views

We are going to develop an enterprise level application which will be run by a dozen microservices. Every microservice will be inside docker and all this will be orchestrated by Kubernetes. Obviously, ...
Anatoly's user avatar
  • 274
1 vote
0 answers
100 views

I am currently working on a project for a production facility. The machines in the production are saving so called 'Telemetry Data', measurements like water pressure, plastic volume or temperature ...
Curunir's user avatar
  • 119
5 votes
1 answer
444 views

I need to implement product search using Elastic search similar to it is done on any scalable ecommerce site.I am planning below algorithm for this Whenever product is added to system, First add it ...
user3198603's user avatar
  • 1,896
1 vote
0 answers
69 views

I have some user defined custom fields corresponding to a ticket (A ticket is an entity which has subject, status and custom fields). I need to search tickets based on its custom field values. A ...
Tuhin Dey's user avatar
  • 97
0 votes
1 answer
115 views

We're building a search engine at a client's place. To evaluate the results, the client is comparing top N results of our search engine to top N results of a competitor. And they want me to get at ...
tired and bored dev's user avatar
  • 109
-3 votes
1 answer
761 views

I need to design the feature like in encommerce(consider hotel booking site) we can enter the keyword/partial-keyword and need to return the relevant results. For Example :- If site admin or hotel ...
user3222249's user avatar
  • 457
1 vote
1 answer
438 views

This is regarding designing a search api. We have 3 tier architecture now using Spring MVC. All communications are via REST api. UI <-> Business <-> Data(sql). Now to implement faster ...
Renjith's user avatar
  • 123
3 votes
3 answers
2k views

We are building a new product in real estate space and the end users of this product are not so tech savvy. To have better user experience with our product, we want our users to find relevant things ...
mrcasa bengaluru's user avatar
  • 51
2 votes
1 answer
161 views

We have a very large search service (written in golang if it matters) that runs on top of ElasticSearch, receive requests, builds the correspondent query, and returns the results (with some post-...
DotnetProg's user avatar
  • 129
2 votes
1 answer
2k views

A side project I'm working on with some friends currently deals with an API interface that, for many reasons, is slow and cannot be changed to improve speed. I'm talking API responses that take ...
Daniel Fullerton's user avatar
  • 29
3 votes
1 answer
3k views

Elastic search is basically about indexing of data. In database world, Multiple indexes can be created on a MongoDB collection Collection in MongoDB can be schema-less. In MongoDB, BSON encoding of ...
user1787812's user avatar
  • 769
8 votes
1 answer
4k views

I've got a relatively high-traffic public-facing product-based website backed by SQL Server as the point of authority. It has some search capability on some of the columns of the Items table (year, ...
Jorick918's user avatar
  • 89
1 vote
1 answer
152 views

I am very new to elastic search and i need to know it is even useful to store data? because i was curious to try my hands on how elastic search works and i used postman>run elastic search then added ...
Shikha thakur's user avatar
  • 143
3 votes
1 answer
2k views

I've got java logging user activities to Fluentd, Fluentd is then writing these activities into an elasticsearch index. Every user activity is recorded, some include: User1 follows user2 User1 likes ...
James111's user avatar
  • 173
0 votes
1 answer
2k views

I have been asked to create a filtering functionality for e-commerce application written in PHP. Since the app is using MySQL database, I made the decision to use Elasticsearch with Logstash and ...
Jan Richter's user avatar
  • 201
2 votes
1 answer
897 views

I am making a web application using the javascript framework Meteor, which runs with mongodb. In the web app I have a db set up that holds individual video games in the documents. An example of this ...
Dylan's user avatar
  • 133
4 votes
1 answer
2k views

I’m currently building a dashboard to view some analytics about the data generated by my company's product. We use MySQL as our database. The SQL queries to generate the analytics from the raw live ...
Julien's user avatar
  • 141
0 votes
2 answers
4k views

we are working on a JAVA EE project which handles huge amount of data, but has to provide full-text-search option (in hungarian language). So we started to think about what kind of architecture could ...
maestro's user avatar
  • 111
2 votes
1 answer
2k views

I'm designing an analytics system that feeds all events to Elasticsearch. The event lifecycle is as follows: Visitor does something. Custom analytics server gathers data, makes an event out of it and ...
Zippo's user avatar
  • 416
6 votes
1 answer
2k views

Imagine I have a marketplace application - where users can search for products (we concentrate on clothes). Every product has an ID, name (text), description (text), price (numeric), size (numeric), ...
Anton's user avatar
  • 161
0 votes
0 answers
192 views

I have a lot of text and I am storing it in Elastic search. Using Lucene, NLP and Wordnet filters the search is good but not as good as Google's because none of these methods use AI for the search so ...
arisalexis's user avatar
  • 419
0 votes
0 answers
529 views

I know, title is a little confusing but the problem is, too. I am working on a company, it has several different applications and wants these applications have search functionality. We have developed ...
ismailarilik's user avatar
  • 111
3 votes
4 answers
2k views

We are planning to build a travel website in which we will be integrating multiple APIs (eg. DOTW, GTA, Expedia) for Hotels. I have initially tried to use MySQL but since there are huge amounts of ...
Ankur Jain's user avatar
  • 139
22 votes
3 answers
35k views

I don't find any deep explanation on the web about a comparison between ElasticSearch and the graph databases. Both are optimized to traverse data. ElasticSearch seems to be optimized for analytics. ...
Mik378's user avatar
  • 3,926
8 votes
2 answers
3k views

I already understand that Elastic Search is supposed to be deployed in a distributed topology, in that you can have multiple nodes for a cluster of ES instances. I like the API, and it looks promising....
Alan's user avatar
  • 201