0

I am working on an interactive query application for data records that look like this in a CSV file:

w1 w2 ... , w3 w4 w5 ... , f1, f2, f3, f4

where the first and second field contain phrases comprised of 1-15 words, and the rest (n1, n2 ...) are simply floating point numbers ("features"). The data can contain as many as 2-5 million such records.

I want to build a browser-based, standalone interactive querying app where I can run queries such as:

  • find N records (10 < N < 100) where the first (second) field is of length 5 words or less
  • find N records where the first (second) field contains a specific string
  • find N records with the highest (lowest) values for feature f1 (or f2/f3/f4)
  • find N records where the first field is longer (shorter) than the second field
  • ...

I would like to use jquery to build the interactive part of this tool and, therefore, I figure that I need to use something like MongoDB to store the (JSON-formatted) data which I can then query using javascript. However, I am not sure whether it is even possible to use entirely local, client-side databases with JavaScript inside a browser. I am also not sure whether MongoDB can deal with queries like this for the data sizes that I will be dealing with. I am a complete novice at stuff like this so it is entirely possible that I may have missed something that's much more appropriate to this situation.

Thanks in advance!

2 Answers 2

1

I would think many local client browsers would run out of memory at that scale. I'd use Ajax to pass the queries back to some more traditional server-side database technology.

Sign up to request clarification or add additional context in comments.

Comments

0

If you are developing this for an in-house type of project, you could definitely look into HTML5 client-side storage.

See:

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.