JSON Parsing a File of Standalone Objects in Ruby

Question

I have a JSON file with discrete objects that are not enclosed in another composite object (e.g. an array). The reason for this is that I don't want to rely on the assumption that they will all fit into memory.

In other words, I'd like to iterate over them, reading, parsing, and processing them one at a time.

In YAML I can do this using YAML.load_documents. Is there such a thing in (Ruby) JSON?

Thanks, Keith

I think I understand. An example in the question would be useful though. — Neil Slater
– Neil Slater, Commented Jul 3, 2013 at 16:58

Mark Thomas · Accepted Answer · 2013-07-03 17:06:41Z

1

So basically you want a streaming parser for JSON.

Try yajl-ruby, a gem with ruby bindings to the Yajl JSON streaming parser library, or JSON::Stream a streaming pure-ruby JSON parser.

answered Jul 3, 2013 at 17:06

Mark Thomas

37.6k11 gold badges78 silver badges101 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Keith Bennett Over a year ago

Thanks! I used yajl-ruby. I couldn't find an example of handling parsed records one at a time, but came up with this method, which works for me: gist.github.com/keithrbennett/5930475.

Trevor Rowe Over a year ago

Don't forget the Oj gem. It provides a significantly faster streaming JSON parser interface via Oj::ScHandler (simple callback handler).

Collectives™ on Stack Overflow

JSON Parsing a File of Standalone Objects in Ruby

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related