I have a bson file: xyz.bson full of useful data and I'd like to query/process the data using python. Is there a simple example/tutorial out there I can get started with?
I don't understand this one.
Add a comment
|
3 Answers
You could use the mongorestore command to import the data into a mongoDB server and then query it by connecting to that server.
4 Comments
DBWeinstein
the documentation says its for json or csv. does it work with bson? docs.mongodb.org/v2.2/reference/mongoimport
drmirror
My bad. Yes, it must be
mongorestore then. That reads .bson files.DBWeinstein
looks like that's the one. i'm a little confused on usage. I have a file on my desktop
property.bson and I tried >mongostore --db propertyInfo /Desktop/property.bson and got SytaxError: Unexpected identifier. Can you point me to some good examples?drmirror
The command is
mongorestore, in your example you wrote mongostore, maybe that is the reason. You may also have to specify both a database name and a collection name to import to, using the -d and -c options (-d is equivalent to --db). You also have an absolute pathname in your example, which may or may not be what you intended.If you want to stream the data as though it were a flat JSON file on disk rather than loading it into a mongod, you can use this small python-bson-streaming library:
https://github.com/bauman/python-bson-streaming
from bsonstream import KeyValueBSONInput
from sys import argv
for file in argv[1:]:
f = open(file, 'rb')
stream = KeyValueBSONInput(fh=f, fast_string_prematch="somthing") #remove fast string match if not needed
for id, dict_data in stream:
if id:
...process dict_data...
1 Comment
Dukeatcoding
That Looks like a very interesting approach for querying The Exportes data
You may use sonq to query .bson file directly from bash, or you can import and use the lib in Python.
A few examples:
Query a .bson file
sonq -f '{"name": "Stark"}' source.bsonConvert query results to a newline separated .json file
sonq -f '{"name": {"$ne": "Stark"}}' -o target.json source.bsonQuery a .bson file in python
from sonq.operation import query_son record_list = list(query_son('source.bson', filters={"name": {"$in": ["Stark"]}}))
