Extract values from JSON in Python

Question

This is a reply from the Google Distance Matrix. I would like to have only the two value's as an output and I'm trying to extract it with Python.

{
   "destination_addresses" : [ "Hoorn, Nederland" ],
   "origin_addresses" : [ "Amsterdam, Nederland" ],
   "rows" : [
      {
         "elements" : [
            {
               "distance" : {
                  "text" : "45,0 km",
                  "value" : 44952
               },
               "duration" : {
                  "text" : "40 min.",
                  "value" : 2423
               },
               "status" : "OK"
            }
         ]
      }
   ],
   "status" : "OK"
}

This is what I've tried so far. I want to have a reply from Google every 15 minutes and write it to a file. But in the file I only want the value for distance and duration and I have no luck in achieving that. I'm not sure if the reply from Google is proper JSON so I've tried json.loads but it did not allow me to extract certain parts from the reply. Any ideas?

import requests
import json
import datetime
from apscheduler.schedulers.blocking import BlockingScheduler

uri = "https://maps.googleapis.com/maps/api/distancematrix/json?origins=Amsterdam&destinations=Hoorn&mode=driving&key="
now = datetime.datetime.now()

def job():
    datum = now.strftime("%Y-%m-%d %H:%M")
    print datum
    text_file = open('tijdsduur.txt', 'a')
    batch = requests.get(uri)
    data = batch.text
    jdata = json.loads(data)
    print jdata['elements']['distance']['value']
    text_file.write(data)
    text_file.write('\n')
    text_file.close()

job()
scheduler = BlockingScheduler()
scheduler.add_job(job, 'interval', minutes=15)
scheduler.start()

Error when I try json.loads: KeyError 'elements'

I don't see you using json.loads in that code. Please show how you tried to use it, how it didn't work (e.g.: error message, wrong output, ...) — UnholySheep
– UnholySheep, Commented Nov 24, 2016 at 14:03
Added json.loads. Tried to print it and see if it works but is does not. Gives my a KeyError 'elements' — Donald
– Donald, Commented Nov 24, 2016 at 14:09
because the first key you have to specifiy is "rows", also "rows" and "elements" are arrays, so you need to specify which element you need - so it should be print jdata['rows'][0]['elements'][0]['distance']['value'] — UnholySheep
– UnholySheep, Commented Nov 24, 2016 at 14:13
In general, when debugging handling input, print the raw input before processing. In this case print data and you should see exactly whether you have a top-level "elements" key - or in this case, that you don't. — orip
– orip, Commented Nov 24, 2016 at 14:17

Mohammad Yusuf · Accepted Answer · 2016-12-28 15:12:32Z

json.loads will take a string paramater. The 's' in the loads is for string.

import json
a="""{
   "destination_addresses" : [ "Hoorn, Nederland" ],
   "origin_addresses" : [ "Amsterdam, Nederland" ],
   "rows" : [
      {
         "elements" : [
            {
               "distance" : {
                  "text" : "45,0 km",
                  "value" : 44952
               },
               "duration" : {
                  "text" : "40 min.",
                  "value" : 2423
               },
               "status" : "OK"
            }
         ]
      }
   ],
   "status" : "OK"
}"""

b = json.loads(a)
dist,dur = b['rows'][0]['elements'][0]['distance'], b['rows'][0]['elements'][0]['duration']
print dist
print dur

Output:

{u'text': u'40 min.', u'value': 2423}
{u'text': u'45,0 km', u'value': 44952}

Note that:

str(json_object) wraps strings in single quotes, which is not valid JSON.
So if you have a json object which you had earlier converted to string using str() and now you want to convert it back to JSON then you can work around like this:
```
json.loads(json.dumps(str(json_object)))
```

SMCast · Accepted Answer · 2016-11-24 14:12:44Z

0

i think your problem because \n character. try to remove it and use json.loads to extract the response in batch to be json. Here is the response that i got from google:

u'{\n   "destination_addresses" : [ "Hoorn, Netherlands" ],\n   "origin_addresses" : [ "Amsterdam, Netherlands" ],\n   "rows" : [\n      {\n         "elements" : [\n            {\n               "distance" : {\n                  "text" : "45.0 km",\n                  "value" : 44952\n               },\n               "duration" : {\n                  "text" : "40 mins",\n                  "value" : 2423\n               },\n               "status" : "OK"\n            }\n         ]\n      }\n   ],\n   "status" : "OK"\n}\n'


batch.replace("\n", "")
jsonData = json.loads(batch)

Now you have jsonData as JSON

answered Nov 24, 2016 at 14:12

SMCast

11

1 Comment

UnholySheep Over a year ago

any good json parser can handle linebreaks. also if it couldn't it would fail on parsing, not on accessing the data

Collectives™ on Stack Overflow

Extract values from JSON in Python

2 Answers 2

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related