writing Json file from python script [duplicate]

Question

As starting coders, we are busy with a scraping tool in python. It is almost finished, but now we want the result in a JSON file. We tried but it does not work. Is there a code hero who can help us out?

from bs4 import BeautifulSoup
import urllib

jaren = [str("2010"), str("2012")]
DESIRED_COLUMNS = {1, 2, 5}  # it is a set

for Jaargetal in jaren:
    r = urllib.urlopen("http://www.nlverkiezingen.com/TK" + Jaargetal +".html").read()
    soup = BeautifulSoup(r, "html.parser")
    tables = soup.find_all("table")

for table in tables:
    header = soup.find_all("h1")[0].getText()
    print header

    trs = table.find_all("tr")[0].getText()
    print '\n'
    for tr in table.find_all("tr")[:22]: 
          print "|".join([x.get_text().replace('\n', '') 
      for index, x in enumerate(tr.find_all('td')) 
      if index in DESIRED_COLUMNS])

Is this your actual code? Because you have syntax and indentation issues right now. — idjaw
– idjaw, Commented Apr 19, 2016 at 11:54
@idjaw I've updated the code. Now there are no errors anymore. — Patrick
– Patrick, Commented Apr 19, 2016 at 12:09
You still have indentation issues. Specifically at r = urllib.urlopen("http://www.nlverkiezingen.com/TK" + Jaargetal +".html").read(). What should be in that for loop? Should everything underneath for Jaargetal in jaren be inside that loop? You should ensure your code is an exact representation of your code that you are running — idjaw
– idjaw, Commented Apr 19, 2016 at 12:10
I'm sorry, now the code should work. There was some trying stuff in it. — Patrick
– Patrick, Commented Apr 19, 2016 at 12:14
Please look at the code carefully. It is still not indented properly. Look at for Jaargetal in jaren:. The code is not indented underneath that line. — idjaw
– idjaw, Commented Apr 19, 2016 at 12:15

Schore · Accepted Answer · 2016-04-19 12:04:51Z

1

You can write JSON to a file like so:

import json
d = {"foo": "bar"}
with open("output.json", "w") as f:
    json.dump(d, f)

answered Apr 19, 2016 at 12:04

Schore

9156 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

sinhayash · Accepted Answer · 2016-04-19 12:05:59Z

0

json.dumps() is the function. It converts a dictionary to str object. Docs

answered Apr 19, 2016 at 12:05

sinhayash

2,8334 gold badges21 silver badges51 bronze badges

Collectives™ on Stack Overflow

writing Json file from python script [duplicate]

2 Answers 2

Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Linked

Related