Writing data on separate rows in csv file in python

Question

I want to extract news headlines from Hindustantimes.com. I have the following code but i get the data in different columns in the same row. I want each news on separate line. Can anyone please help me. Thanks in advance. Here is my code:

import requests
import bs4
import csv
res=requests.get('https://www.hindustantimes.com')
soup=bs4.BeautifulSoup(res.text,'lxml')

x=[]
for i in soup.select('div.subhead4'):
    x.append(i.text)

for i in soup.select('div.bigstory-mid-h3'):
    x.append(i.text)

for i in x:
    print(i)

with open('newz.csv','w') as cF:
    wr = csv.writer(cF)
    wr.writerow(x)

user3471881 · Accepted Answer · 2018-11-21 21:39:42Z

4

writerow takes an iterable to write:

writerow(['a', 'b', 'c'])
-> a,b,c

Also, you don't need to append the data to a list before you write.

stories = soup.select('div.subhead4') + soup.select('div.bigstory-mid-h3')

with open('output.csv', 'w') as f:
    writer = csv.writer(f)
    for headline in stories:
        writer.writerow([headline.text.strip()])

edited Nov 21, 2018 at 21:39

answered Nov 21, 2018 at 21:26

user3471881

2,7443 gold badges21 silver badges35 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Kamikaze_goldfish Over a year ago

This makes more sense than doing the other code. Nice work!

Kamikaze_goldfish · Accepted Answer · 2018-11-21 21:11:02Z

1

res = requests.get('https://www.hindustantimes.com')
soup = bs4.BeautifulSoup(res.text,'lxml')

x=[]
for i in soup.select('div.subhead4'):
    x.append(i.text.strip())

for i in soup.select('div.bigstory-mid-h3'):
    x.append(i.text.strip())


with open('newz.csv','w') as cF:
    wr = csv.writer(cF)
    for i in x:
        wr.writerow([i])

answered Nov 21, 2018 at 21:11

Kamikaze_goldfish

8611 gold badge12 silver badges26 bronze badges

Comments

ewwink · Accepted Answer · 2018-11-21 23:11:44Z

0

it simple .csv file, here without using csv module

with open('newz.csv','w') as cF:
  for x in soup.select('.subhead4 a'):
    cF.write(x.text + '\n')

answered Nov 21, 2018 at 23:11

ewwink

19.3k2 gold badges49 silver badges56 bronze badges

Collectives™ on Stack Overflow

Writing data on separate rows in csv file in python

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related