Scraping html table using python

Question

I am trying to scrape a table through from a website but i am getting NULL.

How can i get the table? What am i doing wrong?

import requests
from bs4 import BeautifulSoup

html = "https://traderslounge.in/implied-volatility-rank-nse-fno-stocks/" #link that has to be scrapped

response = requests.get(url) # before we feed it to request to parse 

response.status_code
soup = BeautifulSoup(response.text, 'html.parser')

table = soup.find_all("th")
list_of_rows = []
for row in table.findAll("td"):
    list_of_cells = []
    for cell in row.findAll(["th","td"]):
        text = cell.text
        print(text)
        list_of_cells.append(text)
        list_of_rows.append(list_of_cells)

for item in list_of_rows:
    print(' '.join(item))

Scrape, not scrap!

kshetline
– kshetline

2019-10-26 22:56:20 +00:00
Commented Oct 26, 2019 at 22:56 — kshetline
– kshetline, Commented Oct 26, 2019 at 22:56

Bertrand Martel · Accepted Answer · 2019-10-26 23:48:18Z

2

The table content of this site is retrieved from an external API :

https://traderslounge.in/FNO/ivrank/ivranktable.txt

You can get the result using :

import requests

r = requests.get('https://traderslounge.in/FNO/ivrank/ivranktable.txt')

print(r.json()["data"])

answered Oct 26, 2019 at 23:48

Bertrand Martel

46k17 gold badges156 silver badges170 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Scraping html table using python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related