Extracting data from html using python

Question

I am trying to extract the text within all the 'a' tags from this code, i get an error:

(AttributeError: ResultSet object has no attribute 'find_all'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?)

What am i doing wrong?

import json
import time
from datetime import datetime
from discord import Webhook, RequestsWebhookAdapter
from discord_webhook import DiscordWebhook, DiscordEmbed
import discord
from bs4 import BeautifulSoup
from discord.ext import commands

r = requests.get("https://www.hypedc.com/nz/nike-air-force-1-07-black-black-cw2288-001")
soup = BeautifulSoup(r.content, 'lxml')
size = soup.find('div', id="size-selector-tab-mobile-0")
size = size.find_all('li', class_='col-xs-6 col-sm-8 col-md-6 col-lg-4')
size = size.find_all('a').text
print(size)

Your code doesn't show any attempt to find 'a' tags.

erip
– erip

2021-01-08 00:13:00 +00:00
Commented Jan 8, 2021 at 0:13 — erip
– erip, Commented Jan 8, 2021 at 0:13
"but this didn't work" what error message?

new Q Open Wid
– new Q Open Wid

2021-01-08 00:21:23 +00:00
Commented Jan 8, 2021 at 0:21 — new Q Open Wid
– new Q Open Wid, Commented Jan 8, 2021 at 0:21
OK let me fix the question.

Supreme
– Supreme

2021-01-08 00:27:10 +00:00
Commented Jan 8, 2021 at 0:27 — Supreme
– Supreme, Commented Jan 8, 2021 at 0:27

Samsul Islam · Accepted Answer · 2021-01-08 06:11:12Z

1

Here size.find_all('li', class_='col-xs-6 col-sm-8 col-md-6 col-lg-4') return a list. So you need to iterate it to get the size.

import requests
r = requests.get("https://www.hypedc.com/nz/nike-air-force-1-07-black-black-cw2288-001")
soup = BeautifulSoup(r.content, 'lxml')
size = soup.find('div', id="size-selector-tab-mobile-0")

size = size.find_all('li') # return list

for t in size:
    print(t.a.text.strip())

answered Jan 8, 2021 at 6:11

Samsul Islam

2,6192 gold badges20 silver badges24 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Supreme Over a year ago

Thank you, appreciate the help

Samsul Islam Over a year ago

please mark answer as accepted if it correctly solved your issue :)

Collectives™ on Stack Overflow

Extracting data from html using python

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related