ValueError: Missing scheme in request url: h in python

Question

This is my code and i am trying to access a review from this site but showing an error.

class DomainCrawlSpider(BaseSpider):
    name = "Spider"
    allowed_domains = ["www.smahavarkar.wordpress.com"]
    start_urls = "http://smahavarkar.wordpress.com/"

    def parse(self, response):
        hxs = HtmlXPathSelector(response)
        titles = hxs.select("//p")
        items = []
        for titles in titles:
            item = DItem()
            item ["address"] = titles.select("a/text()").extract()
            item ["review1"] = titles.select("p/text()").extract()
            item.append(item)
        return item

ValueError: Missing scheme in request url: h

iamsujit
– iamsujit

2014-12-03 14:58:46 +00:00
Commented Dec 3, 2014 at 14:58 — iamsujit
– iamsujit, Commented Dec 3, 2014 at 14:58

selllikesybok · Accepted Answer · 2014-12-03 15:09:47Z

2

start_urls should be a list, try changing to:

start_urls = ["https://www.zomato.com/cs/mumbai/restaurace?q=pop%20tates"]

answered Dec 3, 2014 at 15:09

selllikesybok

1,24511 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

selllikesybok Over a year ago

what is the full traceback?

selllikesybok Over a year ago

though I'm pretty sure your problem is that it should be items.append(item).

iamsujit Over a year ago

SOrry for mistake but How do i fix it it seems all code is correct

selllikesybok Over a year ago

item.append(item) becomes items.append(item)

Anh Pham · Accepted Answer · 2017-07-30 10:15:09Z

0

Change start_urls to:

start_urls = ("http://smahavarkar.wordpress.com/",)

It worked for me.

edited Jul 30, 2017 at 10:15

Anh Pham

2,1189 gold badges20 silver badges29 bronze badges

answered Jul 30, 2017 at 8:08

Crypto营长

1791 gold badge3 silver badges17 bronze badges

Collectives™ on Stack Overflow

ValueError: Missing scheme in request url: h in python

2 Answers 2

4 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related