python scrapy 'str' object has no attribute 'encoding'

Question

This is my spider

class AjaxSpider(BaseSpider):
    name = "AjaxSpider"
    start_urls = ['http://localhost:7908/Test.html'];

    def parse(self, response):
        open('firstResponse', 'wb').write(response.body)
        return [FormRequest.from_response('http://localhost:7908/ToLoadAjax.aspx', callback=self.parseAjax)]

    def parseAjax(self,response):
      open('AjaxResponse', 'wb').write(response.body)

I got this exception:

Traceback (most recent call last):
  File "C:\Python27\lib\site-packages\twisted\internet\base.py", line 1201, in mainLoop
    self.runUntilCurrent()
  File "C:\Python27\lib\site-packages\twisted\internet\base.py", line 824, in runUntilCurrent
    call.func(*call.args, **call.kw)
  File "C:\Python27\lib\site-packages\twisted\internet\defer.py", line 382, in callback
    self._startRunCallbacks(result)
  File "C:\Python27\lib\site-packages\twisted\internet\defer.py", line 490, in _startRunCallbacks
    self._runCallbacks()
--- <exception caught here> ---
  File "C:\Python27\lib\site-packages\twisted\internet\defer.py", line 577, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "testAjax\spiders\Spider.py", line 13, in parse
    return [FormRequest.from_response('http://localhost:7908/ToLoadAjax.aspx', callback=self.parseAjax)]
  File "C:\Python27\lib\site-packages\scrapy-0.20.2-py2.7.egg\scrapy\http\request\form.py", line 35, in from_response
    kwargs.setdefault('encoding', response.encoding)
exceptions.AttributeError: 'str' object has no attribute 'encoding'

I am trying to get the post calls using fromrequest

and I can see the post calls in my chrome webkit xhr.

Sunjay Varma · Accepted Answer · 2014-04-05 18:36:15Z

2

It looks like from_response expects a response object. Not a URL string.

Documentation

answered Apr 5, 2014 at 18:36

Sunjay Varma

5,1756 gold badges38 silver badges53 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Talvalin Over a year ago

So what happens if you use return [FormRequest.from_response(response, callback=self.parseAjax)] instead?

Collectives™ on Stack Overflow

python scrapy 'str' object has no attribute 'encoding'

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related