python program for fetching link from a page

Question

I am trying to download an entire play list for Android development tutorial from Youtube. So I used savefrom for generating playlist for download. But the problem is that I have so many videos in that playlist. So, I decided to write a python script for making this work simpler. But the problem is it uses Java Script to generate the link so I cant able to fetch generated link using javascript()

Example: http://ssyoutube.com/watch?v=AfleuRtrJoA It takes 5 sec to generate download links.

I want to get page source only after 5 sec from the browse.

For this kind of work I found a good package named selenium.

import time
from selenium import webdriver

def savefromnotnet(url):
    browser = webdriver.Firefox() # Get local session of firefox
    browser.get(url) # Load page
    time.sleep(5) # Let the page load, will be added to the API
    return browser.page_source()

source = savefromnotnet("http://ssyoutube.com/watch?v=AfleuRtrJoA")

The savefromnotnet function open's Firefox and it will request the url, up to this every thing works fine. But when I want to get page source browser.page_source() it shows the following error.

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Python27\lib\site-packages\spyderlib\widgets\externalshell\sitecustomize.py", line 523, in runfile
    execfile(filename, namespace)
  File "C:\Users\BK\Desktop\Working Folder\Python Temp\temp.py", line 10, in <module>
    source = savefromnotnet("http://ssyoutube.com/watch?v=AfleuRtrJoA")
  File "C:\Users\BK\Desktop\Working Folder\Python Temp\temp.py", line 8, in savefromnotnet
    return browser.page_source()
TypeError: 'unicode' object is not callable

Add link to playlist. And show your code.

furas
– furas

2013-07-05 23:51:40 +00:00
Commented Jul 5, 2013 at 23:51 — furas
– furas, Commented Jul 5, 2013 at 23:51

fliedonion · Accepted Answer · 2013-07-06 01:23:31Z

2

Error occured on following line.

return browser.page_source()

I think brackets did not need.

return browser.page_source

answered Jul 6, 2013 at 1:23

fliedonion

9628 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

user3252247 · Accepted Answer · 2014-01-30 08:36:07Z

0

I think not !

pcode = wdriver.page_source()

is absoluteley right call. By auto-complete in python ide.

I have the same problem. Looks like we need to encode page-sourse text variable in somethind like classic ANSI

answered Jan 30, 2014 at 8:36

user3252247

2813 silver badges2 bronze badges

Collectives™ on Stack Overflow

python program for fetching link from a page

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related