Google search using python script [closed]

Question

Closed. This question is seeking recommendations for software libraries, tutorials, tools, books, or other off-site resources. It does not meet Stack Overflow guidelines. It is not currently accepting answers.

We don’t allow questions seeking recommendations for software libraries, tutorials, tools, books, or other off-site resources. You can edit the question so it can be answered with facts and citations.

Closed 5 years ago.

Improve this question

Could anyone help me on how to write a python script that searches google and prints the links of top results.

Or how basic of help are you looking for? Beginners? Getting started with web scraping? — jball
– jball, Commented Oct 10, 2010 at 1:17
@jball i havent coded yet. I am new to python. I have learnt the basic structure of coding in python. So inorder to implement google search can u suggest me where to start with. what kind of modules to use? — sudh
– sudh, Commented Oct 10, 2010 at 1:18

Mansoor Akram · Accepted Answer · 2016-07-01 09:43:44Z

34

Try this, its very simple to use: https://pypi.python.org/pypi/google

Docs: https://breakingcode.wordpress.com/2010/06/29/google-search-python/

Github: https://github.com/MarioVilas/google

Install this python package and usage is as simple as this:

# Get the first 5 hits for "google 1.9.1 python" in Google Pakistan
from google import search

for url in search('google 1.9.1 python', tld='com.pk', lang='es', stop=5):
    print(url)

edited Jul 1, 2016 at 9:43

answered Jun 29, 2016 at 18:44

Mansoor Akram

2,0664 gold badges26 silver badges40 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

GorvGoyl Over a year ago

geeksforgeeks.org/performing-google-search-using-python-code

user1142217 Over a year ago

This worked for me, except that using the tld='...' key consistently resulted in a "connection refused" error. To search for an exact phrase, you can surround it in double quotes, just as you would for a normal google search.

Hartator · Accepted Answer · 2018-04-17 01:24:16Z

25

Maybe, something like this?

import urllib
import json as m_json
query = raw_input ( 'Query: ' )
query = urllib.urlencode ( { 'q' : query } )
response = urllib.urlopen ( 'http://ajax.googleapis.com/ajax/services/search/web?v=1.0&' + query ).read()
json = m_json.loads ( response )
results = json [ 'responseData' ] [ 'results' ]
for result in results:
    title = result['title']
    url = result['url']   # was URL in the original and that threw a name error exception
    print ( title + '; ' + url )

Read the docs http://docs.python.org/

[Edit] As the AJAX API is dead, you can use a third party service, like SerpApi, they do provide a Python library.

edited Apr 17, 2018 at 1:24

Hartator

5,1874 gold badges46 silver badges74 bronze badges

answered Oct 10, 2010 at 3:55

LK-

2823 silver badges2 bronze badges

2 Comments

user567879 Over a year ago

This gives five results only?

vishnu viswanath Over a year ago

This api is no longer available. We have to use developers.google.com/custom-search

Shiv Deepak · Accepted Answer · 2010-10-10 06:02:23Z

1

it is better suggested to use google apis but a very ugly version.. (alternative to use google api) you can filter content if you want

import os, urllib, sys
filename = 'http://www.google.com/search?' + urllib.urlencode({'q': ' '.join(sys.argv[1:]) })
cmd = os.popen("lynx -dump %s" % filename)
output = cmd.read()
cmd.close()
print output

it will print exactly what ever a browser should display when you search for something on google

answered Oct 10, 2010 at 6:02

Shiv Deepak

3,1365 gold badges38 silver badges50 bronze badges

2 Comments

mt3 Over a year ago

interesting for the "lynx -dump"

heltonbiker Over a year ago

I usually get good results with re (regular expression module) to "dump" source-code of pages. Just in case using Linux is not available ;o)

Løiten · Accepted Answer · 2016-06-29 09:28:43Z

1

As @Zloy Smiertniy pointed out, the answer can be found here.

However, if you are using Python 3 the syntax of raw_input, urllib has changed, and one has to decode the response. Thus, for Python 3 one can use:

import urllib
import urllib.request
import json
url = "http://ajax.googleapis.com/ajax/services/search/web?v=1.0&"
query = input("Query:")
query = urllib.parse.urlencode( {'q' : query } )
response = urllib.request.urlopen (url + query ).read()
data = json.loads ( response.decode() )
results = data [ 'responseData' ] [ 'results' ]
for result in results:
    title = result['title']
    url = result['url']
    print ( title + '; ' + url )

edited Jun 29, 2016 at 9:28

answered Jan 17, 2016 at 15:20

Løiten

3,2474 gold badges28 silver badges37 bronze badges

3 Comments

Mansoor Akram Over a year ago

In python3 i am getting this error: 'module' object has no attribute 'parse'

Løiten Over a year ago

Hmm...strange. It should be there according to docs.python.org/3/library/urllib.html. I noticed that after rerunning the script that I had to add import urllib.request (now in the updated answer), so maybe import urllib.parse could help in your case. Also note that after rerunning the script, I had troubles getting an output for response, so the url may have changed since I used the script last time. Best of luck

ands Over a year ago

This API is no longer available, the alternative is google-custom-search.

Johan Lundberg · Accepted Answer · 2016-07-21 18:57:52Z

0

Try the following:

import webbrowser
lib = input()
url = "https://www.google.co.in/search?q=" +(str(lib))+ "&oq="+(str(lib))+"&gs_l=serp.12..0i71l8.0.0.0.6391.0.0.0.0.0.0.0.0..0.0....0...1c..64.serp..0.0.0.UiQhpfaBsuU"
webbrowser.open_new(url)

edited Jul 21, 2016 at 18:57

Johan Lundberg

27.3k13 gold badges76 silver badges101 bronze badges

answered Jul 21, 2016 at 18:38

mayank

3153 silver badges3 bronze badges

1 Comment

ands Over a year ago

This doesn't answer the OP's question. It just opens the page in a browser window (even though OP asked for python script) and it doesn't print out the results (links).

Rohith Sankar · Accepted Answer · 2016-03-05 17:30:49Z

-3

I'm a newbie to Python. Just my simple idea for a google search.

import webbrowser
lib=raw_input("Enter what you want to search for:")
ur="https://www.google.co.in/gfe_rd=cr&ei=Q7nZVqSBIMSL8QeBpbOoDQ#q="
webbrowser.open_new(ur+lib)

answered Mar 5, 2016 at 17:30

Rohith Sankar

1

1 Comment

Mogsdad Over a year ago

This doesn't actually do what was asked; it performs a google search by opening a browser window, but the Python code never receives the search results to display (or otherwise manipulate).

lf2225 · Accepted Answer · 2018-02-24 00:09:47Z

-3

I've used SERP API to accomplish this.

The instructions are fairly simple:

pip install google-search-results

and the usage is:

from lib.google_search_results import GoogleSearchResults
query = GoogleSearchResults({"q": "coffee"})
json_results = query.get_json()

More advanced uses are on Github.

answered Feb 24, 2018 at 0:09

lf2225

4054 silver badges6 bronze badges

Comments

Ronis Gracie · Accepted Answer · 2014-12-14 20:06:25Z

-7

from pygoogle import pygoogle
g = pygoogle('quake 3 arena')
g.pages = 5
print '*Found %s results*'%(g.get_result_count())
g.get_urls()

answered Dec 14, 2014 at 20:06

Ronis Gracie

11 bronze badge

1 Comment

reticentroot Over a year ago

Dude you just copied and pasted that from the pygoogle, which no longer works fyi. You provided zero explain as well.

Collectives™ on Stack Overflow

Google search using python script [closed]

8 Answers 8

2 Comments

2 Comments

2 Comments

3 Comments

1 Comment

1 Comment

Comments

1 Comment

Linked

Hot Network Questions

Collectives™ on Stack Overflow

8 Answers 8

2 Comments

2 Comments

2 Comments

3 Comments

1 Comment

1 Comment

Comments

1 Comment

Linked

Related