Trouble running my python selenium script using proxy

Question

I've written a script in python in combination with selenium to fetch a text block from a webpage in which it is written that my scraper is sending request via proxy or not.

For example: if the request is not sent via proxy then text should appear in the console is like 'This request appears NOT to have come via a proxy.', 'The request appears to have originated from ip address [my_ip_address]' which is what I'm having.

How can I run my scraper through proxy? Thanks in advance.

Script I've tried with:

from selenium import webdriver

proxies = {
    'http': 'http://163.172.27.213:3128',
    'https': 'https://163.172.175.210:3128'
}

chrome_options = webdriver.ChromeOptions()
proxy_arg = ';'.join(['{}={}'.format(k, v) for k, v in proxies.items()])
chrome_options.add_argument('--proxy-server="{}"'.format(proxy_arg))

driver = webdriver.Chrome(chrome_options=chrome_options)
driver.get('http://www.lagado.com/proxy-test')
items = [item.text for item in driver.find_elements_by_css_selector(".main-panel p")[:2]]
print(items)
driver.quit()

Berk Baytar · Accepted Answer · 2018-04-08 14:44:33Z

2

from selenium import webdriver

proxy = "12.12.12.12:1212" # IP:PORT or HOST:PORT

chrome_options = webdriver.ChromeOptions()
chrome_options.add_argument('--proxy-server=%s' % proxy)

chrome = webdriver.Chrome(chrome_options=chrome_options)
chrome.get("http://www.google.com")

answered Apr 8, 2018 at 14:44

Berk Baytar

362 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Trouble running my python selenium script using proxy

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related