Python requests proxy connection timeout

Question

I am using this code to check proxy servers:

def check_proxy(p):
    try:
        r = requests.get('https://httpbin.org/get', proxies={'https': 'https://%s' % p}, timeout=5)
        if r.status_code == 200:
            return True
        else:
            return False
    except:
        return False

it works fine with working proxy. it fails with bad proxy after several minutes:

Traceback (most recent call last):
  File "/home/me/Desktop/general/test_proxyt.py", line 22, in check_proxy
    r = requests.get('https://httpbin.org/get', proxies={'https': 'https://%s' % p}, timeout=5)
  File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 59, in get
    return request('get', url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 48, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 451, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 557, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 413, in send
    raise ConnectionError(e, request=request)
ConnectionError: HTTPSConnectionPool(host='httpbin.org', port=443): Max retries exceeded with url: /get (Caused by ProxyError('Cannot connect to proxy.', error(110, 'Connection timed out')))

Is it possible to set proxy connection timeout exception?

probably need to write HTTPAdapter, for proxy is handled by urllib3 — tdihp
– tdihp, Commented Jun 1, 2015 at 10:08

Ajay · Accepted Answer · 2015-06-01 08:42:31Z

3

May be you can try exceptions that come with the module.

def check_proxy(p):
    try:
            r = requests.get('https://httpbin.org/get', proxies={'https': 'https://%s' % p}, timeout=5)
            if r.status_code == 200:

                return True
            else:
                return False
    except requests.exceptions.Timeout as e:

        # Maybe set up for a retry
        print e

    except requests.exceptions.RequestException as e:
        print e

answered Jun 1, 2015 at 8:42

Ajay

5,3092 gold badges26 silver badges30 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Grammargeek · Accepted Answer · 2024-04-22 21:00:44Z

0

To close the circle here, this was a bug in requests that has since been fixed by updating to urllib3

edited Apr 22, 2024 at 21:00

Grammargeek

1172 silver badges5 bronze badges

answered May 26, 2017 at 20:27

Handyman5

1394 bronze badges

2 Comments

leonheess Over a year ago

The link is dead and I'm having this issue

Mike Bell Over a year ago

Commenting here because I am having a similar problem with httpx, and am doing research on how to fix this problem. Disheartening that the link is dead and that this answer is so old =\

Collectives™ on Stack Overflow

Python requests proxy connection timeout

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related