Python requests module connection timeout

Question

I'm looking at http://docs.python-requests.org/en/latest/ and "Connection Timeouts" is listed as a feature. However, when I read further, it states

timeout is not a time limit on the entire response download; rather, an exception is raised if the server has not issued a response for timeout seconds (more precisely, if no bytes have been received on the underlying socket for timeout seconds).

That doesn't sound like a description of a connection timeout. What I'm seeing is a connection is successful, it uploads a big file and then waits for a response. However, the response takes a while and then timesout.

How can I set a connection timeout, but still wait for slow responses once a connection has been successful? Thanks a lot.

Related: Python requests, how to limit received size, transfer rate, and/or total time?, Timeout for python requests.get entire response — Martijn Pieters
– Martijn Pieters, Commented Jul 16, 2014 at 15:41

Darren Weber · Accepted Answer · 2019-10-07 23:55:46Z

20

The requests (for humans) library has connection timeouts, see - https://requests.kennethreitz.org/en/master/user/advanced/#timeouts

r = requests.get('https://github.com', timeout=(3.05, 27))

# e.g. explicitly
conn_timeout = 6
read_timeout = 60
timeouts = (conn_timeout, read_timeout)
r = requests.get('https://github.com', timeout=timeouts)

The docs are not exactly explicit about which value is which in the tuple, but it might be safe to assume that it's (connect, read) timeouts.

answered Oct 7, 2019 at 23:55

Darren Weber

1,7141 gold badge21 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Bruno Grieder Over a year ago

This is the most practical answer to setting timeouts

caiolopes Over a year ago

The docs is not explicit, but looking the code docstring we can confirm that it is (connect, read)

Martijn Pieters · Accepted Answer · 2014-07-16 15:46:49Z

13

The timeout is used for both the socket connect stage and the response reading stage. The only exception is streamed requests; if you set stream=True, the timeout cannot be applied to the reading portion. The timeout is indeed used just for waiting for the socket to connect or data to be received.

If you need an overall timeout, then use another technique, like using interrupts or eventlets: Timeout for python requests.get entire response

edited Jul 16, 2014 at 15:46

answered Jul 16, 2014 at 15:28

Martijn Pieters

1.1m326 gold badges4.2k silver badges3.4k bronze badges

1 Comment

Ivan De Paz Centeno Over a year ago

Note that this does not mean that you can't receive a read timeout exception with stream=True.

Collectives™ on Stack Overflow

Python requests module connection timeout

2 Answers 2

2 Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related