Python Request for JSON file returns None

Question

from fake_useragent import UserAgent
import requests

ua = UserAgent()
header = {'User-Agent':str(ua.chrome)}

d = {"query": "/api/v2/details/ip/", "query_entry": "41.219.127.69"}


r = requests.get("https://talosintelligence.com/sb_api/query_lookup/", 
data = d, headers=header)

When I run the same result from the main site "talosintelligence.com" and look at the network counsel, that exact URL is responds with a JSON file but a get request from python returns None.

I think it may be using a session cookie to confirm that the query is coming from the form. — Barmar
– Barmar, Commented Aug 15, 2017 at 0:18

VeNoMouS · Accepted Answer · 2017-08-15 01:01:07Z

1

I got it to work by setting the referer header..

import requests
sess = requests.session()
ip_addr = "41.219.127.69"
ret = sess.get('https://talosintelligence.com/sb_api/query_lookup', data={"query": "/api/v2/details/ip/", "query_entry": ip_addr, "offset": 0, "order": "ip asc"}, headers={'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.31 Safari/537.36', 'referer': 'https://talosintelligence.com/reputation_center/lookup?search=' + ip_addr})

answered Aug 15, 2017 at 1:01

VeNoMouS

3022 silver badges5 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Mohammad U. Over a year ago

Thank you!! Just adding "referer" to the header resolved it.

Collectives™ on Stack Overflow

Python Request for JSON file returns None

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related