Execute curl command within Python

Question

I am a beginner with python. I am trying to execute a curl command within Python script.

If I do it in the terminal, it looks like this:

curl -k -H "Authorization: Bearer xxxxxxxxxxxxxxxx" -H "hawkular-tenant: test" -X GET https://www.example.com/test | python -m json.tool

I tried to do research, so I think I can use urllib2 library.

How can I run this command?

StackOverflow is not a cURL to Python requests conversion service. curl.trillworks.com is though. — Lukas Graf
– Lukas Graf, Commented Mar 11, 2016 at 19:12
Is there a reason you have you use curl, rather than just sending HTTP requests from inside Python? — DaveBensonPhillips
– DaveBensonPhillips, Commented Mar 11, 2016 at 19:12

Bernardo Meurer · Accepted Answer · 2016-03-11 19:00:58Z

3

Try this

import subprocess

bash_com = 'curl -k -H "Authorization: Bearer xxxxxxxxxxxxxxxx" -H "hawkular-tenant: test" -X GET https://www.example.com/test | python -m json.tool'
subprocess.Popen(bash_com)
output = subprocess.check_output(['bash','-c', bash_com])

This is a good way of doing this because it avoids using os.system which can make things ugly. But try to avoid calling bash commands from inside Python, specially in a case like this where you could simply use Requests instead.

answered Mar 11, 2016 at 19:00

Bernardo Meurer

2,3536 gold badges34 silver badges52 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Gesuri Ramirez · Accepted Answer · 2016-03-11 21:37:37Z

You can use subprocess with Popen and communicate to execute commands and retrieve the output.

def executeCommand(cmd, debug = False):
   '''
   Excecute a command and return the stdiout and errors.
   cmd: list of the command. e.g.: ['ls', '-la']
   '''
   try:
      cmd_data = subprocess.Popen(cmd, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
      output,error = cmd_data.communicate()
      if debug:
         if (len(error)>1):
            print 'Error:', error
         if (len(output)>1):
            print 'Output:', output
      return output, error
   except:
      return 'Error in command:', cmd

Then, you put your command as

executeCommand(['curl', '-k', '-H', '"Authorization: Bearer xxxxxxxxxxxxxxxx"', '-H', '"hawkular-tenant: test"', '-X', 'GET', 'https://www.example.com/test', '|', 'python', '-m', 'json.tool'])

DaveBensonPhillips · Accepted Answer · 2016-03-11 19:11:57Z

0

I wouldn't recommend calling curl via your shell from inside Python. What about httplib?

import httplib
conn = httplib.HTTPConnection("https://www.example.com/test")
conn.request("HEAD","Authorization: Bearer xxxxxxxxxxxxxxxx")
conn.request("HEAD", "hawkular-tenant: test")
res = conn.getresponse()

If you're using Python3 then you'll need to swap httplib for http.client

answered Mar 11, 2016 at 19:11

DaveBensonPhillips

3,2321 gold badge22 silver badges33 bronze badges

1 Comment

David Dimas Over a year ago

[File "C:\Python27\lib\httplib.py", line 732, in _set_hostport raise InvalidURL("nonnumeric port: '%s'" % host[i+1:]) InvalidURL: nonnumeric port: '//hawkularmetrics.apps.10.2.2.2.xip.io/hawkular/metrics/metrics'] I am getting this issue now.

tuned · Accepted Answer · 2016-03-11 22:29:00Z

-1

You can use the pycurl library.

pip install pycurl

Instructions and examples here

answered Mar 11, 2016 at 22:29

tuned

1,12510 silver badges15 bronze badges

Collectives™ on Stack Overflow

Execute curl command within Python

4 Answers 4

Comments

Comments

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related