How to run a python script in aws lambda /tmp directory

Question

I have downloaded a script from git into /tmp directory and I need to run the script in lambda. My handler looks like this:

def handler(event, context):
  process = subprocess.run("/tmp/my_script.py", env = os.environ, stdout=None, stderr=subprocess.STDOUT)

However, my_script.py has some external dependencies, such as gevent.

# my_script.py
import gevent
...

When running in lambda, I got the following error:

ModuleNotFoundError: No module named 'gevent'

I have packaged the gevent module in the zipped file uploaded to lambda, which I believe they are under /var/task. How can I let my_script.py in /tmp directory know where to look for the dependencies?

Coding Monkey · Accepted Answer · 2020-05-13 08:04:25Z

2

I solved this problem by adding "PYTHONPATH" = "/var/task" in env.

os.environ["PYTHONPATH"] = "/var/task"
process = subprocess.run("/tmp/my_script.py", env = os.environ, stdout=None, stderr=subprocess.STDOUT)

answered May 13, 2020 at 8:04

Coding Monkey

1831 gold badge1 silver badge7 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

rouhija · Accepted Answer · 2020-05-13 07:26:59Z

0

You could try inserting /var/task into the path, like so:

import os
import sys
sys.path.insert(0, os.path.abspath(os.path.join(os.path.dirname(__file__), '../var/task')))

import gevent

Assuming the script above is in /tmp and gevent module is in /var/task.

answered May 13, 2020 at 7:26

rouhija

2412 silver badges9 bronze badges

2 Comments

Coding Monkey Over a year ago

Thank you for the answer! But the problem is that the script is cloned from git and I cannot edit it. Or should I even edit it (That seems hacky)? I was wondering if there is a way to specify the path when calling subprocess maybe?

Coding Monkey Over a year ago

Problem solved! Adding "PYTHONPATH" = "/var/task" in env solved the problem.

Collectives™ on Stack Overflow

How to run a python script in aws lambda /tmp directory

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related