AWS Lambda Python 3.7 runtime exception logging

Question

Unhandled exceptions thrown while using the Python 3.7 runtime do not seem to be logged to CloudWatch as they are in Python 3.6. How can you setup the logger in Python 3.7 to capture this information?

Also posted on AWS forum

To replicate:

1. Create a lambda function like so:

import logging
logger = logging.getLogger()
logger.setLevel(logging.DEBUG)
def lambda_handler(event, context):
logger.info("This shows fine")
raise Exception("I failed")

2. Run this function using the Python 3.6 runtime

START RequestId: a2b6038b-0e5f-11e9-9226-9dfc35a22dcc Version: $LATEST
[INFO]  2019-01-02T07:25:52.797Z    a2b6038b-0e5f-11e9-9226-9dfc35a22dcc //This shows fine
 I failed: Exception
Traceback (most recent call last):
File "/var/task/lambda_function.py", line 9, in lambda_handler
        raise Exception("I failed")
Exception: I failed

END RequestId: a2b6038b-0e5f-11e9-9226-9dfc35a22dcc
REPORT RequestId: a2b6038b-0e5f-11e9-9226-9dfc35a22dcc  Duration: 1.12 ms   Billed Duration: 100 ms     Memory Size: 128 MB Max Memory Used: 21 MB

2. Switch to the Python 3.7 runtime and run again ... no stack trace

    START RequestId: 3840aa8e-0e5d-11e9-bece-45a2022a53c6 Version: $LATEST
    [INFO]  2019-01-02T07:08:35.170Z    3840aa8e-0e5d-11e9-bece-45a2022a53c6    This shows fine

    END RequestId: 3840aa8e-0e5d-11e9-bece-45a2022a53c6
    REPORT RequestId: 3840aa8e-0e5d-11e9-bece-45a2022a53c6  Duration: 2.20 ms   Billed Duration: 100 ms     Memory Size: 128 MB Max Memory Used: 20 MB

docs.aws.amazon.com/en_en/lambda/latest/dg/… might help? or does this only cover the 3.6 part and is invalid in 3.7 - then you should probably raise a bug? — Patrick Artner
– Patrick Artner, Commented Jan 2, 2019 at 8:39
Crosspost: forums.aws.amazon.com/thread.jspa?messageID=883504&tstart=0 - seems to be you from your user name.Please edit link into your post. — Patrick Artner
– Patrick Artner, Commented Jan 2, 2019 at 8:42
I was able to reproduce this behavior in eu-central-1 / Frankfurt - CloudWatch still recognizes that the function failed, which is visible in the metrics, it just doesn't seem to capture the exceptions' output. — Maurice
– Maurice, Commented Jan 2, 2019 at 15:51

Efi MK · Accepted Answer · 2019-01-03 20:30:32Z

7

Yep, I've noticed it. To overcome I use a decorator.

def log_errors(func: Callable[[dict, dict], None]):
    def wrapper(*args, **kwargs):
        try:
            func(*args, **kwargs)
        except Exception as err:
            warning(traceback.format_exc())
            raise err

    return wrapper

Usage:

@log_errors
def handler(event, context):
...

answered Jan 3, 2019 at 20:30

Efi MK

1,0421 gold badge11 silver badges26 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

gwk · Accepted Answer · 2019-01-15 04:59:16Z

1

This is a bug in AWS Lambda. I noticed it mid-December and filed an issue; the response included the following: "I would like to let you know that this has been identified as a genuine issue and the Lambda team is currently working towards resolving it. But, unfortunately I do not have an ETA on when this issue will be resolved."

My solution was to revert back to python3.6 runtime until Amazon fixes it.

answered Jan 15, 2019 at 4:59

gwk

7267 silver badges17 bronze badges

1 Comment

gwk Over a year ago

This was eventually fixed, and I successfully upgraded.

TK Kim · Accepted Answer · 2019-01-02 10:26:49Z

0

It is strange because Exception is built-in function, which should work on both 3.6 and 3.7.

As a workaround, I would suggest making custom exception. Here is a simple example.

test.py

class Error(Exception):
    pass

class CustomException(Error):
    pass

raise CustomException("I failed")

Here is a result when running.

TK$ python3 test.py 

Traceback (most recent call last):
 File "test.py", line 7, in <module>
    raise CustomException("I failed")
__main__.CustomException: I failed

answered Jan 2, 2019 at 10:26

TK Kim

262 bronze badges

1 Comment

Maurice Over a year ago

Hey! Did you try this in the Lambda Runtime Environment, i.e. in AWS? The issue is not that exceptions themselves don't work - rather that Lambda doesn't seem to pick them up ;-)

Collectives™ on Stack Overflow

AWS Lambda Python 3.7 runtime exception logging

To replicate:

3 Answers 3

Comments

1 Comment

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

To replicate:

3 Answers 3

Comments

1 Comment

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related