I want a logging module that parses the log message and sends it to a database for later analysis (I'm using the Elasticsearch database). My current implementation uses the logging module and has all the standard debug levels. To do this, I need access to the log message. Is there a method in Python's logging module that would get me access to the message?
I feel like this boils down to writing a log handler that fits within Python's logging module. Any ideas?
class StoredLogger(logging.Logger):
def makeRecord(self, *args, **kwargs):
...
return logging.LogRecord(*args, **kwargs)
logging.setLoggerClass(StoredLogger)
Within makeRecord, you could add a call to a function like store_message, whose behavior you define.
def store_message(*args, **kwargs):
"""Write a message to the database"""
...
old_factory = logging.getLogRecordFactory()
def new_factory(*args, **kwargs):
record = old_factory(*args, **kwargs)
record.custom_attribute = 0xDECAFBAD
return record
logging.setLogRecordFactory(new_factory)
You would add your call to store_message into your record_factory.
def record_factory(*args, **kwargs):
store_message(*args, **kwargs)
global old_factory
return old_factory(*args, **kwargs)
Then, when you use something like logging.info('foo'), it will pass through store_message, then resume its normal behavior by writing to its out-stream. You may want to consider renaming record_factory to something more descriptive like stored_record_factory.
Logger.makeRecord in a Logger subclass. I'll add an example of that to my answer when I get a chance.