Multiple log files from different modules in python

Question

I've three different modules, let's call ModuleA, ModuleB and Common. The Common module contains some helper methods that are required by both ModuleA and ModuleB.

I wanted to have separate log files maintained for each modules, that means, there should be ModuleA.log and ModuleB.log. So in each module I've created a logger object with file handler and with the corresponding file names.

Now the problem is, if I call a method in Common from ModuleA, the log events in Common should be added to ModuleA.log and if I call a method from ModuleB, the log events in Common should be appended to ModuleB.log. For this, currently I'm passing a corresponding logger object as a parameter on the method from Common module which I feel is not a good solution.

Is there any way / patter to handle this scenario?

This may not be ideal depending on what the files contain, but if you can turn the important parts of Common into a class to inherit from, I guess you could override self.logger in each of the other two classes. — Peter
– Peter, Commented Mar 5, 2019 at 11:06
@Peter I got you. But what if I have some common decorators and wanted to use those decorators in the ModuleA or ModuleB? — Vimalraj Selvam
– Vimalraj Selvam, Commented Mar 6, 2019 at 4:43

Peter · Accepted Answer · 2019-03-06 10:28:37Z

1

You could have a cache dict in Common that the other modules will be able to import and modify.

Here's a quick example with strings:

Common.py

CACHE = {'logger': None}

def func():
    print(CACHE['logger'])

ModuleA.py

from Common import CACHE, func

CACHE['logger'] = 'mod a'

func()
#mod a

ModuleB.py

from Common import CACHE, func

CACHE['logger'] = 'mod b'

func()
#mod b

If it feels a bit messy using a dict, I think you could potentially make a class to deal with the specific bits you need, it just needs to update in place instead of setting new values.

answered Mar 6, 2019 at 10:28

Peter

3,5453 gold badges32 silver badges66 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Multiple log files from different modules in python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related