python module organisation

Question

I am writing a python library that backs up and organises scientific data. lets call it dataapp

I would like to lay out my directory as follows:

core/
operations/
cli_interface.py

core contains all the data classes and the class for a data repository, and all the code is standalone, with no dependancies. operations contains all of the actions, like saving, updating, backing up data, operations does however depend on core. core is not a child of operations and should have the ability to be used on its own.

However importing code from core into operations seems like an ugly thing because I would have to import from relative paths and from the parents.

Another option for importing is for install dataapp on the machine globally, in that case operations can import from core easily.

My question is: is the above recommended, or is there a better way to lay out my code?

rook · Accepted Answer · 2014-06-18 10:27:13Z

2

Try this layout:

core/
    __init__.py
    functions.py

operations/
    __init__.py
    actions.py

test.py

Note: __init__.py files, they are just empty files to define package with a name coincided with the directory name.

Where functions.py with core functions defintions:

def core_function():
    print "core function"

Module actions.py will have such connection with core:

from core import functions

def simple_action():
    functions.core_function()

In your applicationtest.py you could use it as follows:

from core import functions
from operations import actions

functions.core_function()
actions.simple_action()

Note also: that core and operations packages are referenced by whole path - not relative, i.e. if you had lab.sci.core structure you'd use from lab.sci.core and from lab.sci.operations import commands in your test.py application and actions.py module.

answered Jun 18, 2014 at 10:27

rook

6,3305 gold badges42 silver badges54 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Eoin Murray Over a year ago

this solves my issure....I am now using from lab.core import functions in the operations module. My mistake was trying to use from core import functions. But you have now cleared that up for me.

Fred Foo · Accepted Answer · 2014-06-18 09:52:28Z

0

The setup you sketch is perfectly fine. If every module were only allowed to import from its own submodules (a strict tree structure), you could never share code between modules. Tidy module structures are directed acyclic graphs (no mutual imports), not necessarily trees.

answered Jun 18, 2014 at 9:52

Fred Foo

365k80 gold badges765 silver badges852 bronze badges

4 Comments

Eoin Murray Over a year ago

how would you recommend I do it, by installing the app globally and importing, or using relative paths?

Fred Foo Over a year ago

@EoinMurray what do you mean by relative paths?

Eoin Murray Over a year ago

Ill need to put sys.path.append( <path to core> ) in operations. I dont see how I can import naturally.

Fred Foo Over a year ago

@EoinMurray The Python tutorial explains how to set up packages. Changing sys.path in module code is a code smell.

Tok Soegiharto · Accepted Answer · 2014-06-18 10:05:16Z

0

How about it:

cli_interface.py
operations/
core

so core be a child of operation, because core is a data to be used by operations module only.

answered Jun 18, 2014 at 10:05

Tok Soegiharto

3291 silver badge8 bronze badges

2 Comments

Eoin Murray Over a year ago

no, perhaps I was not clear...core is not a child of operations only. It should be allowed to be used on its own. I will update the question to reflect this.

Tok Soegiharto Over a year ago

@EoinMurray, if so, a plain structure will be a better solution.

Mattias Backman · Accepted Answer · 2014-06-18 10:28:34Z

0

There is nothing wrong with your structure. But if you want to be more verbose in imports, this works too:

cli_interface.py
dataapp/
    core/
    operations/

Then you'd do

from dataapp import core

answered Jun 18, 2014 at 10:28

Mattias Backman

9551 gold badge13 silver badges26 bronze badges

Collectives™ on Stack Overflow

python module organisation

4 Answers 4

1 Comment

4 Comments

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

1 Comment

4 Comments

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related