14

I am writing python scripts and execute them in a Makefile. The python script is used to process data in a pipeline. I would like Makefile to execute the script every time I make a change to my python scripts.

Does anyone have an idea of how to do this?

3 Answers 3

23

That's not a lot of information, so this answer is a bit vague. The basic principle of Makefiles is to list dependencies for each target; in this case, your target (let's call it foo) depends on your python script (let's call it do-foo.py):

foo: do-foo.py
    python do-foo.py > foo

Now foo will be rerun whenever do-foo.py changes (provided, of course, you call make).

Sign up to request clarification or add additional context in comments.

2 Comments

I did not define the dependency to my .py files correctly in my script. thanks
As a note, even though the question is effectively self-resolved, I'd like to expand on this answer. You can also define bytecode compilation as a target using invocations of python -m compileall to produce the target pyc/pyo files.
5

And in case when the scripts that need to be run don't produce any useful output file that can be used as a target, you can just use a dummy target:

scripts=a.py b.py c.py
checkfile=.pipeline_up_to_date

$(checkfile): $(scripts)
    touch $(checkfile)
    echo "Launching some commands now."

default: $(checkfile)

Comments

1

If you want that Makefile to be automatically "maked" immediately after saving, pyinotify, which is a wrapper for inotify, might be the only possibility under Linux. It registers at the kernel to detect FS changes and calls back your function.

See my previous post on that topic.

1 Comment

good to know! but I think I my question was a little bit unclear it was more a makefile question. Thanks anyway!

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.