How to use pipes in python without blocking?

Question

In python, I want to create a subprocess and read and write data to its stdio. Lets say I have the following C program that just writes its input to its output.

#include <stdio.h>
int main() {
    char c;
    for(;;) {
        scanf("%c", &c);
        printf("%c", c);
    }
}

In python I should be able to use this using the subprocess module. Something like this:

from subprocess import *
pipe = Popen("thing", stdin=PIPE, stdout=PIPE)
pipe.stdin.write("blah blah blah")
text = pipe.stdout.read(4) # text should == "blah"

However in this case the call to read blocks indefinitely. How can I do what I'm trying to achieve?

Community · Accepted Answer · 2017-05-23 11:56:54Z

4

stdout is line-buffered when writing to a terminal, but fully buffered when writing to a pipe so your output isn't being seen immediately.

To flush the buffer, call fflush(stdout); after each printf(). See also this question which is the same except that your subprocess is written in C, and this question which references stdin/stdout behaviour as defined in C99.

edited May 23, 2017 at 11:56

CommunityBot

11 silver badge

answered Nov 24, 2010 at 8:17

SimonJ

21.3k2 gold badges38 silver badges51 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Shum · Accepted Answer · 2010-11-24 08:33:36Z

0

I found the pexpect module which does exactly what I need.

answered Nov 24, 2010 at 8:33

Shum

1,2761 gold badge9 silver badges27 bronze badges

Collectives™ on Stack Overflow

How to use pipes in python without blocking?

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related