using command substitution inside a sed script, with arguments

Question

I am trying to write a short script in which I use sed to search a stream, then perform a substitution on the stream based on the results of a shell function, which requires arguments from sed, e.g.

#!/bin/sh

function test {
    echo "running test"
    echo $1
    }

sed -n -e "s/.*\(00\).*/$(test)/p" < testfile.txt

where testfile.txt contains:

(with newlines between each; they are getting removed by your sites formatting). So ok that script works for me (output "running test"), but obviously has no arguments passed to test. I would like the sed line to be something like:

sed -n -e "s/.*\(00\).*/$(test \1)/p" < testfile.txt

and output:

running test
00

So that the pattern matched by sed is fed as an argument to test. I didn't really expect the above to work, but I have tried every combination of $() brackets, backticks, and escapes I could think of, and can find no mention of this situation anywhere. Help?

if you are using GNU sed, read up on the e command ;) gnu.org/software/sed/manual/sed.html#Extended-Commands — user2120209
– user2120209, Commented Feb 28, 2013 at 15:27

Brian White · Accepted Answer · 2011-06-15 09:55:35Z

2

Sed won't execute commands. Perl will, however, with the /e option on a regex command.

perl -pe 'sub testit { print STDERR "running test"; return @_[0]; }; s/.*(00).*/testit($1)/e' <testfile.txt

Redirect stderr to /dev/null if you don't want to see it in-line and screw up the output.

answered Jun 15, 2011 at 9:55

Brian White

8,8442 gold badges50 silver badges74 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Ben Farmer Over a year ago

Perhaps you're right. That's so sad though, so many magical things could be done if only sed would execute commands.

potong · Accepted Answer · 2012-01-16 14:18:36Z

2

This might work for you:

tester () { echo "running test"; echo $1; }
export -f tester
echo -e "1234\n2345\n3006\n4567" |
sed -n 's/.*\(00\).*/echo "$(tester \1)"/p' | sh
running test
00

Or if your using GNU sed:

echo -e "1234\n2345\n3006\n4567" |
sed -n 's/.*\(00\).*/echo "$(tester \1)"/ep'
running test
00

N.B. You must remember to export the function first.

answered Jan 16, 2012 at 14:18

potong

59.3k6 gold badges55 silver badges92 bronze badges

Comments

Bohemian · Accepted Answer · 2011-06-15 09:29:45Z

0

try this:

sed -n -e "s/.*\(00\).*/$1$2/p" testfile.txt | sh

Note: I might have the regex wrong, but the important bit is piping to shell (sh)

edited Jun 15, 2011 at 9:29

answered Jun 15, 2011 at 9:18

Bohemian♦

427k103 gold badges603 silver badges750 bronze badges

1 Comment

Ben Farmer Over a year ago

I'm afraid I don't understand what you are trying to do here, sorry.

Collectives™ on Stack Overflow

using command substitution inside a sed script, with arguments

3 Answers 3

1 Comment

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related