bash grep results into array

Question

In bash I'm trying to collect my grep results in array, each cell holding each line. I'm downloaing urls with this line

wget -O index -E $CurrentURL

and then i want to grep the 'index' file results (other urls) into array each line per cell, what should be the correct syntax?

Array=(grep "some expression" index)

??

This is where you need to find the links, correct? so where will links be? It is tough to create a comprehensive Regex for URLs. — 0x1F602
– 0x1F602, Commented Nov 20, 2011 at 23:51

E.Z. · Accepted Answer · 2013-03-20 15:59:23Z

9

 readarray GREPPED < <(grep "some expression" index)
 for item in "${GREPPED[@]}"
 do
     # echo
     echo "${item}"   
 done

Oh, and combine those -v greps like so:

 egrep -v '\.(jpg|gif|xml|zip|asp|php|pdf|rar|cgi|html?)'

edited Mar 20, 2013 at 15:59

E.Z.

6,71912 gold badges47 silver badges71 bronze badges

answered Nov 21, 2011 at 0:01

sehe

400k49 gold badges475 silver badges671 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

k-man Over a year ago

thanks, i'll improve my code with that, the first block of code you wrote me doing what? reading from such array or the first line also puts to array?

sehe Over a year ago

The first line outputs to array: gnu.org/s/bash/manual/html_node/Bash-Builtins.html; The other 4 lines just demo how to (whitespace-safely) iterate over them

Blaine Over a year ago

Note that 'readarray' is a very new addition to Bash. It is available on nearly none of the Linux servers, or even Cygwin and Mingw installations where I work. If you want a portable solution, see my 'Probably most...' post below.

Blaine · Accepted Answer · 2011-11-20 23:59:26Z

4

Probably most elegant among several poor alternatives would be to use a temp file.

wget $blah | grep 'whatever' > $TMPFILE
declare -a arr
declare -i i=0
while read; do
    arr[$i]="$REPLY"
    ((i = i + 1))
done < $TMPFILE

I don't have time to explain why, but do not pipe directly into read.

No Unix shell is an appropriate tool for this task. Perl, Groovy, Java, Python... lots of languages could handle this elegantly, but none of the Unix shells.

answered Nov 20, 2011 at 23:59

Blaine

1,5962 gold badges17 silver badges15 bronze badges

Collectives™ on Stack Overflow

bash grep results into array

2 Answers 2

3 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related