Search curl output for string with Bash

Question

Trying to fetch a webpage as a lowercase string, then search the string output for a substring

My attempt:

  1 #!/usr/bin/env bash
  2
  3 URL="https://somesite.com"
  4 MOVIES_SOURCE="movies.txt"
  5 PAGE=`curl "$URL"` | tr '[:upper:]' '[:lower:]'
  6
  7 while IFS= read -r movie
  8 do
  9   FOUND="$($PAGE =~ "$movie")"
 10   echo $FOUND
 11   if [[ $FOUND ]]; then
 12    echo "$movie found"
 13   fi
 14 done < $MOVIES_SOURCE
 15

When I run this, I'm receiving line 9: =~: command not found

The $movie variable is valid and contains each line from movies.txt, but I'm struggling to figure out this one!

Adding the line numbers makes it more difficult to copy and test your code, by the way. — Benjamin W.
– Benjamin W., Commented May 22, 2019 at 13:40
I'm a bit unclear about what you're trying to do...some sample input and corresponding desired output would make things clearer. I suspect that this can be reduced to a short line of awk. — Tom Fenech
– Tom Fenech, Commented May 22, 2019 at 14:07

Chris Maes · Accepted Answer · 2019-05-22 12:52:32Z

1

If you want to use regex matching in bash:

if [[ $PAGE =~ $movie ]]; then
    echo "$movie found"
fi

example:

PAGE="text blah Avengers more text"
movie="Avengers"
if [[ $PAGE =~ $movie ]]; then
    echo "$movie found"
fi

gives:

Avengers found

Also: to capture the output of the whole curl command:

PAGE=$(curl "$URL" | tr '[:upper:]' '[:lower:]')

always prefer $() over backticks
you had to wrap your whole command in order for $PAGE to contain the output where you converted to lowercase.

edited May 22, 2019 at 12:52

answered May 22, 2019 at 12:44

Chris Maes

38.2k15 gold badges119 silver badges158 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Search curl output for string with Bash

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related