Java Regex Whitespace not recognized

Question

I'm trying to capture assignment operations from a text file using 'java.util.regex.Pattern'. I've been very frustrated trying to fix my regular expression to actually recognize what I am looking for. I've simplified the problem as much as I can and found an issue with picking up white space.

This post proved helpful, and sheds light on issues dealing with the whitespace character set, but does not answer the question of why the following is not working:

Pattern p = Pattern.compile("adfa =");
Scanner sc = new Scanner("adfa =");

if(sc.hasNext(p))
{
    String s = sc.next(p);
    System.out.println(">" + s + "<");
}
else
    System.out.println(":(");

If I try this:

Pattern p = Pattern.compile("\\w+ *=");

The following string is picked up:

"adfa="

But not:

"adfa ="

Simply by making the following change:

Pattern p = Pattern.compile("adfa=");
Scanner sc = new Scanner("adfa=");

All works as intended! Can anyone shed any light on what is going wrong?

Rohit Jain · Accepted Answer · 2013-01-22 23:25:47Z

5

From the documentation, Scanner#hasNext(Pattern): -

Returns true if the next complete token matches the specified pattern. A complete token is prefixed and postfixed by input that matches the delimiter pattern.

Now, since the default delimiter pattern for Scanner is \p{javaWhitespace}+. Find it out by using Scanner#delimiter() method: -

Scanner sc = new Scanner("abdc =");
System.out.println(sc.delimiter());  // Prints \p{javaWhitespace}+

So, when your Scanner encounters a whitespace in your string. It assumes that the token has ended. And hence stops there, and tries to match the read token with your pattern. And of course it fails, and hence sc.hasNext(p) return false. This is the problem.

edited Jan 22, 2013 at 23:25

answered Jan 22, 2013 at 23:19

Rohit Jain

214k45 gold badges419 silver badges534 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Daeden Over a year ago

EDIT: Just read that the default is indeed any whitespace. Thanks! Not sure how I managed to not read that and assume the delimiter was '\n' or EOF.

Rohit Jain Over a year ago

@Daeden.. Try printing the value of sc.delimiter(). You would get \p{javaWhitespace}+. I hope that makes it clear.

German · Accepted Answer · 2013-01-22 23:28:47Z

2

From Scanner.hasNext(Pattern) javadoc: Returns true if the next complete token matches the specified pattern. A complete token is prefixed and postfixed by input that matches the delimiter pattern.

In Scanner, the withespace is the default delimiter, so in your example the Scanner tries to match the token "adfa" with the regex, which doesn't match. If you change the delimiter to something else, like a line feed:

sc.useDelimiter("\n");

Your regex should work.

EDIT: My answer a bit late!

answered Jan 22, 2013 at 23:28

German

3,6167 gold badges36 silver badges34 bronze badges

1 Comment

Daeden Over a year ago

I appreciate your response nonetheless!

Collectives™ on Stack Overflow

Java Regex Whitespace not recognized

2 Answers 2

2 Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related