Java StringTokenizer odd behavior

Question

I'm trying to extract only lowercase alphanumerical characters from a document with this:

String delim = "abcdefghijklmnopqrstuvwxyz0123456789";

StringTokenizer strtok = new StringTokenizer(str, delim, true);

String newstr = "";

while (strtok.hasMoreTokens()) {
    newstr = newstr + strtok.nextToken();
}

return newstr;

Note that the document is already lowercase only. But for some reason all of the punctuation characters are still being returned along with parethesis and /'s, etc.

I thought using the true boolean in the creation of the tokenizer would count delimiters as tokens?

Thomas · Accepted Answer · 2012-03-16 18:40:05Z

3

The delim argument is a delimiter. You're basically asking for each token to be "whatever is between lower case letters". Then the 'true' argument says "give me those letters on the edges too". Were you looking for replaceAll("[^abcdefghijklmnopqrstuvwxyz0123456789]","")?

answered Mar 16, 2012 at 18:40

Thomas

5,0941 gold badge18 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Java StringTokenizer odd behavior

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related