Comparing string in Python: String X is ASCII, and String Y is UTF

Question

I have a rather weird problem: How do I compare strings (using Python ) that where String X is ASCII and String Y is in UTF or Unicode?

Currently, when I am comparing strings, I receive the following issue:

UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
  filteredtext = [t for t in s if t.lower() not in stopwords]

How do I ensure that the strings are in the same format?

Best Regards.

There's no such thing as "UTF".

Glenn Maynard
– Glenn Maynard

2011-04-03 16:56:43 +00:00
Commented Apr 3, 2011 at 16:56 — Glenn Maynard
– Glenn Maynard, Commented Apr 3, 2011 at 16:56

Paul D. Waite · Accepted Answer · 2011-04-03 14:59:30Z

6

Convert all string using the underlaying encoding and compare them:

print unicode(s1, 'ascii') == unicode(s1, 'utf-8')

edited Apr 3, 2011 at 14:59

Paul D. Waite

99.5k57 gold badges204 silver badges275 bronze badges

answered Apr 3, 2011 at 13:50

user2665694

Sign up to request clarification or add additional context in comments.

2 Comments

Fred Foo Over a year ago

Unicode is not the "underlying encoding" of ASCII. It's more like a least common multiple.

user2665694 Over a year ago

"underlaying encoding" = encoding used for the related byte stream

Collectives™ on Stack Overflow

Comparing string in Python: String X is ASCII, and String Y is UTF

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related