Unicode Regex in Python 3 (from Python 2 Code)

Question

I'm trying to convert my Python 2 script to Python 3. How do we do Regex with Unicode?

This is what I had in Python 2 which works It replaces quotes to « and »:

text = re.sub(ur'"(.*?)"', ur'«\1»', text)

I have some really complex ones which the "ur" made it so easy. But it doesn't work in Python 3:

text = re.sub(ur'ه\sایم([\]\.،\:»\)\s])', ur'ه\u200cایم\1', text)

You do not need u in Python 3 as all strings are Unicode by default. Omit the u prefixes. — Wiktor Stribiżew
– Wiktor Stribiżew, Commented Dec 16, 2016 at 9:48
@Klaus D. IMO not a duplicate. Referenced question is for python 2.x — mkiever
– mkiever, Commented Dec 16, 2016 at 10:18

Drathier · Accepted Answer · 2016-12-16 09:51:41Z

4

All strings in Python3 are unicode by default. Just remove the u and you should be fine.

In Python2 strings are lists of bytes by default, so we use u to mark them as unicode strings.

answered Dec 16, 2016 at 9:51

Drathier

14.7k15 gold badges74 silver badges125 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Elias Dorneles Over a year ago

What about if you're writing code that is supposed to work in both Python 2 and 3?

宏杰李 · Accepted Answer · 2016-12-16 10:26:23Z

0

Since Python 3.0, the language features a str type that contain Unicode characters, meaning any string created using "unicode rocks!", 'unicode rocks!', or the triple-quoted string syntax is stored as Unicode.

Unicode HOWTO This doc will help you.

so, you just do want every you do in Python2, and it will works, no extra effects.

answered Dec 16, 2016 at 10:26

宏杰李

12.2k2 gold badges32 silver badges37 bronze badges

Collectives™ on Stack Overflow

Unicode Regex in Python 3 (from Python 2 Code)

2 Answers 2

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related