UnicodeEncodeError Python 2.7

Question

I am using Tweepy for authentication and I am trying to print text, but I am unable to print the text. I am getting some UnicodeEncodeError. I tried some method but I was unable to solve it.

# -*- coding: utf-8 -*-

import tweepy

consumer_key = ""
consumer_secret = ""
access_token = ''
access_token_secret = ''

auth = tweepy.OAuthHandler(consumer_key, consumer_secret)
auth.set_access_token(access_token, access_token_secret)

api = tweepy.API(auth)

public_tweets = api.home_timeline()
for tweet in public_tweets:
    print tweet.text.decode("utf-8")+'\n'

Error:

(venv) C:\Users\e2sn7cy\Documents\GitHub\Tweepy>python tweepyoauth.py
Throwback to my favourite! Miss this cutie :) #AdityaRoyKapur https://t.co/sxm8g1qhEb/n
Cristiano Ronaldo: 3 hat-tricks in his last 3 matches.

Lionel Messi: 3 trophies in his last 3 matches. http://t.co/For1It4QxF/n
How to Bring the Outdoors in With Indoor Gardens http://t.co/efQjwcszDo http://t.co/1NLxSzHxlI/n
Traceback (most recent call last):
  File "tweepyoauth.py", line 17, in <module>
    print tweet.text.decode("utf-8")+'/n'
  File "C:\myPython\venv\lib\encodings\utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-7: ordinal not in range(128)

that wasn,t the error but thanks, i have corrected that but still i am getting the same error — Rahul Shrivastava
– Rahul Shrivastava, Commented Jun 15, 2015 at 6:26
I came here, and my problem was solved replacing str(i)+"..."+str(x).encode("utf-8") by unicode(i)+u"..."+unicode(x).encode("utf-8"), i.e. making everything unicode before concatenation and encoding. — Nikana Reklawyks
– Nikana Reklawyks, Commented Oct 17, 2016 at 20:00

Serge Ballesta · Accepted Answer · 2015-06-15 06:44:06Z

1

This line print tweet.text.decode("utf-8")+'/n' is the cause.

You decode tweet.text as utf-8 into an unicode string. Fine until here.

But you next try to concatenate it with a raw string '/n' (BTW, I think you really wanted \n) and python try to convert the unicode string to an ascii raw string giving the error.

You should concatenate with a unicode string to obtain a unicode string without conversion :

print tweet.text.decode("utf-8") + u'\n'

If this is not enough, it could be because your environment cannot directly print unicode strings. Then you should explictely encode it in the native charset of your system :

print (tweet.text.decode("utf-8") + u'\n').encode('cp850')

[here replace 'cp850' (my charset) with the charset on your system]

edited Jun 15, 2015 at 6:44

answered Jun 15, 2015 at 6:27

Serge Ballesta

150k13 gold badges137 silver badges267 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

Burhan Khalid Over a year ago

Or he can just get rid of that string all together as print will end a newline.

Rahul Shrivastava Over a year ago

Traceback (most recent call last):   File "tweepyoauth.py", line 17, in <module>     print tweet.text.decode("utf-8") + u'\n'   File "C:\myPython\venv\lib\encodings\utf_8.py", line 16, in decode     return codecs.utf_8_decode(input, errors, True) UnicodeEncodeError: 'ascii' codec can't encode character u'\u2026' in position 139: ordinal not in ra nge(128)

Rahul Shrivastava Over a year ago

and I tried after removing the \n but still its not working

Serge Ballesta Over a year ago

@RahulShrivastava : maybe you must explicitely encode : see my edit

Rahul Shrivastava Over a year ago

how should I know charset

|

Collectives™ on Stack Overflow

UnicodeEncodeError Python 2.7

1 Answer 1

6 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

6 Comments

Your Answer

Sign up or log in

Post as a guest

Related