Loading a json file in python

Question

I've got multiple file to load as JSON, they are all formatted the same way but for one of them I can't load it without raising an exception. This is where you can find the file:

File

I did the following code:

def from_seed_data_extract_summoners():
   summonerIds = set()
   for i in range(1,11):
       file_name = 'data/matches%s.json' % i
       print file_name
       with open(file_name) as data_file:    
           data = json.load(data_file)
       for match in data['matches']:
           for summoner in match['participantIdentities']:
               summonerIds.add(summoner['player']['summonerId'])
   return summonerIds

The error occurs when I do the following: json.load(data_file). I suppose there is a special character but I can't find it and don't know how to replace it. The error generated is:

UnicodeDecodeError: 'utf8' codec can't decode byte 0xeb in position 6: invalid continuation byte

Do you know how I can get ride of it?

Community · Accepted Answer · 2017-05-23 11:52:34Z

2

Your JSON is trying to force the data into unicode, not just a simple string. You've got some embedded character (probably a space or something not very noticable) that is not able to be forced into unicode.

How to get string objects instead of Unicode ones from JSON in Python?

That is a great thread about making JSON objects more manageable in python.

edited May 23, 2017 at 11:52

CommunityBot

11 silver badge

answered Jun 27, 2016 at 13:34

rob

2,1791 gold badge25 silver badges47 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Yonatan Kiron · Accepted Answer · 2016-06-27 14:27:36Z

2

replace file_name = 'data/matches%s.json' % i with file_name = 'data/matches%i.json' % i
the right syntax is data = json.load(file_name) and not -

with open(file_name) as data_file: data = json.load(data_file)

EDIT:

def from_seed_data_extract_summoners():
 summonerIds = set()   
   for i in range(1,11):
        file_name = 'data/matches%i.json' % i
        with open(file_path) as f:
            data = json.load(f, encoding='utf-8')
        for match in data['matches']:
            for summoner in match['participantIdentities']:
                summonerIds.add(summoner['player']['summonerId'])    
    return summonerIds

edited Jun 27, 2016 at 14:27

answered Jun 27, 2016 at 13:34

Yonatan Kiron

2,8381 gold badge22 silver badges25 bronze badges

3 Comments

mel Over a year ago

I did the change and get the following error: AttributeError: 'str' object has no attribute 'read'

Yonatan Kiron Over a year ago

I will rewrite my answer for you

Yonatan Kiron Over a year ago

Also take a look at docs.python.org/2/library/json.html#json.load and docs.python.org/2/library/json.html#json.load @mel

ntg · Accepted Answer · 2016-06-27 13:43:29Z

1

Try:

json.loads(unicode(data_file.read(), errors='ignore'))

or :

json.loads(unidecode.unidecode(unicode(data_file.read(), errors='ignore')))

(for the second, you would need to install unidecode)

answered Jun 27, 2016 at 13:43

ntg

14.4k10 gold badges85 silver badges107 bronze badges

Comments

Yonatan Kiron · Accepted Answer · 2016-06-27 14:41:43Z

1

try :

json.loads(data_file.read(), encoding='utf-8')

edited Jun 27, 2016 at 14:41

Yonatan Kiron

2,8381 gold badge22 silver badges25 bronze badges

answered Jun 27, 2016 at 13:36

Loïc

12k2 gold badges35 silver badges52 bronze badges

1 Comment

mel Over a year ago

I got the following: 'ascii' codec can't decode byte 0xc3 in position 16260798: ordinal not in range(128)

Collectives™ on Stack Overflow

Loading a json file in python

4 Answers 4

Comments

3 Comments

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

3 Comments

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related