JSON.parse throwing Encoding::UndefinedConversionError

Question

Getting the following error on windows:

Encoding::UndefinedConversionError: "\xEF" from ASCII-8BIT to UTF-8

Code:

text = File.open(file, 'r:binary', &:read); #opens file and reads it with r:binary flag
puts text; #works i get here, outputs the below file contents
data = JSON.parse(text.force_encoding(Encoding::UTF_8)); #fails here with above error

Note: I've tried R:UTF-8 as well.

File Contents:

{
  "Environments": [
    {
      "Environment": "UT",
      "Configuration_Directory": "configs/",
      "Files": [
        {
          "Source": "Web.ENV.config",
          "Destination": "Web.config"
        }
      ]
    },
    {
      "Environment": "UAT",
      "Configuration_Directory": "configs/",
      "Files": [
        {
          "Source": "Web.ENV.config",
          "Destination": "Web.config"
        }
      ]
    },
    {
      "Environment": "Staging",
      "Configuration_Directory": "configs/",
      "Files": [
        {
          "Source": "Web.ENV.config",
          "Destination": "Web.config"
        }
      ]
    },
    {
      "Environment": "Production",
      "Configuration_Directory": "configs/",
      "Files": [
        {
          "Source": "Web.ENV.config",
          "Destination": "Web.config"
        }
      ]
    }
  ]
}

I had this problem and this help resolve it stackoverflow.com/questions/23309669/… — user5237076
– user5237076, Commented Aug 17, 2015 at 23:12

Eric Parshall · Accepted Answer · 2019-06-30 04:37:25Z

11

I had this problem where the original string was UTF-8 with BOM but Ruby had encoded it as ASCII-8bit. I convert the string to a byte array and then back into a string while forcing the encoding to be UTF-8.

string_value.bytes.pack("c*").force_encoding("UTF-8")

answered Jun 30, 2019 at 4:37

Eric Parshall

7519 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Marcos Serpa Over a year ago

Eric you saved me a lot of Googling <3

Collectives™ on Stack Overflow

JSON.parse throwing Encoding::UndefinedConversionError

Code:

File Contents:

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

Code:

File Contents:

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related