Junk character when using System.Text.Encoding.GetEncoding.GetString

Question

I am extracting string from an byte array. The string is a sql script.

String sql = System.Text.Encoding.GetEncoding(1200).GetString(script);

The first character is coming out to be junk(square box in preview). Due to which the whole script is failing. Any idea why this is happening?

I don't want to specifically remove the first character. More interested in knowing why and how can this be avoided.

There is no difference between System.Text.Encoding.GetEncoding and System.Text.UTF32Encoding.GetEncoding. I've removed the reference to UTF32Encoding because it might confuse people. — dtb
– dtb, Commented Dec 6, 2010 at 16:55

dtb · Accepted Answer · 2010-12-06 17:03:00Z

2

The first character(s) are probably Byte Order Marks (BOM).

You can use a StreamReader to automatically detect any BOM and select the appropriate encoding:

byte[] script;
string sql;

using (var reader = new StreamReader(new MemoryStream(script), true))
{                                   //                          ↑ 
    sql = reader.ReadToEnd();       //        detectEncodingFromByteOrderMarks
}

edited Dec 6, 2010 at 17:03

answered Dec 6, 2010 at 16:57

dtb

218k37 gold badges413 silver badges438 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Junk character when using System.Text.Encoding.GetEncoding.GetString

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related