| Groups | Blog | Home |
dotnet clr : StreamWriter Adds FFFE at the start of the file with Unicode Encoding!!
hi jay
the other app is Ntbackup which saves its backup files list in unicode without FFFE at the start of the file. any idea how can I remove it from the file. TIA [quoted text, click to view] "Jay B. Harlow [MVP - Outlook]" <Jay_Harlow_MVP@msn.com> wrote in message news:eaJbQFtPEHA.648@TK2MSFTNGP10.phx.gbl... > Majed, > Sounds like a bug in your other app! > > FFFE is the byte order mark of Unicode, it signifies to Unicode that the > bytes are little endian. While FEFF signifies to Unicode that the bytes are > big endian! > > Notice that in your samples, FEFF is Big Endian > > BIGENDIANUNICODE FEFF00480065006C006C006F00210021000D000A > > ...H.e.l.l.o.!.!.... > > , while FFFE is little endian:
jay,
i'm sorry about that,I was late up because of this problem. yuor reply was great and did solve it. tahnks and sorry again.:) majed [quoted text, click to view] "Jay B. Harlow [MVP - Outlook]" <Jay_Harlow_MVP@msn.com> wrote in message news:usUAaMuPEHA.1392@TK2MSFTNGP09.phx.gbl... > Majed, > > any idea how can I remove it from the > > file. > I take it you did not read my response! As I indicated in my response how > you remove it from the file! > > Hope this helps > Jay > > > "Majed" <amjedksa@hotmail.com> wrote in message > news:e1rI2TtPEHA.1340@TK2MSFTNGP12.phx.gbl... > > hi jay > > the other app is Ntbackup which saves its backup files list in unicode > > without FFFE at the start of the file. any idea how can I remove it from > the > > file. > > TIA > > "Jay B. Harlow [MVP - Outlook]" <Jay_Harlow_MVP@msn.com> wrote in message > > news:eaJbQFtPEHA.648@TK2MSFTNGP10.phx.gbl... > > > Majed, > > > Sounds like a bug in your other app! > > > > > > FFFE is the byte order mark of Unicode, it signifies to Unicode that the > > > bytes are little endian. While FEFF signifies to Unicode that the bytes > > are > > > big endian! > > > > > > Notice that in your samples, FEFF is Big Endian > > > > BIGENDIANUNICODE FEFF00480065006C006C006F00210021000D000A > > > > ...H.e.l.l.o.!.!.... > > > > > > , while FFFE is little endian: > > > > > >
Hi , all
I'm trying to write unicode to a file for another app (not developed with vs2003) to read it. I used StreamWriter with unicode encoding.but I was surprised that the streamwriter adds FFFE to the start of the file,which stopes the other app from reading it!! any idea how to stope it frome doing that,do I have to use another class #####writer that supports unicode? help me Please! Thanks majed I did some code with diferent encoding and here is the result: UTF7 48656C6C6F2B4143454149512D0D0A Hello+ACEAIQ-.. DEFAULT 48656C6C6F21210D0A Hello!!.. ASCII 48656C6C6F21210D0A Hello!!.. BIGENDIANUNICODE FEFF00480065006C006C006F00210021000D000A ....H.e.l.l.o.!.!.... UNICODE FFFE480065006C006C006F00210021000D000A00 ...H.e.l.l.o.!.!..... UTF8 EFBBBF48656C6C6F21210D0A ....Hello!!.. and here is the code Imports System Imports System.Text Imports System.IO Class filestream Public Shared Sub main() Dim ASCIIStream As New StreamWriter("ASCIIStream.txt", False, System.Text.Encoding.ASCII) Dim BigEndianUnicodeStream As New StreamWriter("BigEndianUnicodeStream.txt", False, System.Text.Encoding.BigEndianUnicode) Dim UnicodeStream As New StreamWriter("UnicodeStream.txt", False, System.Text.Encoding.Unicode) Dim DefaultStream As New StreamWriter("DefaultStream.txt", False, System.Text.Encoding.Default) Dim UTF7Stream As New StreamWriter("UTF7Stream.txt", False, System.Text.Encoding.UTF7) Dim UTF8Stream As New StreamWriter("UTF8Stream.txt", False, System.Text.Encoding.UTF8) ASCIIStream.WriteLine("Hello!!") ASCIIStream.Close() ASCIIStream = Nothing BigEndianUnicodeStream.WriteLine("Hello!!") BigEndianUnicodeStream.Close() BigEndianUnicodeStream = Nothing UnicodeStream.WriteLine("Hello!!") UnicodeStream.Close() UnicodeStream = Nothing DefaultStream.WriteLine("Hello!!") DefaultStream.Close() DefaultStream = Nothing UTF7Stream.WriteLine("Hello!!") UTF7Stream.Close() UTF7Stream = Nothing UTF8Stream.WriteLine("Hello!!") UTF8Stream.Close() UTF8Stream = Nothing Console.WriteLine ("Done!) End Sub End Class
Majed,
Sounds like a bug in your other app! FFFE is the byte order mark of Unicode, it signifies to Unicode that the bytes are little endian. While FEFF signifies to Unicode that the bytes are big endian! Notice that in your samples, FEFF is Big Endian [quoted text, click to view] > BIGENDIANUNICODE FEFF00480065006C006C006F00210021000D000A > ...H.e.l.l.o.!.!.... , while FFFE is little endian: [quoted text, click to view] > UNICODE FFFE480065006C006C006F00210021000D000A00 > ..H.e.l.l.o.!.!..... You can prevent the byte order mark from being written by creating a new UnicodeEncoding object that you pass as the Encoding parameter of the STreamWriter constructor. Something like(untested): ' little endian, no byte order marks Dim encoding As New UnicodeEncoding(False, False) Dim stream as FileStream Dim writer As New StreamWriter(stream, encoding) Of course you will need to be certain that you other app does not have an issue with little endian verses big endian Unicode characters. Hope this helps Jay [quoted text, click to view] "Majed" <amjedksa@hotmail.com> wrote in message news:%23G4GN9sPEHA.308@TK2MSFTNGP11.phx.gbl... > Hi , all > I'm trying to write unicode to a file for another app (not developed with > vs2003) to read it. I used StreamWriter with unicode encoding.but I was > surprised that the streamwriter adds FFFE to the start of the file,which > stopes the other app from reading it!! > any idea how to stope it frome doing that,do I have to use another class > #####writer that supports unicode? > > help me Please! > Thanks > majed > I did some code with diferent encoding and here is the result: > UTF7 48656C6C6F2B4143454149512D0D0A > Hello+ACEAIQ-.. > DEFAULT 48656C6C6F21210D0A > Hello!!.. > ASCII 48656C6C6F21210D0A > Hello!!.. > BIGENDIANUNICODE FEFF00480065006C006C006F00210021000D000A > ...H.e.l.l.o.!.!.... > UNICODE FFFE480065006C006C006F00210021000D000A00 > ..H.e.l.l.o.!.!..... > UTF8 EFBBBF48656C6C6F21210D0A > ...Hello!!.. > > and here is the code > > Imports System > > Imports System.Text > > Imports System.IO > > Class filestream > > Public Shared Sub main() > > Dim ASCIIStream As New StreamWriter("ASCIIStream.txt", False, > System.Text.Encoding.ASCII) > > Dim BigEndianUnicodeStream As New StreamWriter("BigEndianUnicodeStream.txt", > False, System.Text.Encoding.BigEndianUnicode) > > Dim UnicodeStream As New StreamWriter("UnicodeStream.txt", False, > System.Text.Encoding.Unicode) > > Dim DefaultStream As New StreamWriter("DefaultStream.txt", False, > System.Text.Encoding.Default) > > Dim UTF7Stream As New StreamWriter("UTF7Stream.txt", False, > System.Text.Encoding.UTF7) > > Dim UTF8Stream As New StreamWriter("UTF8Stream.txt", False, > System.Text.Encoding.UTF8) > > ASCIIStream.WriteLine("Hello!!") > > ASCIIStream.Close() > > ASCIIStream = Nothing > > BigEndianUnicodeStream.WriteLine("Hello!!") > > BigEndianUnicodeStream.Close() > > BigEndianUnicodeStream = Nothing > > UnicodeStream.WriteLine("Hello!!") > > UnicodeStream.Close() > > UnicodeStream = Nothing > > DefaultStream.WriteLine("Hello!!") > > DefaultStream.Close() > > DefaultStream = Nothing > > UTF7Stream.WriteLine("Hello!!") > > UTF7Stream.Close() > > UTF7Stream = Nothing > > UTF8Stream.WriteLine("Hello!!") > > UTF8Stream.Close() > > UTF8Stream = Nothing > > Console.WriteLine ("Done!) > > > > End Sub > > End Class > >
Majed,
[quoted text, click to view] > any idea how can I remove it from the I take it you did not read my response! As I indicated in my response how> file. you remove it from the file! Hope this helps Jay [quoted text, click to view] "Majed" <amjedksa@hotmail.com> wrote in message news:e1rI2TtPEHA.1340@TK2MSFTNGP12.phx.gbl... > hi jay > the other app is Ntbackup which saves its backup files list in unicode > without FFFE at the start of the file. any idea how can I remove it from the > file. > TIA > "Jay B. Harlow [MVP - Outlook]" <Jay_Harlow_MVP@msn.com> wrote in message > news:eaJbQFtPEHA.648@TK2MSFTNGP10.phx.gbl... > > Majed, > > Sounds like a bug in your other app! > > > > FFFE is the byte order mark of Unicode, it signifies to Unicode that the > > bytes are little endian. While FEFF signifies to Unicode that the bytes > are > > big endian! > > > > Notice that in your samples, FEFF is Big Endian > > > BIGENDIANUNICODE FEFF00480065006C006C006F00210021000D000A > > > ...H.e.l.l.o.!.!.... > > > > , while FFFE is little endian: > >
Don't see what you're looking for? Try a search.
|
June 2003
July 2003
August 2003
September 2003
October 2003
November 2003
December 2003
January 2004
February 2004
March 2004
April 2004
May 2004
June 2004
July 2004
August 2004
September 2004
October 2004
November 2004
December 2004
January 2005
February 2005
March 2005
April 2005
May 2005
June 2005
July 2005
August 2005
September 2005
October 2005
November 2005
December 2005
January 2006
February 2006
March 2006
April 2006
May 2006
June 2006
July 2006
August 2006
September 2006
October 2006
November 2006
December 2006
January 2007
February 2007
March 2007
April 2007
May 2007
June 2007
July 2007
August 2007
September 2007
October 2007
November 2007
December 2007
January 2008
February 2008
March 2008
April 2008
May 2008
June 2008
| home · blog · groups | Questions? Comments? Contact the dn |