Databases
StackOverflow2013
Postsdbo
POJava 1.6 Windows-1252 encoding fails on 3 characters
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POJava 1.6 Windows-1252 encoding fails on 3 characters
    primarykey
    data
    text
    <p><strong>EDIT: I've been convinced that this question is somewhat non-sensical. Thanks to those who responded. I may post a follow-up question that is more specific.</strong> </p> <p>Today I was investing some encoding problems and wrote this unit test to isolate a base repro case:</p> <pre><code>int badCount = 0; for (int i = 1; i &lt; 255; i++) { String str = "Hi " + new String(new char[] { (char) i }); String toLatin1 = new String(str.getBytes("UTF-8"), "latin1"); assertEquals(str, new String(toLatin1.getBytes("latin1"), "UTF-8")); String toWin1252 = new String(str.getBytes("UTF-8"), "Windows-1252"); String fromWin1252 = new String(toWin1252.getBytes("Windows-1252"), "UTF-8"); if (!str.equals(fromWin1252)) { System.out.println("Can't encode: " + i + " - " + str + " - encodes as: " + fromWin1252); badCount++; } } System.out.println("Bad count: " + badCount); </code></pre> <p>The output:</p> <pre> Can't encode: 129 - Hi ? - encodes as: Hi ?? Can't encode: 141 - Hi ? - encodes as: Hi ?? Can't encode: 143 - Hi ? - encodes as: Hi ?? Can't encode: 144 - Hi ? - encodes as: Hi ?? Can't encode: 157 - Hi ? - encodes as: Hi ?? Can't encode: 193 - Hi Á - encodes as: Hi ?? Can't encode: 205 - Hi Í - encodes as: Hi ?? Can't encode: 207 - Hi Ï - encodes as: Hi ?? Can't encode: 208 - Hi ? - encodes as: Hi ?? Can't encode: 221 - Hi ? - encodes as: Hi ?? Bad count: 10 </pre> <p>JDK 1.6.0_07 on Mac OS 10.6.2</p> <p>My observation: </p> <p>Latin1 symmetrically encodes all 254 characters. Windows-1252 does not. The three printable characters (193, 205, 207) are the same codes in Latin1 and Windows-1252, so I wouldn't expect any issues.</p> <p>Can anyone explain this behavior? Is this a JDK bug?</p> <p>-- James</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USJames Cooper
    1. USJames Cooper
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POJava 1.6 Windows-1252 encoding fails on 3 characters
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POJava 1.6 Windows-1252 encoding fails on 3 characters
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POJava 1.6 Windows-1252 encoding fails on 3 characters
      1. This table or related slice is empty.
      1. VTUpMod
    1. COThe code you post doesn't make any sense (getting UTF-8 encoded data from a String and interpreting it *as if it were latin1*). Therefore it's pretty hard to follow what you try to do.
      singulars
      1. POJava 1.6 Windows-1252 encoding fails on 3 characters
      1. USJoachim Sauer
    2. COI have some data encoded as UTF-8 that I need to transcode to Windows-1252. In my production system I noticed this failed on character 193, so I wrote this base repro case and to my surprise discovered that these 10 characters do not symmetrically encode between Windows-1252 and UTF-8. Notice that all 254 characters can be encoded between UTF-8 and Latin1. Hence my surprise and confusion. Does that help?
      singulars
      1. POJava 1.6 Windows-1252 encoding fails on 3 characters
      1. USJames Cooper
    3. COWhat **exactly** do you mean by "transcode"? Do you want the Windows-1252 encoded bytes that represent the same glyphs? If so, then you must be aware that this is simply not possible in all cases, because UTF-8 can represent all Unicode characters, while Windows-1252 obviously can't.
      singulars
      1. POJava 1.6 Windows-1252 encoding fails on 3 characters
      1. USJoachim Sauer
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload