StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
text
Body
copied!<p>Correctly detecting the encoding all times is <strong>impossible</strong>.</p> <p>(From chardet FAQ:)</p> <blockquote> <p>However, some encodings are optimized for specific languages, and languages are not random. Some character sequences pop up all the time, while other sequences make no sense. A person fluent in English who opens a newspaper and finds “txzqJv 2!dasd0a QqdKjvz” will instantly recognize that that isn't English (even though it is composed entirely of English letters). By studying lots of “typical” text, a computer algorithm can simulate this kind of fluency and make an educated guess about a text's language.</p> </blockquote> <p>There is the <a href="http://pypi.python.org/pypi/chardet" rel="noreferrer">chardet</a> library that uses that study to try to detect encoding. chardet is a port of the auto-detection code in Mozilla. </p> <p>You can also use <a href="https://www.crummy.com/software/BeautifulSoup/bs4/doc/#unicode-dammit" rel="noreferrer">UnicodeDammit</a>. It will try the following methods:</p> <ul> <li>An encoding discovered in the document itself: for instance, in an XML declaration or (for HTML documents) an http-equiv META tag. If Beautiful Soup finds this kind of encoding within the document, it parses the document again from the beginning and gives the new encoding a try. The only exception is if you explicitly specified an encoding, and that encoding actually worked: then it will ignore any encoding it finds in the document.</li> <li>An encoding sniffed by looking at the first few bytes of the file. If an encoding is detected at this stage, it will be one of the UTF-* encodings, EBCDIC, or ASCII.</li> <li>An encoding sniffed by the <a href="http://pypi.python.org/pypi/chardet" rel="noreferrer">chardet</a> library, if you have it installed.</li> <li>UTF-8</li> <li>Windows-1252 </li> </ul>

Querying!

Guidance

An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload