StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POHow do I encode files to UTF-8 for Rails 3?
primarykey
Id
13129852
data
AcceptedAnswerId
13129949
AnswerCount
1
ClosedDate
CommentCount
0
CommunityOwnedDate
CreationDate
2012-10-29T21:19:34.970
FavoriteCount
0
LastActivityDate
2015-06-19T21:45:40.163
LastEditDate
2015-06-19T21:45:40.163
LastEditorUserId
3373470
OwnerUserId
1462575
ParentId
0
PostTypeId
1
Score
0
ViewCount
380
LastEditorDisplayName
text
Body
I've been working on outlook imports (linked in exports to outlook format) but I'm having troubles with encoding. The outlook format CSV I get from exporting my LinkedIn contacts are not in UTF-8. Letters like <code>ñ</code> cause an exception in the <code>mongoid_search</code> gem when calling <code>str.to_s.mb_chars.normalize</code>. I think encoding is the issue, because when I call <code>mb_chars</code> (<a href="http://apidock.com/rails/String/mb_chars" rel="nofollow">see first code example</a>). I am not sure if this is a bug in the gem, but I was advised to sanitize the data nonetheless. From File Picker, I tried using their new, community-supported gem to upload CSV data. I tried three encoding detectors and transcoders: <ol> <li>Ruby port of a Python lib <code>chardet</code> <ul> <li>Didn't work as expected</li> <li>The port still contained Python code, preventing it from running in my app</li> </ul></li> <li><code>rchardet19</code> gem <ul> <li>Detected <code>iso-8859</code> with <code>.8/1</code> confidence. </li> <li>Tried to transcode with Iconv, but crashed on "illegal characters" at <code>ñ</code></li> </ul></li> <li><a href="https://github.com/brianmario/charlock_holmes" rel="nofollow"><code>Charlock_Holmes</code></a> gem <ul> <li>Detected <code>windows-1252</code> with <code>33/100</code> confidence</li> <li>I assume that's the actual encoding, and <code>rchardet</code> got <code>iso-8859</code> because this ones based of that. </li> <li>This gem uses ICU and has a maintained branch "bundle-icu" which supports Heroku. When I try to transcode using <code>charlock</code>, I get the error <code>U_FILE_ACCESS_ERROR</code>, an ICU error code meaning "could not open file"</li> </ul></li> </ol> Anybody know what to do here?
Tags
<ruby-on-rails><ruby><ruby-on-rails-3><encoding><chardet>
Title
How do I encode files to UTF-8 for Rails 3?
singulars
PostAcceptedAnswerId
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
PostParentId
1. This table or related slice is empty.
PostTypePostTypeId
1. PTQuestion
UserLastEditorUserId
1. This table or related slice is empty.
UserOwnerUserId
1. USRiley Guerin
plurals
PostLinksPostIdRelatedPostId
1. PL
 singulars
 LinkTypeLinkTypeId
 LTLinked
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
VotesPostIdCreationDate
1. This table or related slice is empty.
CommentsPostId
1. This table or related slice is empty.

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.