Note that there are some explanatory texts on larger screens.

plurals
  1. PORails 0mPG::Error: ERROR: invalid byte sequence for encoding "UTF8": 0xeda0bc
    primarykey
    data
    text
    <p>I'm running into an error while trying to write to tweets to my psql database.</p> <p>I've searched the internet high and low (perhaps not well enough) for the answer, with no avail. I've looked at the answers here - but the suggestion was to convert the string to UTF8 (even though the response headers claim it's UTF-8 already).</p> <p>I did so with this code:</p> <pre><code># get the data from twitter response = RestClient.get "http://search.twitter.com/search.json?rpp=100&amp;since_id=238726971826253824&amp;q=love" # find the data encoding using CharDet data = CharDet.detect(response.body) encoding = data['encoding'] # create a new instance of Iconv with UTF-8 and then convert response.body ic = Iconv.new('UTF-8//IGNORE', encoding) converted_response = ic.iconv(response.body + ' ')[0..-2] # take the data and convert it to JSON response_json = ActiveSupport::JSON.decode(converted_response) </code></pre> <p><br> We then parse response_json and create tweets inside out database. However, when doing so, we get this error below. <br><br></p> <pre><code> [4;36;1mSQL (0.1ms)[0m [0;1mBEGIN[0m [4;35;1mSQL (0.0ms)[0m [0mPG::Error: ERROR: invalid byte sequence for encoding "UTF8": 0xeda0bc : INSERT INTO "tweets" ("from_user_id", "approved", "from_user", "has_profanity", "twitter_search_id", "twitter_id", "posted_at", "updated_at", "iso_language_code", "profile_image_url", "text", "created_at", "archived", "geo", "to_user_id", "to_user", "metadata", "source", "event_id") VALUES(573857675, NULL, 'nataliekiro', NULL, 618, 238825898718162944, '2012-08-24 02:31:46.000000', '2012-08-24 02:32:05.166492', 'en', 'http://a0.twimg.com/profile_images/2341785780/image_normal.jpg', 'Happy Birthday @daughternumber1 🎂 Love You 😘', '2012-08-24 02:32:05.166492', 'f', NULL, 0, NULL, '--- !map:HashWithIndifferentAccess result_type: recent </code></pre> <p>I've gone ahead and tested the class of the response_json (returns Hash), even though at the end of that error it says HashWithIndifferentAccess.</p> <p>Anyone else have similar issues &amp; know of a solution?</p> <p>Thanks!</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload