Databases
StackOverflow2013
Postsdbo
PO
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>In the "Details" part of <code>?scan</code> (used by <code>read.table</code>, <code>read.csv</code> and so on):</p> <pre><code> If ‘sep’ is non-default, the fields may be quoted in the style of ‘.csv’ files where separators inside quotes (‘''’ or ‘""’) are ignored and quotes may be put inside strings by doubling them. However, if ‘sep = "\n"’ it is assumed by default that one wants to read entire lines verbatim. </code></pre> <p>So it looks like your problem is the "escaped" quote <code>\"</code> in that line causing the trouble - R expects an escaped quote for a CSV to be a double quote <code>""</code>, not a backslashed quote <code>\"</code>.</p> <p>I think your best bet here is to replace escaped quotes with double quotes, be it using Linux or in R (R example below):</p> <pre><code>txt &lt;- readLines("tmp.txt") txt &lt;- gsub('\\\\"', '""', txt) # note the weird double backslashing because # `readLines` adds extra backslashes # if you `cat(txt, sep='\n')` you will see that the `\"` is now `""` </code></pre> <p>Then you can use <code>read.csv</code> or <code>scan</code> like before (note the <code>textConnection(txt)</code> which converts the string into a file-like object for <code>scan</code> to use):</p> <pre><code>read.csv(textConnection(txt), ...) </code></pre> <hr> <h2>Edit/Addition</h2> <p>Re OP's comment - the file is 1.4GB and there are difficulties reading it all into R at once, so how to do the sanitizing?</p> <h3>Option 1</h3> <p>You appear to be on Linux, so you could use <code>sed</code>:</p> <pre><code>sed -ire 's!\\"!""!g' myfile.txt </code></pre> <p>(Depending on where your data comes from, perhaps you could adjust the program that is outputting the data to output it in the format you require in the first place, but this is not always possible).</p> <h3>Option 2</h3> <p>If you are averse to using Linux or want an in-house R solution, use the <code>n</code> parameter to <code>readLines</code> to only read in a few lines at a time:</p> <pre><code># create the file object and open it, see ?file f &lt;- file('tmp.txt') open(f) txt &lt;- '' # now read in 100 lines at a time, say while (length(txt)) { txt &lt;- readLines(f, n=100) # now do the sanitizing/coercing into a data frame, store. # ... } close(f) </code></pre>
    singulars
    1. This table or related slice is empty.
    1. POError in scan() with backslash in line
      singulars
      1. PTQuestion
    1. PTAnswer
    1. USmathematical.coffee
    1. USmathematical.coffee
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. POError in scan() with backslash in line
      singulars
      1. PTQuestion
    1. This table or related slice is empty.
    1. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTAcceptedByOriginator
    1. COThanks. i forgot to mention but the file is 1.4GB, any idea how can I clean it up since I can't load the whole file into R?
      singulars
      1. PO
      1. USJorge Guzman
    2. COYou can use `readLines`' `n` parameter to only read in a few lines at a time. I've updated the answer to show how you might do this.
      singulars
      1. PO
      1. USmathematical.coffee
    3. COPerfect. Thank you. I ended up doing the following. First, split with linux, then sed, then join again. Thanks forthe ideas.
      singulars
      1. PO
      1. USJorge Guzman
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload