StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
text
Body
copied!<p>There's a couple of edge cases to be aware of: </p> <ul> <li>what if doubled double-quotes are at the beginning of a string? </li> <li>What if that string is the first field?</li> <li>a field containing an empty string</li> </ul> <pre><code>sed -r ' # at the start of a line or the start of a field, # replace """ with "\" s/(^|;)"""/\1"\\"/g # replace any doubled double-quote with an escaped double-quote. # this affects any "inner" quote pair as well as end of field or end of line # if there is an escaped quote from the previous command, don't be fooled by # a proceeding quote. s/([^\\])""/\1\\"/g # the above step will destroy empty strings. fix them here. this uses a # conditional loop: if there are 2 consecutive empty fields, they will # share a delimited, so we have to process the line more than once :fix_empty_fields s/(^|;)\\"($|;)/\1""\2/g tfix_empty_fields ' <<'END' """start of line";"""beginning "" middle and end """;"end of line""" "";"";"";"""";"""""";"";"" END </code></pre> <pre><code>"\"start of line";"\"beginning \" middle and end \"";"end of line\"" "";"";"";"\"";"\"\"";"";"" </code></pre> <p>Sed is an efficient tool, but it will take a while with 16GB files. And you better have at least 16GB free disk space to write the updated files (even sed's <code>-i</code> inplace-edit uses temp files behind the scenes)</p> <p>refs: <a href="http://www.gnu.org/software/sed/manual/html_node/" rel="nofollow">GNU sed manual</a>, <a href="http://www.gnu.org/software/sed/manual/html_node/Programming-Commands.html#Programming-Commands" rel="nofollow">sed looping commands</a></p>

Querying!

Guidance

An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload