StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
primarykey
Id
19076027
data
AcceptedAnswerId
0
AnswerCount
0
ClosedDate
CommentCount
0
CommunityOwnedDate
CreationDate
2013-09-29T08:37:46.663
FavoriteCount
0
LastActivityDate
2013-09-29T08:37:46.663
LastEditDate
LastEditorUserId
0
OwnerUserId
2623736
ParentId
19071546
PostTypeId
2
Score
2
ViewCount
0
LastEditorDisplayName
text
Body
Alright, thanks for the input, I did "my homework" based on it and got the results, working with 50MB sample of actual CSV data: First, iterating over the file using PHP: <pre><code>$in = fopen("a.txt", "r"); $out = fopen("p.txt", "w+"); $start = microtime(true); while(($line = fgets($in)) !== false) { $converted = iconv("UTF-8", "EUC-JP//TRANSLIT", $line); fwrite($out, $converted); } $elapsed = microtime(true) - $start; echo " Iconv took $elapsed seconds\r\n"; </code></pre> <blockquote> Iconv took 2.2817220687866 seconds </blockquote> That's not so bad I guess, so I tried the exact same approach in #bash, so it wouldn't have to load all the file but iterate over each line instead (which might not exactly happen as I understand what Lajos Veres answered). Indeed, this method wasn't exactly efficient (CPU was under a heavy load all the time). Also, the output file is smaller than the other 2, although after a quick look it looks the same, so I must have made a mistake in the bash script, however, that shouldn't have such effect on performance anyway: <pre><code>#!/bin/bash echo "" > b.txt time echo $( while read line do echo $line |iconv -f utf-8 -t EUC-JP//TRANSLIT >> b.txt done < a.txt ) </code></pre> <blockquote> real 9m40.535s user 2m2.191s sys 3m18.993s </blockquote> And then the classic approach which I would have expected to hog the memory, however, checking the CPU/Memory usage, it didn't seem to take any more memory than any other approach, therefore being a winner: <pre><code>#!/bin/bash time echo $( iconv -f utf-8 -t EUC-JP//TRANSLIT a.txt -o b2.txt ) </code></pre> <blockquote> real 0m0.256s user 0m0.195s sys 0m0.060s </blockquote> I'll try to get a bigger file sample to test the 2 more efficient methods to make sure the memory usage doesn't get significant, however, the result seems obvious enough to assume the single pass through the whole file in bash is the most efficient (I didn't try that in PHP, as I believe loading an entire file to an array/string in PHP isn't ever a good idea).
Tags
Title
singulars
PostAcceptedAnswerId
1. This table or related slice is empty.
PostParentId
1. POPHP using iconv to convert large files
 singulars
 PostTypePostTypeId
 PTQuestion
PostTypePostTypeId
1. PTAnswer
UserLastEditorUserId
1. This table or related slice is empty.
UserOwnerUserId
1. USkachnitel
plurals
PostLinksPostIdRelatedPostId
1. This table or related slice is empty.
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. POPHP using iconv to convert large files
 singulars
 PostTypePostTypeId
 PTQuestion
PostsParentIdCreationDate
1. This table or related slice is empty.
VotesPostIdCreationDate
1. VO
 singulars
 PostPostId
 PO
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTAcceptedByOriginator
CommentsPostId
1. This table or related slice is empty.

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.