StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PORead a large file and output sections matching multiple parameters
primarykey
Id
8977829
data
AcceptedAnswerId
8978237
AnswerCount
4
ClosedDate
CommentCount
4
CommunityOwnedDate
CreationDate
2012-01-23T20:02:43.123
FavoriteCount
1
LastActivityDate
2012-01-24T06:21:07.160
LastEditDate
2012-01-23T22:12:37.513
LastEditorUserId
1165677
OwnerUserId
1165677
ParentId
0
PostTypeId
1
Score
6
ViewCount
1359
LastEditorDisplayName
text
Body
I rarely have to deal with scripting, so I'm up against a lack of knowledge for this problem. I have a file >500mb in text, which is nicely sectioned, but I know there are 5 to 10 "bad" sections inside. The data within the sections can be evaluated pretty easily by a human, I don't know how to do it in a program. I pick up a known good value in <code>#Field MyField</code> - however if that value did not appear in <code>#FIELD LOCATION</code>, something went wrong. An example of two sections within the file looks like this. The first is 'bad' and the second is 'good'. <pre class="lang-none prettyprint-override"><code>#START Descriptor #FIELD LOCATION="http://path.to/file/here&Value=FOO&OtherValue=BLAH" #FIELD AnythingElse #FIELD MyField="BAR" #END #START Descriptor #FIELD LOCATION="http://path.to/file/here&Value=BAR&OtherValue=BLAH" #FIELD AnythingElse #FIELD MyField="BAR" #END </code></pre> <ol> <li>Sections start and end logically, with <code>#START</code> and <code>#END</code></li> <li>If <code>#FIELD LOCATION</code> does not exist, go to next section</li> <li>If <code>#FIELD MyField="BAR"</code> and <code>#FIELD LOCATION</code> does not contain <code>BAR</code>, print all lines from this section to a new file.</li> <li>Note - Clarification of <code>#FIELD MyField="BAR"</code> - this is a check value I put in by grabbing other info about the data as this file is being built (in my case it is a language indicator, such as EN or DE. so it would literally be <code>#FIELD MyField="EN"</code> Any other value in this field would be ignored, this isn't a record that matches my criteria. </li> </ol> I believe this can be done in Awk or Perl, I can do very simple one-liners but this is beyond my skills.
Tags
<perl><awk>
Title
Read a large file and output sections matching multiple parameters
singulars
PostAcceptedAnswerId
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
PostParentId
1. This table or related slice is empty.
PostTypePostTypeId
1. PTQuestion
UserLastEditorUserId
1. USwinndm
UserOwnerUserId
1. USwinndm
plurals
PostLinksPostIdRelatedPostId
1. This table or related slice is empty.
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
2. PO
 singulars
 PostTypePostTypeId
 PTAnswer
3. PO
 singulars
 PostTypePostTypeId
 PTAnswer
VotesPostIdCreationDate
1. VO
 singulars
 PostPostId
 PORead a large file and output sections matching multiple parameters
 UserUserId
 USDan Fego
 VoteTypeVoteTypeId
 VTFavorite
2. VO
 singulars
 PostPostId
 PORead a large file and output sections matching multiple parameters
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
3. VO
 singulars
 PostPostId
 PORead a large file and output sections matching multiple parameters
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
CommentsPostId

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.