StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POHow to scrape multiple log files for an exception
primarykey
Id
14695347
data
AcceptedAnswerId
14697339
AnswerCount
1
ClosedDate
CommentCount
0
CommunityOwnedDate
CreationDate
2013-02-04T20:46:56.560
FavoriteCount
0
LastActivityDate
2013-02-05T21:10:43.603
LastEditDate
LastEditorUserId
0
OwnerUserId
731789
ParentId
0
PostTypeId
1
Score
1
ViewCount
599
LastEditorDisplayName
text
Body
I'm writing a node.js function to ssh to a remote machine, and attempt to scrape logs for exceptions from a variety of different log files. The important bit of the log file will look something like this: <pre><code>.... gunk .... 2013-01-29 04:06:39,133 com.blahblah.BaseServlet processRequest Thread-1629 Site-102 Cons-0 Url-http://theurlthat.com/caused/the/problem App-26 yada yada yada java.lang.NullPointerException at com.blahblah.MyClass.hi(MyClass.java:173) at com.blahblah.StandardStackTrace.main(StandardStackTrace.java:125) at com.blahblah.SoOnAndSo.forth(SoOnAndSo.java:109) at java.lang.Thread.run(Thread.java:595) 2013-01-29 04:06:39,133 com.blahblah.BaseServlet defaultThrowableHandler Thread-1629 Site-102 Cons-0 Url-http://theurlthat.com/caused/the/problem App-26 yad yada yada TechnicalDifficultiesException: TD page delivered by handleThrowable http://theurlthat.com/caused/the/problem ....more gunk.... </code></pre> I need to find the exception and corresponding date in the log file that meets the following three requirements: <ol> <li>The exception must be the first that precedes this static text: TechnicalDifficultiesException: TD page delivered by handleThrowable</li> <li>The Exception must be directly between two lines that have "BaseServlet.*Site-102"</li> <li>The exception must be the most recent (last) in the log files that meets the above conditions. The log is rolled over periodically, so it need to be the last in Log, or if that doesn't exist the last in Log.001, or if that doesn't exist the last in Log.002, etc.</li> </ol> Since this program has to ssh into one of many potential servers, it's better to only have to maintain the logic in the node.js program and not on the machines with the logs. Thus, a one-liner in perl/sed/awk/grep/etc would be most ideal.
Tags
<perl><logging><sed><awk><grep>
Title
How to scrape multiple log files for an exception
singulars
PostAcceptedAnswerId
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
PostParentId
1. This table or related slice is empty.
PostTypePostTypeId
1. PTQuestion
UserLastEditorUserId
1. This table or related slice is empty.
UserOwnerUserId
1. USscim
plurals
PostLinksPostIdRelatedPostId
1. This table or related slice is empty.
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
VotesPostIdCreationDate
1. VO
 singulars
 PostPostId
 POHow to scrape multiple log files for an exception
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
CommentsPostId
1. This table or related slice is empty.

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.