StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
primarykey
Id
10091501
data
AcceptedAnswerId
0
AnswerCount
0
ClosedDate
CommentCount
0
CommunityOwnedDate
CreationDate
2012-04-10T15:18:00.707
FavoriteCount
0
LastActivityDate
2013-10-02T16:12:46.690
LastEditDate
2013-10-02T16:12:46.690
LastEditorUserId
-1
OwnerUserId
1235487
ParentId
10090657
PostTypeId
2
Score
0
ViewCount
0
LastEditorDisplayName
text
Body
First of all, I agree that you need to put a flag in your directories indicating that a directory is being processed. The master script should be the only one to set the flag, or you will risk race conditions (two worker scripts taking the same directory at the same time). You can use the same file; the master script creates it empty (meaning "in progress") and the worker script writes 1B in it (meaning "done"). That way, the master script only has to check the existence of the flag. Back to your question: <ul> <li>you can indeed make your worker script into a standalone program, and call it via the <code>subprocess</code> module;</li> <li>you can make it a thread (with the <code>threading</code> module [2]), which is somewhat easier to code; this may be inefficient because of the <a href="http://docs.python.org/library/threading.html" rel="nofollow">GIL</a>, but if your worker script is highly IO-bound, it should not be too much of a problem;</li> <li>if you are using Python 3, you may want to look at the <code>multiprocessing</code> module [3] which I never used but seems to mix the usability of threading without being vulnerable to the GIL; it seems that it is not completely portable though.</li> </ul> Hope this helps <ul> <li>[1] <code>http://docs.python.org/library/subprocess.html</code></li> <li>[2] <code>http://docs.python.org/library/threading.html</code></li> <li>[3] <code>http://docs.python.org/dev/library/multiprocessing.html</code></li> </ul>
Tags
Title
singulars
PostAcceptedAnswerId
1. This table or related slice is empty.
PostParentId
1. POCalling python worker script from master script as multiple instances
 singulars
 PostTypePostTypeId
 PTQuestion
PostTypePostTypeId
1. PTAnswer
UserLastEditorUserId
1. USCommunity
UserOwnerUserId
1. USPierre-Antoine
plurals
PostLinksPostIdRelatedPostId
1. This table or related slice is empty.
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. POCalling python worker script from master script as multiple instances
 singulars
 PostTypePostTypeId
 PTQuestion
PostsParentIdCreationDate
1. This table or related slice is empty.
VotesPostIdCreationDate
1. This table or related slice is empty.
CommentsPostId
1. This table or related slice is empty.

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.