StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POError in using Python/mechanize select_form()?
primarykey
Id
2067915
data
AcceptedAnswerId
2078827
AnswerCount
3
ClosedDate
CommentCount
0
CommunityOwnedDate
CreationDate
2010-01-14T22:05:27.990
FavoriteCount
1
LastActivityDate
2010-12-05T18:45:18.957
LastEditDate
LastEditorUserId
0
OwnerUserId
221342
ParentId
0
PostTypeId
1
Score
2
ViewCount
3224
LastEditorDisplayName
text
Body
I am trying to scrap some data from a website. The scripts I am trying to write, should get the content of the page: <pre><code>http://www.atpworldtour.com/Rankings/Singles.aspx </code></pre> Should simulate the user going trough every option for Additional Standings and the dates and simulate clicking on Go then after fetching the data should use the back function. For now I have been trying to just select this option for Additional Standing: <pre><code> <option value="101" >101-200</option> </code></pre> Here is my (poor) attempt to try to do this: <pre><code>from mechanize import Browser from BeautifulSoup import BeautifulSoup import re import urllib2 br = Browser(); br.open("http://www.atpworldtour.com/Rankings/Singles.aspx"); br.select_form(nr=0); br["r"] = "101"; response = br.submit(); </code></pre> However it just fails on the select_form(nr=0) which should be selecting the first form. This is the log returned by Python: <pre><code>>>> from mechanize import Browser >>> >>> from BeautifulSoup import BeautifulSoup >>> import re >>> import urllib2 >>> >>> >>> >>> br = Browser(); >>> br.open("http://www.atpworldtour.com/Rankings/Singles.aspx"); <response_seek_wrapper at 0x311bb48L whose wrapped object = <closeable_response at 0x311be88L whose fp = <socket._fileobject object at 0x0000000002C94408>>> >>> br.select_form(nr=0); Traceback (most recent call last): File "<stdin>", line 1, in <module> File "build\bdist.win-amd64\egg\mechanize\_mechanize.py", line 505, in select_ form File "build\bdist.win-amd64\egg\mechanize\_html.py", line 546, in __getattr__ File "build\bdist.win-amd64\egg\mechanize\_html.py", line 559, in forms File "build\bdist.win-amd64\egg\mechanize\_html.py", line 228, in forms mechanize._html.ParseError </code></pre> I could not find a proper explanation of all the functions in the mechanize home page. Can anyone either point me to a proper tutorial for using forms and Mechanize or help me on this particular issue ? Anthony
Tags
<python><mechanize><web-scraping>
Title
Error in using Python/mechanize select_form()?
singulars
PostAcceptedAnswerId
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
PostParentId
1. This table or related slice is empty.
PostTypePostTypeId
1. PTQuestion
UserLastEditorUserId
1. This table or related slice is empty.
UserOwnerUserId
1. USBlueTrin
plurals
PostLinksPostIdRelatedPostId
1. This table or related slice is empty.
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
2. PO
 singulars
 PostTypePostTypeId
 PTAnswer
3. PO
 singulars
 PostTypePostTypeId
 PTAnswer
VotesPostIdCreationDate
1. VO
 singulars
 PostPostId
 POError in using Python/mechanize select_form()?
 UserUserId
 USBlueTrin
 VoteTypeVoteTypeId
 VTFavorite
2. VO
 singulars
 PostPostId
 POError in using Python/mechanize select_form()?
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
3. VO
 singulars
 PostPostId
 POError in using Python/mechanize select_form()?
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
CommentsPostId
1. This table or related slice is empty.

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.