StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POPython Web Scraping; Beautiful Soup
primarykey
Id
7884567
data
AcceptedAnswerId
7996339
AnswerCount
2
ClosedDate
CommentCount
0
CommunityOwnedDate
CreationDate
2011-10-25T04:03:57.630
FavoriteCount
0
LastActivityDate
2011-11-03T14:12:55.790
LastEditDate
2017-05-23T11:47:58.870
LastEditorUserId
-1
OwnerUserId
855046
ParentId
0
PostTypeId
1
Score
1
ViewCount
5501
LastEditorDisplayName
text
Body
This was covered in this post: <a href="https://stackoverflow.com/questions/1391657/python-web-scraping-involving-html-tags-with-attributes">Python web scraping involving HTML tags with attributes</a> But I haven't been able to do something similar for this web page: <a href="http://www.expatistan.com/cost-of-living/comparison/melbourne/auckland" rel="nofollow noreferrer">http://www.expatistan.com/cost-of-living/comparison/melbourne/auckland</a>? I'm trying to scrape the values of: <pre><code> <td class="price city-2"> NZ$15.62 (AU$12.10) </td> <td class="price city-1"> AU$15.82 </td> </code></pre> Basically price city-2 and price city-1 (NZ$15.62 and AU$15.82) Currently have: <pre><code>import urllib2 from BeautifulSoup import BeautifulSoup url = "http://www.expatistan.com/cost-of-living/comparison/melbourne/auckland?" page = urllib2.urlopen(url) soup = BeautifulSoup(page) price2 = soup.findAll('td', attrs = {'class':'price city-2'}) price1 = soup.findAll('td', attrs = {'class':'price city-1'}) for price in price2: print price for price in price1: print price </code></pre> Ideally, I'd also like to have comma separated values for: <pre><code><th colspan="3" class="clickable">Food</th>, </code></pre> Extracting 'Food', <pre><code><td class="item-name">Daily menu in the business district</td> </code></pre> Extracting 'Daily menu in the business district' and then the values for price city-2, and price-city1 So the printout would be: Food, Daily menu in the business district, NZ$15.62, AU$15.82 Thanks!
Tags
<python><screen-scraping><beautifulsoup>
Title
Python Web Scraping; Beautiful Soup
singulars
PostAcceptedAnswerId
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
PostParentId
1. This table or related slice is empty.
PostTypePostTypeId
1. PTQuestion
UserLastEditorUserId
1. USCommunity
UserOwnerUserId
1. USA.Krueger
plurals
PostLinksPostIdRelatedPostId
1. PL
 singulars
 LinkTypeLinkTypeId
 LTLinked
PostLinksRelatedPostIdPostId
1. PL
 singulars
 LinkTypeLinkTypeId
 LTLinked
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
2. PO
 singulars
 PostTypePostTypeId
 PTAnswer
VotesPostIdCreationDate
1. VO
 singulars
 PostPostId
 POPython Web Scraping; Beautiful Soup
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
CommentsPostId
1. This table or related slice is empty.

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.