StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
primarykey
Id
16800105
data
AcceptedAnswerId
0
AnswerCount
0
ClosedDate
CommentCount
0
CommunityOwnedDate
CreationDate
2013-05-28T19:40:15.003
FavoriteCount
0
LastActivityDate
2013-05-28T19:46:01.587
LastEditDate
2013-05-28T19:46:01.587
LastEditorUserId
771848
OwnerUserId
771848
ParentId
16796747
PostTypeId
2
Score
0
ViewCount
0
LastEditorDisplayName
text
Body
Here's your spider: <pre><code>from scrapy.item import Item, Field from scrapy.spider import BaseSpider from scrapy.selector import HtmlXPathSelector class UnivercellItem(Item): vendor = Field() model = Field() price = Field() BASE_URL = "http://www.univercell.in/control/AjaxCategoryDetail?productCategoryId=PRO-SMART&category_id=PRO-SMART&attrName=&min=&max=&sortSearchPrice=&VIEW_INDEX=%s&VIEW_SIZE=15&serachupload=&sortupload=" class UnivercellSpider(BaseSpider): name = "univercell_spider" allowed_domains = ["www.univercell.in"] start_urls = [BASE_URL % index for index in range(1, 21)] def parse(self, response): hxs = HtmlXPathSelector(response) mobiles = hxs.select("//div[@class='productsummary']") print mobiles for mobile in mobiles: item = UnivercellItem() item['vendor'] = mobile.select('.//div[1]/div/text()').extract()[0].strip() item['model'] = mobile.select('.//div[3]/div[1]/a/text()').extract()[0].strip() item['price'] = mobile.select('.//span[@class="regularPrice"]/span/text()').extract()[0].strip() yield item </code></pre> Save it to <code>spider.py</code> and run via <code>scrapy runspider spider.py -o output.json</code>. Then in <code>output.json</code> you will see: <pre><code>{"model": "T375", "vendor": "LG", "price": "Special Price Click Here"} {"model": "P725 Optimus 3D Max", "vendor": "LG", "price": "Special Price Click Here"} {"model": "P705 Optimus L7", "vendor": "LG", "price": "Special Price Click Here"} {"model": "9320 Curve", "vendor": "Blackberry", "price": "Special Price Click Here"} {"model": "Xperia Sola", "vendor": "Sony", "price": "Rs.14,500.00"} {"model": "Xperia U", "vendor": "Sony", "price": "Special Price Click Here"} {"model": "Lumia 610", "vendor": "Nokia", "price": "Special Price Click Here"} ... </code></pre> Hope that helps.
Tags
Title
singulars
PostAcceptedAnswerId
1. This table or related slice is empty.
PostParentId
1. POhow to retrieve data ... The page is loaded using ajax
 singulars
 PostTypePostTypeId
 PTQuestion
PostTypePostTypeId
1. PTAnswer
UserLastEditorUserId
1. USalecxe
UserOwnerUserId
1. USalecxe
plurals
PostLinksPostIdRelatedPostId
1. This table or related slice is empty.
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. This table or related slice is empty.
VotesPostIdCreationDate
1. This table or related slice is empty.
CommentsPostId
1. This table or related slice is empty.

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.