Databases
StackOverflow2013
Postsdbo
POHashbang URLs make the website difficult to crawl by Google?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POHashbang URLs make the website difficult to crawl by Google?
    primarykey
    data
    text
    <p>Our agency built a dynamic website that uses a lot of AJAX interactions and #! (hashbang) URLs: <a href="http://www.gunlawsbystate.com/" rel="nofollow">http://www.gunlawsbystate.com/</a></p> <p>It's a long book which you can scroll through and the URL in the address bar changes dynamically. We have to support IE so please don't advise using pushState — hansbang is the only option for us for now.</p> <p>There's a navigation in the left sidebar which contains links to all chapters in the book.</p> <p>An example of a link: <a href="http://www.gunlawsbystate.com/#!/federal-properety/national-parks-and-wildlife-refuges/" rel="nofollow">http://www.gunlawsbystate.com/#!/federal-properety/national-parks-and-wildlife-refuges/</a></p> <p>We are expecting google to crawl this: http:// www.gunlawsbystate.com/?_escaped_fragment_=/federal-properety/national-parks-and-wildlife-refuges/ which is complete html snapshot of the section. (+ there are links to the subsections like www.gunlawsbystate.com/#!/federal-properety/national-parks-and-wildlife-refuges/ii-change-in-the-law/ => www.gunlawsbystate.com/?_escaped_fragment_=/federal-properety/national-parks-and-wildlife-refuges/ii-change-in-the-law/ ).</p> <p>It all looks to be complete according to the Google's specifications ( developers.google.com/webmasters/ajax-crawling/docs/specification ). The site is run for about 3 months for now. The homepage is getting re-indexed every 10-15 days.</p> <p>The problem is that for some reason Google doesn't crawl hashbang URLs properly. It seems like Google just "doesn't like" those URLs.</p> <p>www.google.ru/search?&amp;q=site%3Agunlawsbystate.com : Just 67 pages are indexed. Notice that most of the pages Google indexed have "normal" URLs (mostly wordpress blog posts, categories and tags) and just 5-10% of result pages are hashbang URLs, although there are more than 400 book sections with unique content which Google should really like if it crawles it properly.</p> <p>Could someone give me an advise on this, why Google does not crawl our book pages properly? Any help will be appreciated.</p> <p><em>P.S. I'm sorry for not-clickable links — stackoverflow doesn't let me post more than 2.</em></p> <p><strong>UPD.</strong> The sitemap has been submitted to google a while ago. Google Webmaster Tools says that 518 URLs submitted and just 62 URLs indexed. Also, on the 'Index Status' page of the Webmaster Tools I see that there are 1196 pages <em>Ever crawled</em>; 1071 pages are <em>Not selected</em>. It clearly points to the fact that for some reason google doesn't index the #! pages that it visits frequently.</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PTQuestion
    1. USAzmorf
    1. USAzmorf
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. VO
      singulars
      1. POHashbang URLs make the website difficult to crawl by Google?
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POHashbang URLs make the website difficult to crawl by Google?
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POHashbang URLs make the website difficult to crawl by Google?
      1. USbpossolo
      1. VTFavorite
    1. CODid you find an answer yet? I have a similar problem which is described here: http://webmasters.stackexchange.com/questions/35355/google-crawling-the-site-but-refusing-to-index-dynamic-content
      singulars
      1. POHashbang URLs make the website difficult to crawl by Google?
      1. USMeisner
    2. CO@Omeoe I've done a few SEO enhancements, optimized pages' content, put it above the sidebar in the code, and also removed rel="canonical" links that Wordpress has put into the pages. Also, this is one more question about this AJAX site I've posted: http://webmasters.stackexchange.com/questions/34810/title-of-the-page-in-search-results-and-title-of-googles-cached-version-are-dif/34839#34839 . I'm sure your problem is pretty much different.
      singulars
      1. POHashbang URLs make the website difficult to crawl by Google?
      1. USAzmorf
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload