Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>For dom crunching client side, most web bots (i.e. Google and others) don't interpret js on the fly and parse newly rendered content for indexing. Instead Google (and now Bing) support the 'Google Ajax Crawling Scheme' (<a href="https://developers.google.com/webmasters/ajax-crawling/docs/getting-started">https://developers.google.com/webmasters/ajax-crawling/docs/getting-started</a>) - which basically states that IF you want js rendered dom content to be indexed (i.e. rendering ajax call results), you must be able to:</p> <ol> <li>Trigger the async js rendering via the url using hashbangs <code>#!</code> (i.e. <code>http://www.mysite.com/#!my-state</code>), and</li> <li>Be able to serve a prerendered dom snapshot of your site AFTER js modification on request.</li> </ol> <p>If using a client side MVC framework like Backbone.js, or Spine - you will need to provide this service if you want your web app indexed.</p> <p>Generally this means you intercept a request made by the web bot (explained on the link above), and scrape your side server side using a headless browser (i.e. QT + <a href="https://github.com/thoughtbot/capybara-webkit">capybara-webkit</a>, <a href="http://htmlunit.sourceforge.net/">HtmlUnit</a>, etc.), then deliver the generated dom back to the requesting bot.</p> <p>I've started a gem to do this in ruby (now taking pull requests) at <a href="https://github.com/benkitzelman/google-ajax-crawler">https://github.com/benkitzelman/google-ajax-crawler</a></p> <p>It does this as rack middleware using capybara-webkit (and soon <a href="http://phantomjs.org/">phantomjs</a>)</p>
    singulars
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. VO
      singulars
      1. This table or related slice is empty.
    2. VO
      singulars
      1. This table or related slice is empty.
    3. VO
      singulars
      1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload