Databases
StackOverflow2013
Postsdbo
POHow Do I Make Webpage Content Private To Humans But Public To Search Engines?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POHow Do I Make Webpage Content Private To Humans But Public To Search Engines?
    primarykey
    data
    text
    <p>When you click on my client's search result in Google (or any other search engine) you're taken to the URL you were seeking but the content presented is a standard 'Terms of Use' page.</p> <p>A human needs to accept the 'Terms of Use' by clicking on a JS 'ok' link, which activates a cookie, and then they're allowed to see the actual page content.</p> <p>Problem is this is making the page's content private and the search engines are consequently indexing the 'Terms of Use' content.</p> <p>I'm looking for some sort of compromise that will satisfy the legal eagles and my client's SEO needs.</p> <p>I'm not a developer but what I've come up with so far is ...</p> <p>They could set a cookie for requests coming from known search engines (using <a href="http://www.user-agents.org/index.shtml" rel="nofollow noreferrer">http://www.user-agents.org/index.shtml</a> and/or www.iplists.com/nw/) and allow those requests to access the content.</p> <p>This would make the private content public so they'd also need to noarchive those pages so people can't skip accepting the 'Terms of Use' and just access the content via Google's cache.</p> <p>I believe this would allow the search engines to evaluate the page's content and rank it accordingly while still requiring humans to accept the site's 'Terms of Use' ?</p> <p>First time I've come across this issue ... any advice on how to implement / better alternative solutions / live examples appreciated.</p> <p><em>[There is <a href="https://stackoverflow.com/questions/3956822/can-i-allow-indexing-by-search-engines-of-restricted-content-without-making-it">a vaguely similar question</a> but I'm looking for something a bit more specific please.]</em></p> <p>Many thanks in anticipation!</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PTQuestion
    1. USCommunity
    1. USScotch AL
    plurals
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    3. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POHow Do I Make Webpage Content Private To Humans But Public To Search Engines?
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POHow Do I Make Webpage Content Private To Humans But Public To Search Engines?
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POHow Do I Make Webpage Content Private To Humans But Public To Search Engines?
      1. USeglasius
      1. VTFavorite
    1. CO+1 legal eagles. name of my elementary school soccer team.
      singulars
      1. POHow Do I Make Webpage Content Private To Humans But Public To Search Engines?
      1. USash
    2. COSearch engines don't use cookies.
      singulars
      1. POHow Do I Make Webpage Content Private To Humans But Public To Search Engines?
      1. USSLaks
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload