__/ [ Borek ] on Wednesday 07 June 2006 20:03 \__
> On Wed, 07 Jun 2006 20:54:28 +0200, Sholom <sdeen@xxxxxxxxxxxx> wrote:
>
>> Anyone know how to allow Google's robots to index protected content?
>>
>> My company has a site that requires a subscription to access the info,
>> but we'd like to have google index those pages. I see there are many
>> sites who've managed this.
>
> Easy way to get banned.
>
> I hate sites that are indexed but not accessible. Usually I do two things
> at the same time - first, I read cached content. Second, I report such
> site to Google.
There is a way around this. Change user-agent string to googlebot and you're
in. To be honest, I didn't know this trick until somebody told me last week.
And I agree with Borek: it's annoying and given that it's a mild form of
cloaking (different content served to SE's and people or hiding
information), it is basis for banishment.
Best wishes,
Roy
--
Roy S. Schestowitz | {Hide sig} {Show sig} >{Close Application}<
http://Schestowitz.com | Free as in Free Beer ¦ PGP-Key: 0x74572E8E
3:30am up 41 days 9:03, 11 users, load average: 2.47, 1.24, 0.78
http://iuron.com - semantic engine to gather information
|
|
