• Welcome to BookAndReader!

    We LOVE books and hope you'll join us in sharing your favorites and experiences along with your love of reading with our community. Registering for our site is free and easy, just CLICK HERE!

    Already a member and forgot your password? Click here.

What is a Google Spider/Yahoo Slurp Spider?

Sitaram

Sitaram

kickbox
I frequently view "Who's On Line" in forums to see who is reading what (especially, unregistered Guests)... and just now, I saw "The Google Spider", which I guess means that it is a robot visiting the site, and indexing posts for the search engine.


I was able to watch the Google Spider proceed from on thread to the next as I clicked my browser refresh/reload button.
 
All the other guests are those of other search engines. Darren, the site's owner, hasn't registered their IP addresses with the forum's software. The majority of the spiders are likely to be traceable to Yahoo!
 
Stewart said:
All the other guests are those of other search engines. Darren, the site's owner, hasn't registered their IP addresses with the forum's software. The majority of the spiders are likely to be traceable to Yahoo!
Click to expand...

I am very impressed by your history forum, listed in your profile.

So many guests are displayed in the "Who's On-Line" at
www.online-literature.com/forums

It is hard to believe that they are all search engine spiders. Sometimes, I have even seen a guest e-mail a thread or view a printer-friendly version of a page.

Surly, unregistered visitors much be drawn to forum pages through search-engine resultes, and they must appear as guests in the Who's On-Line
 
Sitaram said:
I am very impressed by your history forum, listed in your profile.
Click to expand...

Thanks. It was a lot of work to give it its own personality and to gain a growing community, especially in light of other, more prominent, history forums on the internet. It will soon be getting its first sister site too.

It is hard to believe that they are all search engine spiders. Sometimes, I have even seen a guest e-mail a thread or view a printer-friendly version of a page.
Click to expand...

On Talk History it states that the most users ever online was 277. I remember this happening as I thought how the hell could there be that many on the site when, at the time, it only had 12 members. The answer was that Yahoo! was on a major mission to index and it seems that Yahoo! does this on a regular basis. There are, also, so many search engines out there, the following being just a few examples:

googlebot, ggol, google, inkt, INKTOMI-BLK-3,Yahoo!,lycos,ask jeeves,scooter,fast-webcrawler,slurp@inktomi,turnitinbot,ABCdatos BotLink,Acme.Spider,Ahoy! The Homepage Finder,MSNBot,Lycos, and FastCrawler.

Surly, unregistered visitors much be drawn to forum pages through search-engine resultes, and they must appear as guests in the Who's On-Line
Click to expand...

These also account for a lesser number of the visitors.
 
Turnitin.com Spider

Just now, I spotted a new spider here

Turnitin.com Spider

in addition to seeing the Google spider along side the Tunritin.com spider.
 
what's a Yahoo slurp spider?

I was looking at the Who's Online and noticed that Yahoo Slurp Spider is viewing a lot of threads. I never heard of this before, is it an automatic thing searching for something?
 
Stewart said:
There are, also, so many search engines out there, the following being just a few examples:

googlebot, ggol, google, inkt, INKTOMI-BLK-3,Yahoo!,lycos,ask jeeves,scooter,fast-webcrawler,slurp@inktomi,turnitinbot,ABCdatos BotLink,Acme.Spider,Ahoy! The Homepage Finder,MSNBot,Lycos, and FastCrawler.
Click to expand...
Stewart,

Zowie!!!

And it's a spooky thing to do a google search for your own login name and find that a post of yours has been indexed and can be found through google! At least it was the last time I looked.

Talk about being out there!! :eek:

Peder
 
Peder said:

And it's a spooky thing to do a google search for your own login name and find that a post of yours has been indexed and can be found through google! At least it was the last time I looked.

Talk about being out there!! :eek:
Click to expand...


Holy Jamoley! It's worse than that, Sam!

Last time it was only a single post that I found.

Just now I found 902 posts in my login name at two other forums, including one I dropped out of a year ago -- profile sections included! So there I was, reading about myself and my interests, when along came a spider .... :eek:

Spoo-kee!
Peder
 
Peder said:
Holy Jamoley! It's worse than that, Sam!

Last time it was only a single post that I found.

Just now I found 902 posts in my login name at two other forums, including one I dropped out of a year ago -- profile sections included! So there I was, reading about myself and my interests, when along came a spider .... :eek:

Spoo-kee!
Peder
Click to expand...

Wauu Peder, this IS really spookee! :eek:

I just did it myself and yes all my posts came up. Talking about "Big brother is watching you" or should I say "Google is watching you"!!!!!

I have just bought some saftety program for my computer and now this .... You really have to be carefull what information you place on the internet these days..

Thank you for mentioning this!
 
You must log in or register to reply here.
Back
Top