August 16th, 2004, 03:05 PM
Join Date: Jun 2002
Spider's visit everyones site. Depending on the friendliness of the url will depend on the extent of indexing.
It is a good thing.
If you want some good tutorials on how they work just do a net search on spiders and bots