|
The robots.txt file in our application lists which files not to allow indexing of.
I know nothing of google or yahoo spiders on how they index things so I doubt I could tell you anything about those spiders. That would be something you can ask google or yahoo on there stuff.
Our application is working urls are formatted correctly and all content is viewing correctly right?
|