Thread
:
Disallow the data directory in my robots-txt file?
View Single Post
September 13th, 2012, 09:17 PM
#
8
(
permalink
)
Kirkus
Member
Verified Customer
Join Date: Jan 2008
Posts: 62
Absolutely. For some reason I thought having them crawl the names of the files in that directory would be a good thing.
Fortunately developers like you know what you're doing.
Kirkus
View Public Profile
Find More Posts by Kirkus