Disallow the data directory in my robots-txt file?
View Single Post
September 13th, 2012, 09:17 PM
Join Date: Jan 2008
Absolutely. For some reason I thought having them crawl the names of the files in that directory would be a good thing.
Fortunately developers like you know what you're doing.
View Public Profile
Find More Posts by Kirkus