![]() |
Disallow the data directory in my robots-txt file? I'm curious why my data/ directory would be disallowed (as it is in a default installation of PPPro) in my robots-txt file. Wouldn't this directory being crawled be good for SEO? |
There are no scripts in the data directory for bots to follow in fact there is a blank index fille so nothing is viewable so nothing to crawl. It is to proect your images. The necessary scripts for google etc to crawl are not blocked. |
Ahhh. OK. Thank you, Chuck, for the quick reply. |
Not a problem glad to assist. |
Here is a good example on the basics its kind of long but is information. HowStuffWorks "How Internet Search Engines Work" |
That's great! Thank you, Chuck. :) |
Yeah thought that might help you understand how some things work with SEO. You do not want to have spiders crawl some stuff. |
Absolutely. For some reason I thought having them crawl the names of the files in that directory would be a good thing. Fortunately developers like you know what you're doing. :) |
Yes does not work like that they crawl pages on a site and grab data. ;) |
Here are the top ten things a webmaster can do to help there site for better seo overall http://www.sitepronews.com/2012/02/0...oogle-ranking/ Definately in our program you want to make sure our HTACCESS file is renamed to .htaccess and turn on the SEO feature. This tutorial should assist you in determining the best meta tags to do and other things with the rest of your site to promote it. |
| All times are GMT -5. The time now is 12:58 AM. |
Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.2.0