|Kirkus ||September 12th, 2012 04:23 PM |
Disallow the data directory in my robots-txt file?
I'm curious why my data/ directory would be disallowed (as it is in a default installation of PPPro) in my robots-txt file. Wouldn't this directory being crawled be good for SEO?
|Chuck S ||September 12th, 2012 05:30 PM |
There are no scripts in the data directory for bots to follow in fact there is a blank index fille so nothing is viewable so nothing to crawl. It is to proect your images. The necessary scripts for google etc to crawl are not blocked.
|Kirkus ||September 12th, 2012 06:53 PM |
Ahhh. OK. Thank you, Chuck, for the quick reply.
|Chuck S ||September 12th, 2012 07:06 PM |
Not a problem glad to assist.
|Kirkus ||September 13th, 2012 08:59 PM |
That's great! Thank you, Chuck. :)
|Chuck S ||September 13th, 2012 09:14 PM |
Yeah thought that might help you understand how some things work with SEO. You do not want to have spiders crawl some stuff.
|Kirkus ||September 13th, 2012 09:17 PM |
Absolutely. For some reason I thought having them crawl the names of the files in that directory would be a good thing.
Fortunately developers like you know what you're doing. :)
|Chuck S ||September 13th, 2012 09:40 PM |
Yes does not work like that they crawl pages on a site and grab data. ;)
|Chuck S ||September 14th, 2012 02:43 PM |
Here are the top ten things a webmaster can do to help there site for better seo overall http://www.sitepronews.com/2012/02/0...oogle-ranking/
Definately in our program you want to make sure our HTACCESS file is renamed to .htaccess and turn on the SEO feature.
This tutorial should assist you in determining the best meta tags to do and other things with the rest of your site to promote it.
|All times are GMT -5. The time now is 12:58 AM. || |
Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.2.0