All Products 
Username / Customer#
Password
Log In
 Hi,  |  Log Out
  • Site Search
  • Domain Search
  • WHOIS Domain Check
24/7 Support: (480) 505-8877
Hablamos Español
9 AM to 9 PM IST
7 days a week
Go Daddy Support

Search help articles, forums, and discussion groups

Blocked URL

Viewing post 1 to 2 (2 total posts)
Profile picture of JoesCuustomRod

joescuustomrod said 1 year, 1 month ago:

Goggle analytics says a Robots.txt file has blocked my url so it can’t be crawled. How can I fix this?

Profile picture of TMT

GoDaddy Contributor tmt said 1 year, 1 month ago:

A Robots.txt file would be in the root (top-level) directory of your web site.
This file can state that certain web crawlers, including Google, should not crawl your site.

If you do not wish to restrict web crawlers, you should just delete this file from your site or, if you don’t want to lose the file, just rename it to another file name (such as “robots.txt.backup”, for example).

Add a reply:

You will auto join this group when you reply to this topic.

When posting about a technical issue, please be sure to include as many details as possible, such as your domain name, related URLs and other pertinent information. This consideration will allow us to better understand the situation and quickly assist you.