The site could not be scanned because requests for ROBOTS.TXT return ‘401 Unauthorized’ or ‘403 Forbidden’.
Please contact the site administrator or developer to resolve this issue.
- Blocked Links
- 3.4 Sep 2009 Added.
This page describes a web site issue detected by SortSite Desktop and OnDemand Suite.
Rule ID: ErrCrawlBlockedByRobotsStatus