Blocked by robots.txt

WarningHigh priority

Addresses on this site that robots.txt tells crawlers not to fetch.

Why it matters

They were never requested, by us or by a search engine, so nothing is known about them and they cannot be indexed on their own content.

How to fix it

If they should be found, change the rule named beside each one. If they should not, there is nothing here to fix.

Skitter runs this check on every crawl, and lists each page it finds with the evidence: the header, the tag or the link that gave it away.

More in robots.txt