Resources blocked by robots.txt

WarningMedium priority

Rendered pages of this site that load a file their site's robots.txt tells crawlers not to fetch.

Why it matters

A search engine that obeys robots.txt renders the page without that script or stylesheet, and may see a different page from the one visitors get.

How to fix it

Allow crawlers to fetch the scripts, stylesheets and images a page needs to be drawn.

Skitter runs this check on every crawl, and lists each page it finds with the evidence: the header, the tag or the link that gave it away.

More in JavaScript