ai-crawlersrobots-txtllms-txt
Free homepage check: see what AI crawlers read on your site
HumanKey reads a site's robots.txt, homepage HTML, llms.txt and sitemap and shows what it found, with sources. No score, no sign-up.
Rob, CEO & Founder
Articles on AI traffic, robots.txt and GDPR for website owners.