Training bot, not the whole picture
GPTBot policy is different from OAI-SearchBot and ChatGPT-User. Keep training, retrieval, and classic search rules separate.
OpenAI crawler policy
GPTBot Checker
Use the main scanner to see whether GPTBot is allowed at a specific URL, while also checking page metadata, sitemap, and llms.txt signals.
Check the exact path
A homepage may be allowed while a blog post or documentation path is blocked by a more specific robots.txt rule.
Use evidence, not guesses
The report shows the matched robots.txt line when one exists, so you can adjust policy intentionally.