Google crawler controls

Google-Extended Checker

Review Google-Extended rules separately from Googlebot so training/product-improvement controls do not get confused with search indexing.

Google-Extended is not a classic indexing crawler. The report keeps it separate from Googlebot decisions.

Some sites want classic search visibility while limiting other uses. The checker helps inspect that split.

Clear robots.txt comments and predictable groups make crawler policy easier for teams to maintain.