Status codes
Internal Blocked by Robots.txt
Internal pages are blocked by robots.txt. Review robots.txt rules if these pages should be accessible.
Review method
Confirm the evidence before choosing the remedy.
Locate the source
Inspect the exported section and affected URL that caused internal_blocked_by_robots_txt to fire.
Challenge the meaning
Compare the rendered page, site intent, related signals, and likely false-positive conditions before accepting the finding.
Choose a testable outcome
Define what should change, where it belongs, who owns it, and how the public result will be verified.
Current product boundary
A detected condition does not inherit permission to write.
- Detected
- When measured evidence matches
- AI suggestion
- Not generated for this group
- Declared remediation
- No live action declared
Actual measurement depends on crawl configuration and dependencies. Any declared action still requires account access, site ownership, reliable evidence, operator gates, connector support, and human approval. Cross-crawl resolution is not currently an implemented state.
Continue investigating