MRM-01 / crawler-access
Crawler, non-cloaking, and robots contract
Crawler access matrix
All crawler and human user-agent classes receive the same substantive public graph.
| Class | Robots access | Content |
|---|---|---|
| general_search_crawler | allow_root | same_public_graph |
| ai_retrieval_or_answer_crawler | allow_root | same_public_graph |
| archive_or_research_crawler | allow_root | same_public_graph |
| unknown_or_unclassified_user_agent | allow_root | same_public_graph |
| human_browser | not_applicable | same_public_graph |
Non-cloaking and security
No user-agent-dependent substantive content, personalized content, or bot-only claims are generated.
robots.txt is an advisory discovery control and not a substitute for authentication, authorization, or removal of private content.