# _____________________ # | | # | AXIORANK | # | | # | [ GOVERNED ] | # | | # \ / # \ / # \ / # \ / # \ / # \ / # \ / # \ / # \ / # \_/ # # Hello, fellow bot. You found AxioRank's robots.txt. # We are the security gateway for AI agents: every agent, # every call, governed. Crawl the docs, behave yourself. :) # The security gateway for AI agents. # https://axiorank.com User-agent: * Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /agents Disallow: /alerts Disallow: /inbound Disallow: /logs Disallow: /login Disallow: /signup Disallow: /auth/ User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: anthropic-ai User-agent: ClaudeBot User-agent: Claude-Web User-agent: Claude-User User-agent: PerplexityBot User-agent: Google-Extended User-agent: Bytespider User-agent: FacebookBot User-agent: Meta-ExternalAgent User-agent: Applebot-Extended User-agent: CCBot User-agent: ImagesiftBot User-agent: Amazonbot User-agent: cohere-ai User-agent: Diffbot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /agents Disallow: /alerts Disallow: /inbound Disallow: /logs Disallow: /login Disallow: /signup Disallow: /auth/ Host: axiorank.com Sitemap: https://axiorank.com/sitemap.xml # AI-readable content index (llmstxt.org): # https://axiorank.com/llms.txt (curated, link-first index) # https://axiorank.com/llms-full.txt (every doc page inlined) Llms: https://axiorank.com/llms.txt