AxioRankZero-Trust for AI Agents
Open the console

Content permission plane

Pay Per Crawl

Cloudflare's HTTP 402 crawler-access marketplace: publishers price AI crawls and bots settle centrally. Preflighting the 402 charge bridges content permission and commerce.

View coverage matrixRead the spec

Tracked. We are watching this standard evolve.

What it answers

May it use this content?

Pay Per Crawl sits in the content permission plane of the agent-interop stack. May it use this content? AxioRank tracks it as one row in a coverage matrix that spans six planes, from discovery and identity to authorization, content permission, and commerce.

Plane

Content permission

Status

watching

Direction

both

How AxioRank handles it

Governed, not just listed.

Tracked. We are watching this standard evolve. Both directions: agents you run, and agents that reach you.

Read the Pay Per Crawl specification

More content permission protocols

Related protocols

Abuse / rate signals

Detect scraping, enumeration, and probe patterns on inbound agent traffic.

Open

robots.txt / llms.txt

Cache and enforce machine-readable crawl + AI-usage permissions.

Open

IETF AI Preferences

Honor standardized train/infer/index content-usage preferences.

Open

Really Simple Licensing (RSL)

Honor publisher RSL licenses governing AI use of content.

Open

TDM Reservation Protocol (TDMRep)

Honor the W3C / EU TDM reservation at /.well-known/tdmrep.json, a machine-readable opt-out from text & data mining and AI training.

Open

All protocols

The full coverage matrix across six planes.

Open

Govern the whole agent stack

AxioRank verifies identities and capabilities across the agent ecosystem, from discovery to commerce. See the full coverage matrix, machine-readable.

View coverageRead the docs