What Is Agentprobe and What Does It Do?

Updated

Agentprobe is a readiness-testing tool for agentic commerce. You give it a seller URL, and it runs 13 probes to determine whether an AI agent can discover that seller, get a quote, and complete a purchase. It returns a score out of 110 and a readiness tier, so the practical audience is any seller or site operator who wants AI shopping agents to be able to transact with them rather than skip past them.

What it actually checks

The tool probes the machine-readable surfaces an AI agent would look for when deciding whether a store is transactable. According to the site, the 13 probes cover:

  • Discovery and description: llms.txt, OpenAPI, ai-plugin.json, MCP, commerce.json
  • Transaction path: catalog API, quote API, checkout API, payment rails
  • Trust and after-sale signals: refund/contact, unsupported rails, no fake claims, fulfillment proof

The logic behind this list is that discovery alone isn't enough. A site can be perfectly crawlable and still be useless to an agent if there's no way to get a structured quote or finish a checkout. That's why the tiers separate "findable" from "transactable."

The scoring tiers

Scores run to 110 and map to four readiness levels:

Tier Score What it means
CERTIFIED ≥85/95 (listed examples show 100–110/110) Fully agent-legible
AGENT_READY 70–84 Agents can transact with guidance
PARTIAL 40–69 Discoverable but not transactable
NOT_READY <40 Opaque to agents

The gap between PARTIAL and AGENT_READY is the one most sellers will care about. Being discoverable is table stakes; the score only climbs once the quote and checkout path is machine-usable.

How to use it

  1. Take the URL of the seller page or storefront you want evaluated.
  2. Submit it to Agentprobe to run the probe set.
  3. Read the resulting score and tier, then look at which of the 13 probes failed — those are your remediation targets.
  4. Re-run after changes to confirm the score moved.

The expected result is a tier label plus a per-probe breakdown, which is more actionable than the headline number alone. A CERTIFIED score with a failing checkout probe tells you something different than a uniformly mid-range PARTIAL.

Reading the registry

Agentprobe publishes a registry of top certified sites, which doubles as a set of reference implementations. Listed examples include agentic-evidence.fly.dev, 8bitconcepts.com, nothumansearch.ai, bringyour.ai, and geo-agent.fly.dev, several at 110/110. If you're building agent-readiness into your own site, these are the sites to inspect for what a full-score configuration looks like in practice. The tool itself is listed at 110/110, and the site notes it's built by 8BitConcepts, currently at v0.3.1, with API, registry, and JSON access.

Where it fits

Agentprobe answers one narrow question: can an AI agent complete a purchase on this site? It is not a general SEO or analytics tool, and it doesn't tell you whether agents want to buy from you — only whether they can. If your traffic strategy assumes AI shopping agents will increasingly mediate discovery and checkout, this is a way to test that assumption against your own URL instead of guessing.