Cloudflare Turnstile stopped our agent at sign-up on all 33 products that use it there

Our agent drives software the way an AI agent would. We record every bot check it meets, at every step from the docs to deleting the account.

Where a bot check stopped our agent

Products stopped at that step, of those where our agent met the check there

Every step and check

Each row covers 5 or more products that met the check. Where 1 to 4 of them were stopped, the row says “fewer than 5”.

Bot check and stepStopped, of met
Cloudflare challenge page, docs5 of 6 (83%)
Google reCAPTCHA, sign-up55 of 76 (72%)
Cloudflare Turnstile, sign-up33 of 33 (100%)
hCaptcha, sign-up12 of 16 (75%)
Cloudflare challenge page, sign-up12 of 14 (86%)
Arkose Labs, sign-up5 of 5 (100%)
hCaptcha, checkout0 of 30 (0%)

Bot checks per product shows one deciding check for each product, from sign-up to the first call, and counts Turnstile and the challenge page together as Cloudflare. This table counts every check at every step, so one product can be in several rows.

Bot checks per product

How we count

Stopped
The check refused our agent, or asked for a person to pass it, such as a picture puzzle. Our agent doesn't try those, so the step counts as needing a human. A check that let the agent through counts as met, not stopped.
Challenges
Our agent never solves a CAPTCHA and never uses a solving service. It signs every request on every drive with Web Bot Auth and names itself, so a bot check can tell it from an anonymous bot.
Products
Every product in our directory, 237 of them, each counted once on its newest drive. We drive products we pick, ones anyone suggests, and ones whose owner asked for a drive; a drive an owner ordered is left out.
Period and updates
Newest drives from 1 October 2026 to 11 November 2026. The page is rebuilt every day. New products come first. We drive one again when its sign-up changes, when its owner asks, or when a random quality check picks it.

The full method

Payments, and signed against unsigned

Which products offer an agent a way to pay, and which sign-up pages open only to a signed request.

Paying

A way to pay counts when our agent saw it offered or paid through it: x402, MPP, Stripe Projects and similar. The card form is counted over the products where our agent set out to buy.

One fetch, signed and unsigned

A separate test, not a drive. We fetch each product's sign-up page once from the same server, signed with Web Bot Auth and unsigned: 232 of the 237 products we drove had a sign-up page to fetch. A page can open to that one request and still stop the agent later in a drive.

Free under CC BY 4.0

Each product's own record stays open. Use it in your research or your product, with a credit and a link.

The check that stopped it

For each product, the bot check that decided its drive: the vendor and the step.

How an agent can pay

For each product, the payment rails it offers and what happened when our agent tried them.

Its level over time

Every product's level on each drive, and when it moved.

What a study or a licence adds

Every check on every drive, including those that let our agent through: at the docs, the key, the checkout and account deletion.

Sponsored field study

  • We choose the question and publish the method before the first drive.
  • Several sponsors can back one study. Each page says “Sponsored by” and names them.
  • No sponsor sees the findings before they are published.
  • A sponsor's own product and category are never measured in a study it pays for.
  • Products a study names can reply. Sponsors can't.
  • No sponsor makes up more than a third of our income in a year.
  • Findings are counts, each over 5 or more products.

From $15,000 excl. VAT

Data licence

  • The full record: 692 drives since 1 October 2026, every check met on each.
  • Per check: product, drive date, step, vendor, challenge type, status, outcome, and whether our agent signed its requests.
  • How each check changed for the same product from one drive to the next.
  • Refreshed every quarter.
  • Non-exclusive.

From $12,000 a year excl. VATOr one snapshot of the same data, without updates: from $4,000 excl. VAT.

Not for sale

  • A score
  • A level
  • A place in a ranking
  • A removal
  • An early look at findings
  • A product's attempt log, evidence or fixes

Ask about a study or a licence

Tell us the question you want answered or the part of the record you need. We reply within two working days, then set up a call to scope it. Or write to hello@agentdrives.com.

We read every message and answer as soon as we can.

The sample

20 rows from real drives, one bot check each, free under CC BY 4.0. Product names are removed, and every row matches 5 or more products, so no row points at one.

Columns: product (withheld), month of the drive, step, bot check, challenge, outcome, and whether our agent signed.

Download the sample (CSV)