Model APIs for AI agents

In model APIs, Mistral AI gets an AI agent furthest on its own: it reaches L4 (Runs on its own), working through its API, MCP server and CLI and in a browser. As of 15 Nov 2026, both we drove let an agent in on its own.

2 products drivenDriven 2 to 15 Nov 2026Last drive 15 Nov 2026Method of 18 Nov 2026MarkdownJSONCite

Model APIs, step by step

Each product's newest drive, by the level it shows. Open one for its whole drive.

Model APIs: every product we drove, by the five steps
Place#ProductLevelFindGet inUsePayLeaveFirst checkpoint not passedDriven
–Mistral AIL41 drive, not yet confirmedFind: On its ownGet in: On its ownUse: On its ownPartlyLeave: On its ownPayment · A card form
–AgentgatesL21 drive, not yet confirmedPartlyGet in: On its ownNot measuredPay: On its ownPartlyDeleting the account
  • On its own
  • Partly
  • Not measured

By level; on one level, confirmed products first, then work done, then time to the first call. A level still waiting for its second drive says so beside it and has no place number. How we rank

n = 2 products · Updated  · Method of 18 Nov 2026 · CC BY 4.0

CSVShareLink copied
Cite

Cite this figure

AgentDrives, "Model APIs, step by step", 18 Nov 2026. https://agentdrives.com/categories/model-apis#products

CC BY 4.0

2 chartsFirst stop and payment

Payment is the first checkpoint not passed for 1 of 2

The first checkpoint our agent did not pass on its own, on each product's newest drive.

  • Payment1 of 2
  • Deleting the account1 of 2
  • Passed every checkpoint0 of 2
First checkpoint not passedProductsOf
Payment12
Deleting the account12
Passed every checkpoint02

n = 2 products · Updated  · Method of 18 Nov 2026 · CC BY 4.0

CSVShareLink copied
Cite

Cite this figure

AgentDrives, "Payment is the first checkpoint not passed for 1 of 2", 18 Nov 2026. https://agentdrives.com/categories/model-apis#first-stop

CC BY 4.0

1 of 2 paid on its own

The Pay step as the products table above marks it. Paying on its own means our agent paid, or got a valid payment request it could pay, with no person stepping in.

  • On its own1 of 2
  • Partly1 of 2
PayProductsOf
On its own12
Partly12

n = 2 products · Updated  · Method of 18 Nov 2026 · CC BY 4.0

CSVShareLink copied
Cite

Cite this figure

AgentDrives, "1 of 2 paid on its own", 18 Nov 2026. https://agentdrives.com/categories/model-apis#payment

CC BY 4.0

Got in on its own

2of 2

All products: 109 of 246

At L3 or higher

1of 2

All products: 93 of 246

Left on its own

1of 2

All products: 59 of 246

The record in detail

Where agents drop out

Payment loses the most: 1 of 2 stopped there or needed a person

Of the 2 products driven, how many our agent passed on its own at each checkpoint.

  • Docs2 of 2
  • Sign-up2 of 2
  • Verification1 of 2

    1 not needed

  • API key2 of 2
  • First call2 of 2
  • First action2 of 2
  • Payment1 of 2

    1 stopped

  • Cancelling0 of 2

    2 not needed

  • Deleting the account1 of 2

    1 stopped

CheckpointPassed on its ownA person did itStoppedNot neededNot reachedNot tried
Docs200000
Sign-up200000
Verification100100
API key200000
First call200000
First action200000
Payment101000
Cancelling000200
Deleting the account101000

n = 2 products · Updated  · Method of 18 Nov 2026 · CC BY 4.0

CSVShareLink copied
Cite

Cite this figure

AgentDrives, "Payment loses the most: 1 of 2 stopped there or needed a person", 18 Nov 2026. https://agentdrives.com/categories/model-apis#checkpoints

CC BY 4.0

What an agent can do

What an agent can do in each

The tasks most model APIs products share. Our agent did at least one at 2 of 2.

Model APIs: what an agent can do in each product
ProductRun an autonomous agent taskUpload a file
Mistral AIDoneDone
AgentgatesPaid planDone

DonePaid plan

n = 2 products · Updated  · Method of 18 Nov 2026 · CC BY 4.0

ShareLink copied
Cite

Cite this figure

AgentDrives, "What an agent can do in each", 18 Nov 2026. https://agentdrives.com/categories/model-apis#capabilities

CC BY 4.0

Daily sign-up checks

Sign-up pages, checked every day

Each day our agent loads every sign-up page, without signing up.

  • Mistral AI, No sign-up page on the newest check; 16 of 16 days
  • Agentgates, No sign-up page on the newest check; 4 of 4 days

n = 2 products · Updated  · Method of 18 Nov 2026 · CC BY 4.0

ShareLink copied
Cite

Cite this figure

AgentDrives, "Sign-up pages, checked every day", 18 Nov 2026. https://agentdrives.com/categories/model-apis#sign-up-checks

CC BY 4.0

Read more

Use the data The numbers on this page, for your own tools and agents.