AI ComparisonsNov 9, 202613 min read

Best System One Models in 2026: 26 Tested on 450 Decisions

The best System One models in 2026, measured: Drex Max leads 26 at 94.4% for $91 per million decisions. None matches Claude Opus 4.8. Jev is fifth.

On this page
  1. What changed this week?
  2. Which System One model is the most accurate?
  3. Which System One model should you pick for your situation?
  4. What is the cheapest System One model worth using?
  5. What is the best System One model you can run yourself?
  6. Which System One model is the fastest?
  7. Is Jev still the best System One model?
  8. Where do all System One models fall short?
  9. Which System One models did we not test?
  10. The full ranking: 26 decision models on DecideBench v2
  11. How we tested
  12. Where XY Space fits
  13. FAQ
  14. Sources

The best System One model in 2026, the kind of AI that picks one answer from a list, is Nace.AI's Drex Max. On DecideBench v2, our 450-decision test of 9 November 2026, it got 94 of every 100 right. That is the best of 26, at $91 per million decisions. None matches Claude Opus 4.8, the general AI we use as a yardstick (99.3%, about $26,543).

A System One model reads some text, a question and a short list of options, then returns one option. "Approve this refund or send it to a person" is a typical question. What is a System One model explains the category from scratch.

Want the most accurate hosted API? Drex Max, 94.4% at $91 per million.

Want the cheapest hosted model that still gets 4 in 5 right? s1-fast from Decision Models, 82.0% at $29.82.

Need the model on your own hardware? Perplexity's pplx-decider v1.2 27B, 92.2%.

Need answers fast? OpenAI's GPT-6 Luna, 196 ms, the quickest hosted model.

Already on Jev? It scored 86.2%, fifth of 26. Drex Max is 8.2 points ahead for $15.96 more per million.

  • 26 decision models: 7 hosted APIs and 19 open models we ran on one graphics card.
  • Every price is per million decisions, so hosted and self-hosted models compare directly.
  • DecideBench is ours (XY Space), and so are two of the models in it, yev0-4b and yev1-4b. The items, answers and code are public.

What changed this week?

DecideBench v2 went out on 9 November 2026 with a new, harder test, and every number on this page comes from it. The earlier v1 test (400 short decisions) had most models above 90%, so it could no longer tell them apart. v1 and v2 scores are different tests and do not compare.

Each v2 item looks like what a decision model sees in production. That might be a JSON payload from an AI agent, a raw email with its headers, or a release controller's metrics. Inputs are about three times longer than in v1, and each item has 3 to 10 options.

Three entries changed for other reasons:

  • Quyet-1.0-Large is gone. Decision Models retired it on 3 November 2026, and its API now answers HTTP 410.
  • Drex 1.5 is no longer separate. Nace.AI now serves Drex Max when you ask for Drex 1.5. All 450 answers matched, so it gets no separate score.
  • Clef runs on our own graphics card. Cloudflare publishes Clef's weights, so we ran the model ourselves. Through AI Space, our model gateway, Clef 27B scored 68.4% on the same items, against 85.3% when we ran Cloudflare's weights directly. We report the 85.3%.

Which System One model is the most accurate?

Drex Max is the most accurate decision model we have measured: it got 94 of every 100 decisions right. Three models sit two to three points behind it.

ModelCompanyRight answersPairs both rightCost per millionMedian wait
Claude Opus 4.8 (reference, general AI model)Anthropic99.3%98.7%$26,542.701,336 ms
Drex MaxNace.AI94.4%89.3%$91.00258 ms
REAX 1 27BDecision Models92.4%87.1%$120.29545 ms
pplx-decider v1.2 27B (self-hosted)Perplexity92.2%86.2%$386.341,528 ms
s1-pro 26BDecision Models91.6%85.3%$120.93418 ms

"Pairs both right" is the stricter score. Every item has a twin that differs by one small, realistic edit that changes the right answer, such as a file attached to the chat instead of a database table. A model that answers from topic words alone gets one twin wrong, so pair accuracy falls faster than plain accuracy.

Top 10 decision models on DecideBench v2's 450 decisions
Top 10 decision models on DecideBench v2's 450 decisions
Right answersBoth halves of a pair right
Drex Max94.4%89.3%
REAX 1 27B92.4%87.1%
pplx-decider v1.2 27B92.2%86.2%
s1-pro 26B91.6%85.3%
Jev86.2%72.9%
Clef 27B85.3%72.4%
GPT-6 Luna84%72%
s1-fast82%68.9%
Drex 2.080.9%65.8%
yev1-4b79.3%62.7%

Source: DecideBench v2, measured 9 November 2026

Drex Max is 4.9 points behind Opus 4.8 at about 1/290 of its cost. On 450 items, one point is about 4.5 answers. Treat REAX 1, pplx-decider and s1-pro as a cluster, not a strict order.

Drex Max got every item right in three of nine jobs: approving an AI agent's proposed action, moderating a post and reading a customer's intent. Its weakest job was gating a staged software release, at 74%. Drex Max vs Jev goes through the two side by side.

Which System One model should you pick for your situation?

Pick by the constraint you cannot move: accuracy, price, where the model runs, or speed. Each row below is the best measured answer to one of those.

If you wantPickRight answersPairs both rightCost per millionMedian wait
The most accurate hosted APIDrex Max (Nace.AI)94.4%89.3%$91.00258 ms
The cheapest hosted model above 80%s1-fast (Decision Models)82.0%68.9%$29.82238 ms
The most accurate model you run yourselfpplx-decider v1.2 27B (Perplexity)92.2%86.2%$386.341,528 ms, no network
The cheapest self-hosted model above 75%OpenJev Flash 9B (OpenJev)75.3%55.6%$41.33174 ms, no network
The fastest hosted APIGPT-6 Luna (OpenAI Decisions)84.0%72.0%$140.01196 ms
The originalJev (TypeSafe)86.2%72.9%$75.04334 ms

Self-hosted costs are graphics-card time, and self-hosted wait times were measured on the card with no network in them. Hosted wait times include the network from one client machine. The two columns are close, not identical, comparisons.

Moving off Jev specifically? Best Jev alternatives ranks the same models by what each trades away from Jev. This page ranks the whole category, Jev included.

What is the cheapest System One model worth using?

s1-fast from Decision Models is the cheapest hosted model that still gets 4 in 5 right. It scored 82.0% at $29.82 per million, about a third of Drex Max's price.

s1-fast is on the cost frontier, meaning no other model is both cheaper and more accurate. The other hosted models on that frontier are Jev ($75.04, 86.2%) and Drex Max ($91.00, 94.4%). Every other hosted model is beaten on both counts by one of those three.

s1-fast trails Drex Max by 12.4 points, and the gap sits in two jobs. On triaging a bug report it scored 66% to Drex Max's 94%. On gating a staged release, 46% to 74%. On reading a customer's intent the two are within two points.

Decision Models lists s1-fast at $0.019 per million input tokens, with output free. Per-token prices hide how many tokens each model bills for the same decision, which is why we quote cost per decision. System One model pricing covers every model's list price and what it means per decision.

Nothing cheaper than s1-fast is worth using yet. Julia-1 costs $9.13 per million and Laya $13.96, but both score close to random guessing.

What is the best System One model you can run yourself?

Perplexity's pplx-decider v1.2 27B is the most accurate model you can download and run: 92.2%, level with the second-best hosted API. You pay for it in graphics-card time: $386.34 per million decisions, about 4.2 times Drex Max's price.

We ran every self-hosted model on one NVIDIA RTX PRO 6000 Blackwell graphics card, rented from AWS at $3.36 an hour. Each model ran alone, with 4 requests in flight. A busier server that keeps the card full would cost less per decision. Perplexity ships pplx-decider as a Python library, so we wrote a small server that batches queued requests into one call. Without batching it scored 92.4% at $875 per million and 3,443 ms.

The weights are Apache 2.0 on Hugging Face, and Perplexity's model card says the weights take about 52 GiB of graphics-card memory. What is pplx-decider covers the model and its smaller Flash sibling.

Cheaper self-hosted options, in order of accuracy:

ModelCompanyRight answersPairs both rightCost per millionMedian wait (no network)
Clef 27BCloudflare85.3%72.4%$216.42928 ms
yev1-4b (ours)XY Space79.3%62.7%$71.15275 ms
pplx-decider-flash v1.2 4BPerplexity78.2%62.2%$125.34284 ms
OpenJev Flash 9BOpenJev75.3%55.6%$41.33174 ms

We built yev1-4b and we built the test, so weigh its row knowing that. The reason to self-host is usually where the data goes, not price: Drex Max is more accurate than every self-hosted model, and cheaper than pplx-decider and Clef 27B. Open source System One models covers the self-hosted field in depth.

Which System One model is the fastest?

GPT-6 Luna, behind OpenAI's Decisions API, is the fastest hosted model: half of its answers came back within 196 ms. s1-fast (238 ms) and Drex Max (258 ms) follow.

Hosted times include the network from our client machine. Jev was called through AI Space, our gateway, so its 334 ms includes one extra hop. Self-hosted times were measured on the graphics card itself: OpenJev Flash 9B answered in 174 ms there, but you would add your own network on top. Laya (58 ms) and Julia-1 (39 ms) are faster still and near chance, so speed alone is a poor reason to pick them.

Most models saw one solved example per answer option before each question. Luna also ran without those examples and scored 83.3%, against 84.0% with them. That matters for cost: examples are input you pay for on every call.

Is Jev still the best System One model?

No. Jev scored 86.2% and placed fifth of 26, behind Drex Max, REAX 1, pplx-decider and s1-pro. It is still good value: no hosted model is both cheaper and more accurate.

The bigger gap is in the pairs. Jev got both halves of 72.9% of pairs right, against Drex Max's 89.3%. That 16.4-point gap means Jev more often gives the same answer to two items that need different ones. Its weakest jobs were gating a staged release (60%), ruling on a return (76%) and triaging a bug report (78%).

TypeSafe introduced Jev as the first System One model on 15 September 2026, and what is Jev covers how it works. For the price detail, read Jev pricing. We called Jev through AI Space, which served version 1.13.0.

Where do all System One models fall short?

Every decision model falls short on rules that need a number worked out first. Gating a staged software release means computing a crash-free rate or error ratio and checking it against an ordered list of rules. Opus 4.8 got all 50 of those right. No decision model got more than 74%.

JobOpus 4.8Drex MaxREAX 1pplx-deciderJevGPT-6 Luna
Gating a staged software release100%74%66%64%60%46%
Ruling on a return under a written policy100%90%84%86%76%78%
Triaging a bug report100%94%92%90%78%78%
Reading a customer's intent100%100%100%100%96%98%

Ruling on a return, where dates and amounts meet a written policy, is the next widest gap. Reading a customer's intent, by contrast, is close to solved: the top four decision models all scored 100%.

One approach worth testing, which DecideBench did not measure: compute the number in code first and pass the result in the input, so the model only has to read it. If a decision depends on arithmetic you cannot move into code, a general LLM is the safer pick for that step. Decision model vs LLM covers that split.

Each family has 50 items, so a single family's score moves 2 points per answer and carries wide error bars. The overall ranking is firmer than any one row of this table.

Which System One models did we not test?

Several decision models are on the market that DecideBench has no score for. We list them so a missing name is not read as a low score:

  • Liquid AI d1-ultra
  • Microsoft-Decision-1
  • Strands Decider 2B
  • Upstage Solar Decide
  • meraGPT Decider 1
  • Quyet-1.0-Large (retired by Decision Models on 3 November 2026)
  • Drex 1.5 (Nace.AI now serves Drex Max under that name)
  • The Jeff models (the pinned upstream code they need is gone)

We also did not test general LLMs other than the reference in v2. Any score you see for these models comes from their makers or from another test, and is not ours.

The full ranking: 26 decision models on DecideBench v2

All 26 decision models, plus the reference and a random baseline, measured on 9 November 2026. A dash in Company means an individual published the model.

#ModelCompanyHostingRight answersPairs both rightCost per millionMedian wait
–Claude Opus 4.8 (reference)AnthropicAPI99.3%98.7%$26,542.701,336 ms
1Drex MaxNace.AIAPI94.4%89.3%$91.00258 ms
2REAX 1 27BDecision ModelsAPI92.4%87.1%$120.29545 ms
3pplx-decider v1.2 27BPerplexitySelf-hosted92.2%86.2%$386.341,528 ms
4s1-pro 26BDecision ModelsAPI91.6%85.3%$120.93418 ms
5JevTypeSafeAPI86.2%72.9%$75.04334 ms
6Clef 27BCloudflareSelf-hosted85.3%72.4%$216.42928 ms
7GPT-6 LunaOpenAIAPI84.0%72.0%$140.01196 ms
8s1-fast 26B-A4BDecision ModelsAPI82.0%68.9%$29.82238 ms
9Drex 2.0Nace.AIAPI80.9%65.8%$87.07264 ms
10yev1-4b (ours)XY SpaceSelf-hosted79.3%62.7%$71.15275 ms
11pplx-decider-flash v1.2 4BPerplexitySelf-hosted78.2%62.2%$125.34284 ms
12yev0-4b (ours)XY SpaceSelf-hosted78.2%60.0%$162.63408 ms
13Bespoke-Nimble-9BBespoke LabsSelf-hosted75.6%56.0%$135.67507 ms
14OpenJev Flash 9BOpenJevSelf-hosted75.3%55.6%$41.33174 ms
15TevTogether AISelf-hosted74.9%54.7%$81.88306 ms
16imajev-4b–Self-hosted74.0%53.8%$57.59248 ms
17JevK5 v0.3–Self-hosted68.0%44.0%$73.02310 ms
18Clef-Flash 9BCloudflareSelf-hosted66.9%45.8%$65.42273 ms
19Decider-4B–Self-hosted63.6%42.2%$63.18254 ms
20Kev-4B–Self-hosted41.8%17.8%$100.81374 ms
21GLiNER2.5-Decide 340MFastinoSelf-hosted40.7%7.6%$94.79432 ms
22Laya typed-decisions 421M–Self-hosted39.1%10.7%$13.9658 ms
23Kev-9B–Self-hosted35.8%15.1%$123.46466 ms
24Decider-2B–Self-hosted31.8%10.2%$28.19115 ms
25Julia-1 144MSupersonic LabsSelf-hosted26.9%2.2%$9.1339 ms
26CLM-v0.1-8B–Self-hosted26.4%1.8%$16.6567 ms
–Random guessing––25.1%4.4%$0.000 ms

Self-hosted wait times have no network in them. The four small encoder models (GLiNER2.5-Decide, Laya, Julia-1 and CLM) score 26% to 41%, against 25.1% for random guessing; Laya, Julia-1 and CLM ran without worked examples because they have no place to take them.

How we tested

Every model saw the same 450 decisions in 225 pairs, 50 from each of nine jobs: approving an AI agent's proposed action, routing an agent to a tool, checking a claim against its sources, moderating a post, ruling on a return, gating a staged software release, reading a customer's intent, triaging an inbound email and triaging a bug report. Where a decision depends on a written policy, the question carries the full policy.

Models that take worked examples saw one solved example per option before each item. Hosted costs are the tokens each API billed, at its dated list price. Self-hosted costs are the run's wall-clock time on the graphics card at its hourly price. Median wait is the time per request with 4 in flight.

Claude wrote every item, and Claude Opus, Sonnet and Haiku checked each answer before the runs. That is a real limit: a careful reader could dispute a few labels, and one of Opus 4.8's three misses is arguable. The items are public, so a model trained on them later could score higher; every line carries a canary string asking trainers to exclude it. System One model benchmark explains the method in full.

Where XY Space fits

AI Space, our platform, hosts Jev and open decision models on Western infrastructure. XY Space builds agentic workflows that use decision models for steps like routing and triage, and DecideBench is how we choose which one goes where.

FAQ

What is a System One model?

A System One model is a decision model: it reads an input, a question and a fixed list of options, and returns one option with a score instead of writing text. TypeSafe introduced the name when it launched Jev on 15 September 2026. Because it writes nothing, it bills mainly for input and answers in a few hundred milliseconds. What is a System One model covers it in full.

What other decision models are there besides Jev and GPT-6?

Plenty. On DecideBench v2 the most accurate is Nace.AI's Drex Max (94.4%), followed by Decision Models' REAX 1 (92.4%), Perplexity's open pplx-decider (92.2%) and Decision Models' s1-pro (91.6%). All four beat Jev (86.2%) and OpenAI's GPT-6 Luna (84.0%). Cloudflare's Clef, Nace.AI's Drex 2.0, Together AI's Tev, Bespoke-Nimble and our own Yev models follow. The full table above lists all 26.

Are System One models cheaper than LLMs?

Yes, by a wide margin on this test. Drex Max costs $91 per million decisions, about 1/290 of Claude Opus 4.8's $26,542.70, and s1-fast costs $29.82. The trade is accuracy: Opus scored 99.3%, and no decision model passed 94.4%. DecideBench v2 did not test cheaper general LLMs, so the gap to a small chat model is not measured here.

Can I run a System One model locally?

Yes. 19 of the 26 models we tested are open weights, and we ran each of them on one NVIDIA RTX PRO 6000 graphics card. The most accurate, pplx-decider v1.2 27B, needs about 52 GiB of graphics-card memory for its weights. Smaller 4B models such as yev1-4b and pplx-decider-flash run at 275 to 284 ms on that card, before any network.

Sources

Written by

Cho Yin Yong

Principal AI Solutions Engineer, XY Space

Principal AI Solutions Engineer at XY Space. University of Toronto lecturer for five years, co-author of two patents, winner of two competitive AI awards, and nine years of regulated engineering leadership.

More from Cho Yin Yong

Share this article

Work with us

We build the systems these posts describe, and we'll tell you in the first call whether yours is worth building.

Start a project
Work with us

Book a call.We'll come back with specifics.

Start with the map of your organization, or with the one job that hurts. Measured in hours and money, and everything we build stays yours.

Loading form…