Lesson 05 · Jev 101

Confidence: the difference between a demo and automation

A typed decision is still a guess. Production systems need a control signal: when to act, when to ask a human, when to call a bigger model.

Why prompted “I’m 90% sure” is a weak control

TypeSafe argues RLHF-trained chat models tend to beoverconfident and inconsistent even when you ask them for a confidence field. If a model is right 95% of the time but won’t tell you when it’s in the 5%, you can’t safely automate. TheWhat’s the difference? spells out that contrast.

“Yet RLHF creates inherent issues such as mode dropping, overconfidence, and lack of reliability. These flaws mean that LLMs require humans-in-the-loop.”

TypeSafe AI homepage · fetched Sep 20, 2026 · Source

What Jev gives you (company claim)

Every Choice / Score decision ships with probability and confidence estimates trained under RLCD for calibration: higher confidence should mean higher accuracy. Official nuance: calibration is a property across many predictions, not a guarantee on one answer.

Noul is different: official API concepts say Noul has no separate confidence field. The probability is the uncertainty signal. Design thresholds on P(yes) directly.

Your job: validate calibration on your labeled data, then set thresholds.

“if this only comes back with 50% probability, maybe this is a coin toss, and I disregard it. But if it's 95%, sure, then I can do something with it.”

Secondary Armin Ronacher via TechCrunch · Sep 18, 2026 · Source

How TypeSafe derives confidence

Official confidence.md: Choice and Score answers include the full probabilities distribution.confidence collapses that shape into one number from 0 to 1 so you can threshold it. All probability on one option → 1.0. A flatter spread → lower confidence. Noul still has no separate field.

Official: you are not locked into their definition. The full distribution is in the response if another statistic fits your domain better. Other formulas are promised as a future cookbook — this 101 does not invent one.

The official interactive demo approximates three-option Choice confidence as(3 × largest probability − 1) / 2. Treat that as teaching math for the slider, not as a promise that production uses exactly that line.

Official line worth keeping: if a system cannot say “I don’t know,” it cannot be trusted. Low confidence is a feature your code should listen to.

Official three paths, then scale by risk

TypeSafe’s starting pattern is three ranges. Where you draw the lines depends on the cost of being wrong — not one magic number for the whole product.

Official example shape · pin the SDK

# Official confidence.md, conceptual
if action.confidence < 0.5:
    route_to_human()          # genuinely unsure — don't guess
elif action.choice == "check_balance":
    show_balance()            # low stakes, recoverable
elif action.choice == "approve_transfer":
    if action.confidence > 0.9:
        confirm_then_execute()
    else:
        ask_user_to_confirm() # high stakes, only moderate confidence

Official: start conservative, test on your own labeled data, then move the numbers. The 0.5 / 0.9 figures above are the docs’ illustration, not a TypeSafe SLA.

Official: confidence is not the winner’s probability

Official classification cookbook: a winner at 0.45 with a runner-up at 0.44, and a winner at 0.45 with the rest scattered, are different situations. confidence is what separates them. If your labels form a hierarchy, report the parent when unsure — no second call. Local clone (vagmi/jev-lite): the author defines Choice confidence asp_max of the selected option. That is the winner’s probability, not official peakedness. Do not mix the two.Jevify measured hosted Jev 1.13.0 Choiceconfidence as(p_max − 1/K) / (1 − 1/K) on every sample they took — PRESS, not an official formula page. They could not reproduce Score confidence from the published distribution. Official Noul has no confidence field. Community Ruby (typesafe_ruby): Noul confident?(threshold) is distance from 0.5 and only discriminates above 0.5. Official Noul has no confidence field — threshold P(yes) yourself.Hunch predicates are the author’s defaults:possibly? ≥ 0.25, likely? ≥ 0.5,probably? ≥ 0.75, almost_certainly? ≥ 0.93. Tune them. They are not TypeSafe cutoffs. Community hooks (jev-belay, jev-commit) fail open: a missing key or a timeout lets the turn or commit through. Only a credential-shaped added line blocks jev-commit by default.wakegate skips a wakeup only if Jev answers andp(wake) < 0.2. User messages, bare timers, skip-limit, errors, and unsure all wake. That 0.2 is the author’s skip floor, not a TypeSafe cutoff.hush defaults apply: false and abstains unless both probability and confidence clear your line (author default 0.80 / 0.60). Silence is the product, not a failure.JevNoiseGate fails open on every uncertain path — leaking one ad is cheaper than swallowing a verification code. Those cutoffs are the authors’, not TypeSafe SLAs.pi-heed fails open and leaves an uncertain classification unused.Nyarlathoteppppp/pi-jev-context hides a block only below P < 0.15 useless — author sieve, not a TypeSafe cutoff.kevinpita/pi-jev-context is the other repo: keep only when p > 0.8, so 0.80 is hidden.pi-verdict is the opposite habit: timeout or garbage → deny. Those three directions are the authors’, not TypeSafe SLAs.slop-grader prints a line hit only at confidence ≥ 0.8.jev-for-chrome withholds a premature DONE orBLOCKED below 0.5 on an independent Noul.typesafe-ai phi colors Nouls at 0.2 for display only — it does not declare PHI.fast-jev-compaction keeps a tool call only at keepThreshold 0.5 — distinct from LiteLLM jev-compaction at 0.2fail_open. A Jev error there throws; Claude Code then falls back to its own summary.y0usaf/pi-jev fails open on a missing key, timeout, 429, or garbage. Author smoke calibration (destructive 0.90 / leak 0.90) stays with the author — not enough to default to enforce.s1-rs Policy::act(0.85).review(0.6) maps confidence onto Act / Review / Escalate — author defaults, not a TypeSafe SLA.jev-tools defaults -p 0.5; most tools fail open (exit 5);jgate fails closed because a gate that opens during an outage is not a gate.kamchatka --advise fails open if Jev is unreachable — the standing rules stay. The color rating never becomes a verdict.jev-guard denies at risk ≥ 2.5 or from_untrusted ≥ 0.7; fail open unless JEV_GUARD_FAIL_CLOSED.Sniff Test flags at 0.7; 0.4–0.6 is no judgment.typesafe-adblock removes at P ≥ 0.70.unclutter hides only when selected-choice p and TypeSafe confidence are both ≥ 0.9.hotchpotch/jev-reranker defaults relevance_rerank at 0.2.shinpr/jev-reranker filters at 0.5.jcm-router keeps Claude Code’s model below 0.7 and reuses a follow-up at Noul ≥ 0.55.pi-jev-router auto-loads skills at p ≥ 0.8.Jev-Auto-Router falls back at confidence < 0.55.cv-screen sends a Noul in 0.35–0.65 to a person — 0.5 is a coin flip, not a medium intensity.pagegrade 0–4 numbers are rubric positions, not confidence; × 25 is just a 0–100 display.Foreman steers or stops at 0.80, verifies at 0.65, finishes at 0.75.uehaj semgrep defaults -t 0.5;nlgrep defaults 0.8;jegrep cascade uses the last -t value, default 0.20.hermes-jev-approvals escalates at self_advocating ≥ 0.6 and denies when secrets + outbound are both ≥ 0.7.omo-jevlike-router fails open after 2.5 s — and it is a local clone, not hosted Jev.jev-pruner keeps a chunk at keepThreshold 0.5 or any score above 0.1.jlink defaults to 0.5.Yoshi omits only when both loss Nouls are ≤ 0.2.jev-canvas acts at is_command ≥ 0.5, action ≥ 0.55, complete ≥ 0.6.jev-browser stops at goal or stuck > 0.85.pi-fast-jev-compaction keeps at 0.5.mastra-jev-moderation blocks at Noul ≥ 0.7 and fails open.huncho pages at enter 0.8 and holds until exit 0.6.hono-jev-router matches at 0.5; the Nouls do not add to 1.kierandotai/jev-scout gates on a 0–2 scale (default 1.0) and fails open.fast-dev-compaction and pi-jev-compact keep at 0.5; the latter’s prose gate is 0.3.sqlite-jev scalar jev() defaults to 0.5; keep the cutoff in SQL.pg-jev also defaults to 0.5, but batches 20 — the author measured accuracy dropping at 40.jevsql jev_decide reviews 0.1–0.9;jev_choice_prob_gate defaults 0.8.TheoOliveira/pi-jev routes tools at 0.65 and gates at 0.70.jkudish/jev-mcp auto-accepts verify at 0.8; screenblock_at 0.75 is advisory.skillbox returns an uncalibrated 0–4 rubric and keeps scores ≥ 3 — that is not a TypeSafe probability.duckdb-jev bills one request per row (sixteen at a time); the cutoff stays in SQL.jev-tree keeps each Choice at or under 255 (default 32) and treats a failed walk as unavailable, not a guess.winnow hides only below 0.1 and keeps the uncertain band through 0.5; errors are never hidden.jev-skill-suggester reviews at fit ≥ 0.80 and Choice confidence ≥ 0.65 — exploratory, not a calibrated accuracy.Elixir jev puts those cutoffs in handle_answerguards (examples: 0.5 / 0.85 / 0.6).LitJev probabilities are uncalibrated by default.Von reports confidence as P(top)−P(second) — not TypeSafe peakedness.jev_stock author: a 0.68 is not a 68% historical win rate, and confidence is not a calibrated chance of being correct.jev-ood-calibration on hosted Jev: Choice/Score overconfident on an unknowable rule (refit T 3.3–3.4); boolean underconfident (T 0.66). Do not threshold the separate confidence field — it was never better than max-p on those sets. One OpenBookQA item assigned 0.00 to the correct answer with confidence 0.99.4esv/jev-eval saw identical inputs flip the label on 1.7% (intent) and 3.3% (sentiment) of items — pin a version, then measure determinism yourself.s1_ruby keeps the probability and collapses late (undecided?) instead of treating a bare answer as a decision.zod-jev defaults to t = 0.95; lowering it widens auto-reject (p ≤ 1 − t), and unavailable never passes.jev-voice-browser ignores below is_command ≥ 0.5 and waits until complete ≥ 0.6 (or 900 ms of silence) — pin jev-1.13.0 before you reuse T.jev-dsl names three floors (lenient / careful / strict); the tag is not an ACL, and a doubt is not a no.perch min: 70 is the author’s lint floor, not a TypeSafe cutoff.jev-shell-history fuzzy mode uses 0.5 / 0.3 / 0.9.killmyidea writes KILL / FIX / SHIP at 50 / 65 and withholds a verdict when understandability is below 0.3.semdecide default predicate threshold is 0.7; exit 3 is the uncertain band.jev-codex-router logs confidence but does not treat it as P(the routed model finishes the task).Canny reports a broken rule above 0.9 and treats a message as “not done” below 0.1 — Jev can only relax the done-gate.jevlogs retainBelow defaults to 0.1.Sponsor Skip skips at ≥70% and cuts a phrase only at ≥80%.jev-eval-agent blocks respond_to_user when done is below JEV_DONE_THRESHOLD (default 0.5).SlidePilot starts rehearsal at 0.68 / 0.65 / 0.55 / 0.30 — still-explaining is a hard veto.agent-router exits 3 when confidence is low on a consequential task — there is no fallback if TypeSafe is down.vibecheck forces Sleep on it when any bad metric is ≥75%.jev-behavior-study saw 95/108 when the correct Choice sat first and 62/108 when it sat last — order is an evaluation variable, not a reliability guarantee.commit-sentry blocks a leak at ≥70% and a risk score at ≥3.5.jev-shell-guard never blocks on the Choice alone — a block Choice with P≥0.60 only confirms unless a Noul also fired.inbox-blitz sends a category to a human below 0.7 and an intent Noul only when ≥0.5.jev-lint raises a marker at Noul ≥0.60, or a warning/error Choice ≥0.55 if any Noul is ≥0.15.agent-assist autofills a macro only at ≥0.6.log-sentinel treats an event as actionable at P≥0.5.ModStream routes self_harm ≥0.5 to care — never a ban — and re-decides the last 500 stored judgments when you drag a threshold.jev-voice-turn fires at turn_complete ≥0.85 plus 250 ms pause; below 0.35 the silence fallback stretches 2.5×.jev-ax-pilot ends at goal_reached > 0.8; a weaker done can press a runner-up ≥0.12.jev-dispatch merges at duplicate ≥0.6 and falls to a keyword heuristic below category 0.3.jev-firehose puts mods at needs_mod ≥0.60 or harassment ≥0.50, and a spoiler shield at ≥0.80.jev-instant-search gates intent at ≥0.45, cheap/premium/gift at ≥0.6, and inferred sort at ≥0.5.jev-launcher lights the green ↵ at ready ≥0.6 or one target ≥90%; a group row needs P(all) ≥0.5 and match ≥0.6.jev-swarm applies move only at ≥0.12 and boost only at ≥0.6 when the cooldown is ready.jev-tower shows an H on handoff above 0.5 and falls to the rule autopilot below its confidence floor.Fern puts a Who owns this? chip when owner confidence is below 0.6.nl-palette lights Enter at ≥0.55 and asks for confirm when is_destructive ≥0.5.JevPip treats confidence as a gate, not a measured win rate.JevChat accepts a reply at responds ≥0.80 and grammatical ≥0.5.jev-demo-router auto-dispatches at ≥0.75.jev-demo-guardrails sent a 37% action to review.pi-prompt-enhancer marks a Noul below 0.5 as missing.jev-demo-screener advises human review when recommend confidence is below 0.6.jev-demo-rag keeps a chunk only at relevance ≥ 2 and injection < 0.5.jev-demo-logictest colors ≥70% / 30–70% / <30% in the UI — those bands are not model output.hipporoute-jev-codex falls back to Sol below a 0.5 confidence gate.Jevalyn adds Noul certainty as distance from 0.5 — that number is the gem’s, not TypeSafe’s. Official Noul has no confidence field.pi-jev-permit allows only at p ≥ 0.6; no answer is a block.jevcore defaults minConfidence 0.7 and minProbability 0.6.NRS Navigator uses confidence as peakedness, not legal correctness — a high number does not mean the statute is right.minhgv/jev-mcp defaults AUTO_ACCEPT 0.8, REVIEW_AT 0.5, BLOCK_AT 0.75; ci-shadow never blocks the pipeline.arunav25/jev-mcp notes verbalized LLM “confidence” piles on 0.8 / 0.9 / 0.95 — and that a 2-point accuracy gap at 15% disagreement needs ~3k labels (McNemar).jev-receipt-classifier holds a category below 0.7 for 要確認.TheWayWithin/jev-bench treats confidence as a coverage dial — author 0.95 keeps 57.1% and is wrong on 4.2% of that slice.jev-first-look saw an all-wrong Choice still pick shipping at 0.60–0.62; addingnone_of_these made that option 1.00.jev-triage defaults actMin 0.6.LogiPulse routes on Choice confidence (0.90 / 0.60) because official Noul has no confidence field.the UiPath AML demo caught one miss at ~0.50 without disturbing a correct call — n=12.jev-spec README “0.85 means 85% true” is not TypeSafe docs.JevGuard flags AMBIGUOUS_STATE when top p is below 0.40 or the margin is below 0.15 — the wrapper’s rule, not a TypeSafe SLA.jev-ultralightspeed triage(keep=0.8) is the author’s packer, not official confidence.rh-guard blocks a deny-kind Noul at 0.80 and never lets Choice or Score cancel a structural deny — the author’s envelope, not a TypeSafe SLA.fast-decision leaves thresholds to the host agent.wellposed saw a closed Choice pick the wrong label at confidence 1.00 — gating on confidence cannot catch a forced pick.jevgate uses 0.2 on five unknown-verb Nouls.JevLint defaults 0.8 on a file-level Noul.gudcks0305/jev-java leaves atLeast(0.90)to the caller.Tangerg/typesafe-sdk-go has no Yes() on Noul for the same reason.JevShield can set min_confidenceso a low-confidence “safe” still asks a human.Auto-Guard escalates when Jev is unsure or unreachable — the author’s envelope.openlayer-ai/jevals gates default fail-open if the backend stays down; passon_error="block" for irreversible actions.anilsenay/jev exposes Sure(threshold)— that cutoff is the author’s.tax-doc-classifier gates at 0.95 onformConfidence.typesafe-computer-use stops under--min-confidence 0.4.Simple Jev confidence is the largest option probability — not calibrated.openjev-sglang uses 1 − H/log(n), not TypeSafe’s field.daseinlabs/open-jev uses the same entropy shape and warns it is an approximation.jevon --min-confidence is the author’s — rewording moves every probability.jev-on-a-laptop confidence is raw softmax — the 7B was >0.90 confident on 13 of 20 wrong fields.Nimble says 0.9 is not “right 90% of the time.”jev-sec-bench keeps the 0.70 / 0.35 cuts in Go — and found Jev under-confident on injection.jev-go says the same: thresholds stay in your code.Distill needs 0.55 to hand a call to the Worker and 0.40 to change effort — fail-open if Jev is down.TipTour has no cutoff: the top-ranked click just runs.quackd compares confidence to a per-verb floor (0.60 in the grip-check stub).wondertwins found confidence only weakly tracks chess blunders (Spearman −0.24).jev-robot-control says Jev bars are not P(the apple lands).jev-playground says option weights are not win probabilities.SmartMoney-Cub reports ECE 0.1464 on a toy suite — still not a trading signal.thijmenkam ECE 0.067 is four small tasks.PadFlow auto-posts above 0.90 — that floor is PadFlow’s, and the Jev row is still empty.LFM2.5-350M-RLCD scores are raw log-likelihoods — no calibrated API.pngwn fits T=1.75 on val (ECE 0.135 → 0.044) — that temperature is the author’s.LFM 2.6B sets calibratedto false.system-one-mini temperature scaling worsened ECE 0.1273 → 0.2673.eve-rlcd held ECE ~0.021 — it did not improve calibration.jod defaults Noul to 0.5 on the schema.super-jev permit floor 0.80 is the author’s — the hard rule can refuse before any call.jev-shield review 0.35 / action 0.7 / severity 2.0 are the author’s.Jev4Mellea accept_at 0.90 / reject_at 0.10 are the author’s — uncertain is never a silent pass.judging-with-typesafe treats 0.30–0.70 as uncertain; an 8-run spread 0.004–0.014 is the author’s.n8n-nodes-jev Low Confidence 0.5 is the author’s.jevmetrics keep 0.70 / drop 0.30 are the author’s.qualm defaults to 0.7 and calls that bar arbitrary.jev4k band() 0.30/0.70 and isTrue(0.7) are the author’s.jev-lens GREEN 0.9 / UNSURE 0.6 / FILE 0.6 are the author’s.binnash isYes() defaults to 0.5.pydantic-jev-examples uses 0.75 on the input guard.jev-gates edit 0.8 / done 0.4 / claim 0.7 are the author’s.rashedInt32/jev-mcp act 0.8 / review 0.5 / yes 0.7 / no 0.3 are the author’s.jev-reach marks done at 0.85.jev-php-sdk uncertain(0.8) is the author’s, and Noulconfidence() is distance from 0.5.Ying-Kai jev-browser 40/42 is one author’s bench.jev-playwright-mcp injection 0.5 / prune 0.35 / destructive 0.6 are the author’s.clarity-judge flags at 70%.typesafe-ui labs are fixtures — a visual live state is not a Jev call.Loki Autorouter is first-task only, then sticky.askjev act 0.6 / destructive 0.85 are the author’s.jev-recall 0.5 is the author’s keep floor.jev-sentinel 1.3 / 0.3 / 0.8 are the author’s.BorisLeMeec P@1 0.96 / ask precision 1.00 / hook 50/50 are the author’s benches.typesafe-skill-router gate 0.30 / fits 0.40 / fits_margin 0.15 are the author’s.iefnaf/pi-jev keep 0.5 / minReduction 0.15 / cheap ≤0.5 / strong ≥1.5 / confidence 0.6 are the author’s.patdown 0.85 is the author’s violation cutoff.omp-jev-compaction keep 0.2 is the author’s — same number as LiteLLM, not tamaratran 0.5.clear-head 0.5 / 0.7 / 0.7 / 0.6 / 0.3 are the author’s.git-jev-stage 0.6 is the author’s include/exclude floor.jevex 0.35 is the author’s stop floor.construct-auto-classifier 0.6 / 0.7 and the 0-dangerous cert are the author’s.jev-skill-gate nameOnly 0.15 / on 0.60 are the author’s.jevprune 0.3 is the author’s keep floor.pijev 0.8 is the author’s briefing floor.todo-jev 0.70 / 0.50 are the author’s routing floors.JevPromptCoach puts several check thresholds below 0.5 — the author’s.jev-pref 0.8 / 0.7 are the author’s gate and advisory floors.jev-pr-labeler 0.75 is the author’s abstain floor.jev-skillful holdout recall@K 0.600 is the author’s and misses their 0.90 target.switchboard 0.5 / 0.1 are from their table, not cookbook 0.8 / 0.4.jev-harness 0.55 is the author’s review floor.typesafe-local shows confidence 1.000 can be an option-order artifact.system-one-gemma 64.4% / ECE 0.047 are the author’s.pi-agent-foreman 0.5 is the author’s unfinished floor.jevegis 42/42 is the author’s labeled eval.jev-phishing-bench 62.6% / 81.3% / 91.8% / 95.0% are the author’s.jev_local confidence is peakedness, not a calibrated accuracy.lucianfialho/jev-model-router 0.5 is the author’s classifier floor.lomeshdutta/skill-router 0.45 / 0.50 / 0.85 are the author’s.typesafe-mod 0.6 / 0.75 are the author’s.TypeSafe Code Guard 0.25 file reject and 0.70 / 0.65 / 0.70 / 0.75 audit floors are the author’s; a one-file hit hardcodes confidence 1.0.jev-engineering 0.90 / 0.10 / 0.45 are the author’s; a 0.8 attack floor escalated 58% of their clean traffic — the author’s.Mandrilsquad −49% / 342/342 are the author’s 42-task table.jev-organize 0.6 review line and 98%/96%/88% on 61 files are the author’s.jev-predict-skill 0.65 breakdown floor is the author’s.omp-typesafe 0.20 / 0.45 / 0.75 are the author’s.stepwarden 0.6 / 0.9 are the author’s starting points.agent-handoff-gate 0.80 is experimental, not TypeSafeconfidence; 38/40 is the author’s.check-risk 0.8 / 0.2 are the author’s; the score is a policy index.Frost 104–145 ms and the $0.000084 list-price estimate are the author’s.hermes-jev-router 0.8 is an uncalibrated starter.jev-builder-loop 1/9 → 6/9 is the author’s; argmax 9/9 includedship_or_mergeat 0.29.jev-firewall ask_below 0.7 is the author’s.jev-judge does not choose a threshold.hermes-jev 419 ms / $0.000095 is the author’s four-call note.thiago-ss/jev-review 10/10 synthetic match is the author’s; certainty never authorizes approval.omp-jevens-classifier 0.80 / 0.50 are the author’s; argmax is not a decision.pi-jev-code 0.80 / 0.90 / 0.85 are the author’s.twilwa/pi-typesafe 0.95 / 0.80 are the author’s.taste-lint leaves uncalibrated AI rules advisory.typesafe-demo-mcp 53/47 at 0.29 is the author’s smoke.typesafeai-review 0.5 / 0.6 blocker floors are the author’s.zcode-jev ≥0.9 / ≤0.2 are the author’s; 70–500 ms is expected, not measured.hermes-jev-skills 0.4 s / $0.00006 are the author’s table.x-scanner 174 ms / $0.000038 and the 75% Noul floors are the author’s.live-jev 0.45 / 0.6 are the author’s. Notokinaaudio/live-jev.jev-ego 31.6 s is the author’s flights run.AskJev 0.65 is the author’s Guard floor.aside-jev 0.7 is an example; 0.540 ms is localhost transport.vinilana/jev-browser 0.55 / eval 0.70 are the author’s.computer-use-jev 0.5 is the author’s.kyrylo jev-browse 0.8 / 30/30 / 4.4 s are the author’s.jev-mail 9¢/1k is the author’s.jev-windows-voice 0.55 / 0.6 / 0.45 are the author’s.YT Time Saver 0.6 / 0.5 are the author’s.tontoko/jev-browser 0.8 is the author’s; that score is not assertion correctness.jev-frontend-qa 0.55 is the author’s.vmendes jev-shield 85% is the author’s.JevOnly risk ≥ 0.5 and 20 / 80 / 30 s are the author’s.MCode Jev pack 9.79 s is the author’s smoke.Otto shows model confidence as a score, not a guarantee.jev-turbo done > 0.85 and unsure < 60% are the author’s; 30/30 / 10/10 / 15/15 are the author’s.ThinkyMiner Winnow 0.4 / $0.0015 / 80% are the author’s.jev-ra 25/25, 2,714 ms 8.50×, and budgets 40 / 80 / 120 are the author’s.Barrunto Low–Ultra sensitivity relabels without a new call.Cerebellum-2B 94.92% / 81.10% / 25.2 ms / Brier 0.0271 / escalate ≥ 0.50 are the author’s — not TypeSafe evals.jevcumber 0.6 is the author’s.psearch 0.5 is the author’s.Mahmoud/jev-browser 32/33, 1.8 s, 1.5×, and 0.3 / 0.5 are the author’s.Page Verdict 0.75 / 0.50 / $0.0001 are the author’s.CorieW/JevTest 250k / 80 are the author’s.tylergibbs1/sift 0.85 / 0.6 are the author’s.Sloppy Jev’s 50% is the author’s.jeff 75.5% / 66.9 / 151 ms are the author’s — not TypeSafe evals. NotAlurith/jeff.kevinbadi/jev-voice 0.35 is the author’s.invalidate 89.2% / $0.00006 / unsure → review are the author’s.jev-mail-classifier 0.7 / 0.9 are the author’s.hev/reranker 0.768 is the author’s.AI Elo Ranker K=48→16 is the author’s.jev_antispam_bot 0.90 is the author’s.Mintzs/jevify 26.1× / 90.0% / 167 ms are the author’s — Jev was not benchmarked.SmartSwitch 1 s fallback is the author’s.jev-cvss 0.5 is the author’s.JEV Document Classification 0.75 is the author’s.jevibe-check 55% is the author’s.commentcop 159 / $0.008 are the author’s.jev-audio-beeper 0.72 is the author’s.JevTicketRouter 0.75 is the author’s.Emoji Jev 100 ms / $0.0002 are the author’s.Mimicry 0.80 / 0.05 are the author’s.pkg-gate 0.50 is the author’s.Scam Shield 9/9 0/7 is the author’s smoke on tuned samples.typesafe-comment default thresholds are the author’s.triage-guard 0.6 / 0.66 / 0.35 / 0.70 are the author’s starting points.EmbodiedJev Jev two-run table is the author’s.mario-jev 0.5 is the author’s.Askable arm ~1 s is the author’s.jev-tetris (trungdq88) ~220 ms / seed-42 samples are the author’s.OneVOneJev ~9 Hz is the author’s.JevBall $0.0051 / 366 ms / 44% are the author’s.gg-friggin-ez 97.6% / 0.3 / 0.55 / 0.7 are the author’s.jev2048 (erhanmeydan) 884 / ~300 ms / $0.006 are the author’s.弈瞬 2∶7 / 6∶3 are the author’s recorded games.jev-play-ping-pong 11–0 / 325 ms are the author’s.jev2048 (KyleKreuter) is a Choice lab, not a solver.tsai-civ2 has no verified victory.TypeSafe Minecraft demo 2,266 / 991 s are the author’s.Agent-JEV-Tetris 14,300 / zero holes / ~310 ms are the author’s.BeatJev 0.5 and derived confidence are the author’s.casse-brique-typesafe 5% / ~90% are the author’s.Cyber-Breach 5–10 Hz is the author’s.jev-gomoku (mizchi) ~0.5 s / $0.0024 are the author’s.Jev Snake 1.5 moves/s is the author’s.jev-tetris (ML-Nerd) local planner is not Jev.pong-jev 7–4 / 21–3 / 379 ms are the author’s.ps2-ai-agent default 0.95 is not Jev.River Oaks 750 ms / 15 batches/s are the author’s.River Run ~8 req/s / ~115 ms are the author’s.RoverLab 253.2 s is a scripted check.SIEGE 33%→100% / 0.9 floor are the author’s.snake-jev 29/461 is the author’s.Terrarium 100–400 ms is the author’s.typesafe-chess ~350 ms / 25 cp / 2–0 are the author’s.Instinct 5 free generations is a cost cap, not security.IntelliPrompter 1.5 / 236 ms / $0.0011 are the author’s.jev-notion ≤2 s / ≥60% are the author’s.jev-got inFiction < 0.5 is the author’s.GPT vs JEV 2 live runs / 24 h is the author’s.guard-jev 10 req/min is the author’s.jev-pii-checker 0.5 / 0.8 / 22/24 are the author’s.jev-cloud-quiz 30 questions are the author’s.The Council room-division 100 is the author’s game score.human-compiler 0.50 dialect fallback and 4000 chars / 20/min are the author’s.Jev Data Analysis 71 plays is the author’s fixture.Jev CSV Workbench 20 / 25 / 3 and the 24 h cookie are the author’s.jev-demos 0 mazes / 35–46% / 6/10 are the author’s.jev-dev difference-sum max 16 is the author’s.Jev Paper Judge 0.6 / 0.3 routing, 12 papers/min, and display 65 are the author’s.Job Risk Analyzer 0.82 / 0.115 is a mock sample, not Jev.Probably 15 s / 60 s / 12 samples and the 60 s cooldown are the author’s.typesafe-image-diffusion 57k / 39k tokens are the author’s.razorback16/openjev 10.7 req/s / 94 ms and the MLX times are the author’s.reflex 1.000 / 0.917 / 0.685 / ECE 0.081 / ~200 ms are the author’s.Jev Capability Atlas 0.90 / 0.97 history pair is the author’s.jev-as-a-judge 100.0% / 0.0000149 / $0.00035 / 0.44 s are the author’s.open-alternative-jev 92.9% / 4.55 q/s are the author’s.sgoedecke/system-one 600 ms / 172 ms are the author’s.jev-column-race 4.576 s / $0.0225 / ρ 0.803 are the author’s.system-one-open 76.7% / 97 ms / 95.4% are the author’s.TypeLLM 9.35 s / 1.61 s / 5.8× are the author’s.jevfire 496.9 ms / 10.29× / Mario 71.26 ms are the author’s.jev-rag-benchmark 99.425% / $0.410866 / 532 ms are the author’s.jev.nu 4 s / 0.4 s are the author’s.jev-lm 0.25 s / 6.92 bits/token are the author’s.claude-jev “roughly 150 ms” and real < 0.5 / already_handled ≥ 0.7 / reachable < 0.4 are the author’s.Little Airways ~150 ms / 0.70 give-way / confidence 0.04 are the author’s.realZachi/jevtest default min 0.85 is the author’s.mcts-agent prune ≥ 0.8 / stop ≥ 0.85 are the author’s.jev-codes 6/6 / 0.909 / leftover_debug 0.75 are the author’s.jev-exploration ECE 2.1–2.5× / p≥0.9 1.000 are the author’s — not a TypeSafe calibration card.jev-for-engineers 1.91 / 0.01 BOM pair is the author’s.jev-mode −77.8% tokens / 96.10% / gate 0.8 are the author’s.jev-oas-sentinel 0.65 / 0.90 are the author’s.larguesa/jev-search 29/34 / $0.000639 / 0.536 s are the author’s.jev-starter 0.9 / 0.65 are the author’s example.JevGPT completeness noul 0.9 and 60-word floor are the author’s.siftr SWE-bench 82% / read 92% / pick 81% are the author’s.tenbin 650 ms / $0.00002 / 20M-token budget are the author’s.trade-jev 0.7 cutoff / 4 agreeing / 200-stop / 100-target are the author’s — fitted on the same 15 days.ZeroSweep Human Review below 0.85 / ~220 ms / $0.0004 are the author’s.DecisionBridge threshold 0.8 / 29/32 / 3 accepted errors are the author’s local MLX pilot.jev-agent-failure-benchmark 73.4 / 23.7 / ECE 0.287 / $1.28 are the author’s.carryforward 0.60 full / 0.30 one-line are the author’s exported constants.hemanth/jev-chess resolveIntent 0.6 is the author’s.jev-labs identity floor 0.042 / ECE 0.075 / 0 wrong are the author’s.jev-reward-model-evaluation 92.58% / Precise IF 50.63% / $3.19 are the author’s.jev-routing-experiment 62.4% matches the no-Jev ablation; 69.5% / 311 ms are the author’s.jev-synergy-screening Noul gates 0.5 / full 94.6% / H2H $0.0065 are the author’s.kyotsu-ai-bench 534 / 523 / $0.026 are the author’s — not a TypeSafe exam card.openjev-experiments 0.8727 / 0.8985 are the author’s local NLI numbers — not TypeSafe Jev.typesafe-vs-deepseek ~150 ms / 91% are the author’s.jev-alpha-bench +0.24 pub-day / −0.008 tradeable / −18 bps are the author’s.jev-anotacao-sentencas 96.6% / 0.32 s / $0.25 are the author’s.jev-deferred-crispification 70× / ~2 min are the author’s — v1.2 withdrew 25–60×.jev-headline-bench 64.5% / 74.7% / 0.80+ → 78.5% are the author’s.jev-jp-address 39/40 / 89% / review 0.7 are the author’s.jev-pick-and-place-study 10/10 / 146 ms / $0.0035 are the author’s.jev-report 86/90 / ECE 0.070 / 0.80 gate / $0.0046 are the author’s.jev-shadcn-lint-eval 91% / 82% / 1.41 / 0.7 are the author’s.jev-trace-classifier 0.741 / 830 ms sit below 77.6% majority — the author’s.shade-arena-jev-monitor 0.97 / 12/13 / 1.5 s are the author’s on 13 hand-built transcripts.thaiexam-jev-charts 70.7% / 0.35 s / $0.000029 / ECE 7.5 pp are the author’s.typesafe-oracles 0.389 gap / 0.70 → 95.9% / 94.4% / $0.082 / 312 ms are the author’s — four claims were retracted.jev-skill Mode B labelsjev_called: false— those numbers are not Jev probabilities.fable-jev 70–120 ms / 80% / 0% / 84 ms / 1200 ms circuit are the author’s.LiteLLM JEV classifier 5.43× / 96% / 95.00% / 126.81 ms / 688.40 ms are LiteLLM’s — expected tiers were authored without independent review.jev-physical-ai 91.3% is template agreement, not production accuracy.Jev-sample 48.3% → 98.3% is question shape on labeled scenarios.savka777/jev-use 0.3–1.5 s/step is the author’s loop timing.jev-gateway 712 ms is README key-check copy, not a bench.SystemOneHarness 5/5 / $0.000208 / 0.98s stay with the author — the README says they do not claim ambiguous state.pZacca/askjev 42/42 / 16/16 are the author’s first eval.philippdubach/pi-jev-router 5/5 $0.1993 is five tasks with classification overhead excluded.davila7/jev-explained ~100 ms is README copy.jcr 85% / $0.3700 → $0.1222 are one-run lookup averages, not task-execution accuracy.jevvy 0.35 / 0.50 are the author’s calibration.oxlint-plugin-jev example cutoffs 0.8 / 0.6 are the author’s.tiab-review-plugin 96.1% Recall / 36.9% Precision at threshold 0.3 are the author’s.Pi Jev Guard 0.90 / 0.85 are uncalibrated starting points.tripwire 0.85 / 0.80 are the author’s defaults — no accuracy vs real Jev yet.triagedy ~200 ms is README copy; OpenAI-backend confidence is uncalibrated.jev-rules 0.6 / 260–520 ms / 1,390→330 are the author’s.compact-adviser 0.90→0.50 floor is the author’s schedule.jev-pong 227 ms / 400 ms / 222 ms / 288 ms are the author’s Gateway runs, not TypeSafe SLAs.lurk 0–100 is product-side, not a Jev probability.RoboJEV Wilson 72.2–100 / 49.0–94.3 are the author’s ten-seed intervals.doc-router 1.72× / 1.74× / 2.5% are the author’s 2026-09-17 bench.live-jev (Ableton) 20 ms / 10 ms are local Remote Script times, not Jev.abide 0.8 / 0.5 bands and ~300 ms are the author’s.macbrow ~300 ms is README copy.jevscan-evm 70 / 50 / 30 bands and 0.7 s / 0.015¢ are the author’s.crush-monitor affection total is product-side, not a Jev probability.ST-jeved 3 s / 2 s waits are the author’s; late calls fail open.pi-jev-router (sugarforever) 0.6 / ~0.5 s are the author’s.orchestkit 0.8 / 93.5% / 0.5 floor are the author’s.pi-fabric 0.50 auto-approval is the author’s; secrets and destructive must stay below 0.5.agent-dispatcher 0.80 / 358 ms are the author’s; auto fails open.jev-social does not execute a low-confidence decision.hermes-web-search-plus 0.95 news confirm is the author’s.JevSeek / JMP 0.225 s / 30/30 are the author’s small studies.WrongStack brain conf ≥ 0.75 / p ≥ 0.7 / decidable ≥ 0.4 are the author’s.jevkeep leaves native compaction running when scoring fails.open-jev-approvals 0.70 deny is the author’s; Jev down allows.forma-system1-experiment 0.8–1.6 s / $0.0005 are the author’s.jev-tool-router 0.90 is the author’s; below it returns the full list.jev-stage 170–300 ms is the author’s.jev-browser-pilot 15/15 / 349 ms are the author’s; a transport failure is an error.newsscore 310 / 97.1% / ~15 s are the author’s.jevlens falls back to LOCAL when Jev fails.beat-jev 850 ms save window is the author’s; late cannot save.filedcom/playjev 8/8 / 0.91 s are the author’s.decide-mcp does not treat Jev confidence as a choice percentage.jev-resume-disqualifier Sub-25ms / $0.0001 are README copy, not a measured SLA.tenet fail 0.8 / 1.1 s / $0.0022 are the author’s.trading-bot-jev news bias is at most ±0.5%; Jev adds nothing measurable on prices — the author’s.github-star-organizer-jev confidence is the probability distribution, not classification accuracy.jev-flash-router ~150 ms is the author’s.picaye/jev-compaction keep threshold 0.5 is the author’s.pi-jev-helm 0.75 fail-open is the author’s.typesafe-jev-examples 0.60 / 0.85 are the author’s.jev-dspy-lab 0.7 gate / 0.913 are the author’s; the synthetic fixture is not model quality.kiarina/labs 205–215 ms / 0.5 moderation / 0/43 danger-as-safe are the author’s.JevArena (rolki) Jev fail is BLOCKED, not a Demo fallback.pi-fast-jev-compaction (QuentinDanblon) keep threshold 0.5 is the author’s.jev-review-action file-selector 0.5 is the author’s; recommended is advisory.jevframe does not threshold or silently renormalize.jevcache (kushals256) intent 0.93 / 3244 ms → 394 ms are the author’s.jevcheck fails an upgrade on answer flips or confidence drops.cursor-clijev-compaction keep 0.5 is the author’s.dsh-jev-tools screen 0.75 is the author’s; 8/8 is not accuracy.how-sure-is-jev 72-question / max_prob match are the author’s, not an official TypeSafe formula.ProgressGate 0.42 materialProgress is the author’s.jev-issue-radar 0.8 duplicate floor is the author’s.jevtriage ready needs official confidence ≥ 0.8 (author’s).leanest low confidence means RUN.jevassert ECE / Brier are from a recording, not a live call.jev-packs 0.979 / 8/9 calibration are the author’s.moongate 4-of-10 near a 0.90 gate is the author’s.agentic-harness-cli treats provider confidence as uncalibrated until project evidence.typesafe-screening-mcp 0.7 / 0.3 are the author’s.qingliu 0.7% false-positive is the author’s.dspy-jev GEPA 100 / 96 are the author’s.linkedin-noslop has no validated accuracy figure.slop-filter weights are fit from your labels.diff-risk-sentinel 52% / 66.7% are the author’s.jev-browser-qa 0.7 / 0.55 are the author’s.shipit-gate 0.5 / 0.7 are the author’s.jev-outlook-organizer 80/80/70 are the author’s defaults.survey-qc-with-jev 92.8% PASS is the author’s policy.dsh-jev-guard 0.5 / 0.7 / 90.4% are the author’s.DriftLab 0.65 is the author’s.rocky 0.45 / 0.5 / 0.8 are the author’s.jevseo 0.55 is the author’s.lgtm 16k / 347 are the author’s.jev-adrank +29% is the author’s simulator.openclaw-tool-prefilter 0.35 is the author’s.jev-board-game offline ECE is not Jev accuracy.semantic-live-caption 0.55 / 0.12 / 0.70 are the author’s.approval-judge-bridge 0.65 / 0.30 are the author’s.whoa has no labelled judge corpus yet.jev-debtgate 0.85 / 0.5 are the author’s.rspamd-jev 0.9 / 0.9 are the author’s and never change the score.whatitdid 0.88 median top-1 is the author’s.JEV-TheFishGame ~300 ms is the author’s.jev-android DeepSeek confidence is not a Jev probability.jev_playground 0.37 vs 0.71 framing flip is the author’s.rag-jev 0.5 support gate is the author’s.dynamic-context-engine 0.5 cutoff is the author’s.jev-crawlers P0.8 is a rank, not calibrated confidence.jeffrey 0.5 / 0.6 are the author’s.public-browser 20.2 s / $0.0012 are the author’s n=2.clash-jev ~250 requests/match is the author’s.jev-voice-control ~0.5 s / $0.00002 are the author’s.actionreflex 89.3 / 260 ms / $0.19 are the author’s.codex-cua-jev risk ≥ 0.2 is the author’s.jev-ads-analysis ±0.33 confidence drift is the author’s.kaustav1996/reflex ~400 ms / $0.00004 are the author’s.tegersdorfer-collab/jevkit 14/14 / 0.38 are the author’s.Jev-Checkpoint 0.95 is the author’s.JevRAG ~1 s / 40 candidates is the author’s.prasanthj/duckdb-jev 0.515 s / 1,943 rows/s are the author’s.loom 0.7 s / 13 s / $0.001 are the author’s.comment-opportunity-radar 0.45 / 2.5 / 0.65 are the author’s.jev-multimodal 91.15% / 1,104 ms are the author’s.is-jrecord 0.5 / ~6 s / 300–900 ms are the author’s.jev-ai-skill 95% / 17,947→944 are the author’s.jev-table 97.4% / $0.0040 / 8.9 s are the author’s.Talya1412/jev-harness 94.7% / $0.0006 are the author’s.jevi 29/30 vs 2/30 / 317 ms are the author’s.jev-in-mcp 6/6 / 4–10 s are the author’s.n8n-nodes-jev-classification Confidence Threshold 0.5 is the author’s.jev-wide 32,962 tokens / 0.7619 nDCG@10 / 7.3% are the author’s.coffee-under-fire 3,082 / 2,770 are the author’s.jev-newbie 65% / 35% are the author’s.jevtown 83–97% / 0.49→0.72 are the author’s.jev-downloads-sorter ~400 ms is the author’s.open-system-one 79.3% / 381 ms / $0.284 are the author’s.neurolink ~400 ms / ~$0.00002 are the author’s.home-assistant-typesafe 0.7 is the author’s.x-reply-filter 0.75 is the author’s.tidy 21–48× / 9 s / 110 are the author’s.pi-Jev-browser 22 scenarios pass is the author’s.jevmory 553 tests / 3/3 are the author’s.jev-field-trial $3.60 / 0.89 are the author’s.jev-browser-wingman 0.85 is the author’s.svitaTLCO/jev-skill ~650 ms / P≥0.70 are the author’s.jev-complete.nvim 0.7 is the author’s.cartpole-jev 49/53 / $0.0098 are the author’s.jev-wrapped $0.10 / 35–85 s are the author’s.jev-skill-router 6/6 / 3/6 / 0.7–1.6 s are the author’s.Jev-LLM-Playground 16/16 / 383 ms are the author’s.jevtok 0 mismatches / 403/403 are the author’s.jfind 0.7 is the author’s.jev-grand-prix 50.9 s / $0.06 / ~0.27 s are the author’s.pi-jev-effort ~250 ms / $0.000015 / 0.3 / 0.6 are the author’s.neuralint 45% / 75% are the author’s.feed-rubric 0.75 is the author’s.JohnsonRan/pi-jev 0.30 / 0.85 / 3/10→0/10 are the author’s.Jev-MongoDB ~300 ms / 0.5 / 0.7 are the author’s.jev-torneo-animales 1,999 / ~16 s / ~7.6 ms / ~$0.01 are the author’s.jev-hanko 0.40 s / $0.117 / 0.519 are the author’s.jev-agent-hooks 0.7 / 2–3 s / ~400 ms are the author’s.zm2231/skill-router ~$0.001 is the author’s.clay-jev-people-ranker 0.90 / 0.80 / $0.0206 are the author’s.jev-linter-action 0.8 is the author’s.ask-jev-series 0.5 is the author’s.opencode-jev-compaction $0.21/day / 0.35 are the author’s.jury.nvim 0.6 / ~1 s / 0.04 ms are the author’s.hermes-slash-router 0.85 is the author’s.jev-craft 1.6–3.7 s is the author’s third-party note.jev-wechat-live ~1 s / $0.0001 / 6/11 / 5/11 are the author’s.xinwang-nwpu/jev-mobile 0.62 / 512 ms / 31.7 s / 540 ms are the author’s sample.dsh-jev-verify 96.0% / 308 ms / ≈$0.001 are the author’s.ego-jev ~300–550 ms / $0.0005 are the author’s.fewhnhouse/jev-review-action 0.70 is the author’s.jev-mailroom 0.60 / 0.90 / 0.70 / 0.30 / $0.00024 are the author’s.okooo5km/jev 0.5–1 s / 0.3–0.4 s are the author’s.yibie/pi-jev-browser 7.1 s is the author’s.scam-checker-with-jev 93% is invented fixtures; $0.0001 is the author’s.mcp_typesafe 0.5 / 0.75 / 0.3 / ~100 ms are the author’s.jev-fetch 0.75 s / $0.000056 are the author’s.jev-folio-recursive-classifier 0.9 is the author’s.ibmi-jev 0.7 / 0.6 examples are the author’s.ActionJev 0.65 / 0.8 / 0.7 are the author’s.typesafe-ai-jev-example $0.00125 / 1.2–1.7 s are the author’s.jev-town ~650 ms / $0.0000065 / 94.4% are the author’s.cloudforge-jev 0.7 / 0.97 / 0.84 / 0.65 are the author’s.traderai ~$1–2/month is the author’s.imsukhe/jev 0.85 / 12/12 / 1.2 s are the author’s.gut 26% / 7.6% / 76% / 6.0 cents are the author’s and optimistic.totally-tim/jev-gate 0.8 is the author’s.sahajamit/jev-lens ~300 ms / 76%→86–91% are the author’s.jev-evaluation 123,805 / $12.69 / 12 of 25 are the author’s.jevrouter-prompt-tier-extension 0.60 is the author’s.k4its1t/jevlens 0.60 / 0.70 / 0.55 / 0.85 are the author’s.jev-acento −6.4 pp / $0.58 are the author’s.hermes-and-jev-play-minecraft 211 ms / 7:45 are the author’s.jev-harness-router 350 ms / 90.0% are the author’s.x-bookmark-sorter 0.60 is the author’s.gualican/jev-model-router 0.7 / 1.5 are the author’s.typesafe_agent_gates 27/27 / ~0.3 s / 0.5 are the author’s.themsquared/jev-benchmark 91.7% / 421.6 ms / ECE 0.0712 are the author’s.doceval 0.81 is example output; 0.7 is the author’s CI gate.pilot-typesafeai-jev 80/80 / 40/40 / 0.6–0.8 s are the author’s.system1-system2 0.875 / 0.9167 / $0.001205 / 319 ms are the author’s.jevmod $0.04/1k / AUROC are the author’s.jev-policy-engine DEBUG_JEV is not official.Mrribvar/hermes-jev-plugin ~200 ms is the author’s.dsh-plugin-jev 0.5–0.6 s is the author’s.cursor-jev ~100 ms is the author’s.jev-table-tennis ~350 ms / 47 px / 53% are the author’s.jev-measured $0.0000153–$0.0000226 / 27/27 are the author’s.jev-injection-bench 77.6% / ECE 0.058 / 290 ms are the author’s.profanity-checker 0.5 is the author’s.jeveryword 490 ms / $0.0004 are the author’s.dsh-jev-hook 0.85 is the author’s.demo-symfony-typesafe 1,000 / 25 s / 428 ms are the author’s.jev-flappy-bird ~100 ms / ~$1.50/hr are the author’s.claude-code-jev-compaction 0.2 is the author’s.zurfyx/jev-browser-skill 8.4 s / 2.4 s are the author’s.dsh-memory-jev 0.6 / ¥0.0006–0.0012 are the author’s.jevSweeper ρ −0.274 / 1/25 are the author’s.jevqa 22% of 107 / $0.29–0.41 are the author’s.jevlergy 84% / 1.5% / 0.8 s are the author’s.explore-typesafe-ai 24,557 / 4,722 / p50 317 ms / $0.26 are the author’s.jev-fastloop 4/5 / 8/8 / 0.64 s are the author’s.prompt-demux 22/23 / 360 ms are the author’s.grok-jev-router 536–580 ms / $0.0000465 are the author’s.jev-rust-review 43/48 / 47/48 / $0.0130 are the author’s.jev-eyes 1.5–2.5 s OCR is the author’s.jev-form-filler ~1.5–2 s is the author’s.jev-source-evaluator 168/177 / 11 of 46 / $0.04 are the author’s.Jev-Mem 0.777 / 6.6× / 36.7% are the paper’s.tempo-jev-demo 12× / 35% / 14× / 69% are the author’s.quick-decision-assistant ¥0.0001 is the author’s.Jev-chooses-a-LLM 0.70 is the author’s.Jevsus 45% wording move / $3.07 are the author’s.priorbench/jev 95.9% / 0.99 / 430 ms / $0.176 are the author’s.jev-vs-llm 87.01% / ECE 0.0671 / 95 zeros are the author’s.lkclean 70% / 35% / 60% are the author’s.jev-writer $0.31 / 0.99→0.71 are the author’s.fotocopiatrice 0.91 / $0.84 are the author’s.jev-reality-check 58/100 / $0.0017 are the author’s.Running-Dolphins/jev-bench 3/272 / 0.9 s are the author’s.jev-rag-benchmark +7.62 / 79.29% are the author’s.graphql-classifier 0.6 / 1.65 s are the author’s.jev-lateral-thinking-quiz 20/20 / 283 ms / $0.00003 are the author’s.jev-cite-check 97/100 / $0.0035 are the author’s.adaptmypage 300–500 ms / $0.00007 are the author’s.jev-market-reflex 199 ms / 0.55 are the author’s.Postmark 0.6 / 2.2 are the author’s.jev-kit 81.7% / 809 ms / $0.000601 are the author’s.stil-lint 692 ms is the author’s.tidy 150 ms / $0.0001 are the author’s.jev-calibration-audit 7,000 calls / 280 ms are the author’s.Jev-is-odd 20/20 / 294.3 ms / $0.00029098 are the author’s.jev-access-day 50% / 78% / 306 ms are the author’s.jevskill 18/18 / 99.3% / 292–320 ms are the author’s.Jev-Rug-Checker 0.58 is the author’s.everything-about-jev 0.55 / 0.33 are the author’s community-API result.jev-technical-term $0.02 / 2 h is the author’s.jevymarket 0.27 → 0.78 are the author’s.LocalSafeKidsEngine-Open 0.88 / 10–15 ms are the author’s local-SLM figures, not Jev SLAs.openclaw-plugin-typesafe-ai 70–150 ms / 0.75 are the author’s.brain-speeddial-eeg-jev 0.58 / 0.70 / 95.0% are the author’s.jev-decision-gateway 75 calls / 0.81 / 30.7% / 411.8 ms are the author’s.jev-vphone-cli 0.91 / 0.99 / 0.98 are the author’s README transcript.openclaw-jev-compaction 0.4–1.5 s / 18/62 are the author’s.tab-bouncer 1.6 s / $0.0022 are the author’s.jev-linkedin 68.5% → 79.3% / 1–2 s are the author’s.jev-cyrillic-audit 88.3% → 77.3% / ECE 0.032 → 0.096 / $0.19 are the author’s.jev-graph-walk 5/5 vs 3/5 are the author’s.jevoracle 2.5 / 80 points are the author’s.jev-preflop-poker 90.8% / 98.4% are the author’s.jev-field-tests 820 / 850 ms / 27/28 / ~$0.02 are the author’s.Linkedin-Slop-Detector 0.55 / 0.2–0.6 are the author’s.mailverdict 0.97 / 412 ms / $2.99 / ~$0.0002 are the author’s.opencode-intent-gate 0.81 / 0.97 / ~0.5 s / ~$0.00002 are the author’s.RCIL 85–90%+ / 0.69 / 1.97 are the author’s — a modeled ledger, not a live bench.opencode-context-pruner 530 / 257 / 1,135 ms / 0.15 are the author’s.jev-reranking 0.7535 / 0.2790 / $1.76 are the author’s.omp-jev-web 6,431 ms / 5.9 s vs 47.6 s are the author’s.jev-enterprise-decision-fabric 100/111 / 376 ms / $0.0000268 are the author’s.cartas-ciberseguridad-jev 17,779 tokens / $0.00075 are the author’s.typesafe-computer-use-windows 5.5 s / 2.243 s are the author’s.pi-jev-skill-picker 87.9% / $0.0016 are the author’s.LiveSignal 84.58% / 353 ms / 240/240 are the author’s.jev-lab (Pasblinn) 78% / 1% / p=0.99 are the author’s.jev-study ~1,430 / ~$0.15 / 0.50 / 1.32 are the author’s.jev-1.13-mini-benchmark 0.786 / 1.000 / $0.0011 / 0.41 s are the author’s.pi-jev-session-router 0.3 is the author’s — no live accuracy.jev-tab-grouper 456 ms / ~1s are the author’s.jev-domain-auctions 0.6 is the author’s.maestro-jev 0.8 / 0.35 / 30–60 s are the author’s.jev-master 0.53 / 1.0 / 0.99 are the author’s.claude-jev-warden 84% / 73% / 86% / 92% are the author’s.jev-test (clduab11) 15/20 / 0.75 / 49 / 3.5¢ are the author’s.battleship-vs-jev 46.0 / 48.3 / 85.5 are the author’s.skillpick 96.7% / 805 ms / $0.00076 are the author’s.minesweeper-jev 0.381 / 0.207 / 352 ms are the author’s.omp-greenlight 40.9% / 310 ms / $0.05 are the author’s.commitjev 18 / 4.3 s / $0.0019 / 0.65 are the author’s.pi-jev-approver 500 ms / 0.5 / 1.5 are the author’s.omp-jev-watchdog 10/11 / 173 ms are the author’s.pi-jev-skill-suggestion 0.30 / 0.40 are the author’s.Metis 0.8 / 0.85 / 0.9 are the author’s.jev-feed-filter 60% is the author’s.jev-router-playground has no published live accuracy.jev-x-blocker 0.55 / 0.35 / $0.6–1.2 per 10k are the author’s.FirstScreen has no published live accuracy.jev-tic-tac-toe 55.4% / 83.3% / ~94% / $1.09 are the author’s.jobbyjev 400 / 88 / 0.80 / 22.7 s / $0.028 are the author’s.cc-mod-jev 96% / $0.00033 / 503 ms are the author’s.jev-pacman 2,320 / 89% / 238 ms are the author’s.astra-jev-new-vegas 193.5 ms / 505.5 ms are the author’s.jev-corrective-rag 0.75 / 7.2× / 4.0× are stubbed.jev-plays-tetris 777 / 370 ms / ~3.6M are the author’s.jev-fanout 0.980 / 22 of 24 / $0.015 are the author’s.jev-lint (vayun) 99 / 1,267 / $0.0243 are the author’s.HighwayEnv-But-Jev-is-Driving 528 m / 26.7 m/s are the author’s.rag-jev (Emre) 75.13 / 42.5% / 56.8% are the author’s.typesafe-tetris has no published live accuracy.jev-hands 0.7 s / 0.65 / 496 ms are the author’s.FocusTube 0.82 is the author’s.jev-labeler-action 0.8 / 0.60 / 0.88 / 270 / 38 / 220 ms / $0.000066 are the author’s.jev-prompt-optimization has no published live accuracy.prompt2jev 23 s is the author’s.jev-vs-luna-phishing 81% / 66% / 0.42 s / $0.000037 are the author’s.PlotVeil 0.85 / 0.7 / 0.5 are the author’s.awesome-jev (AgentBuff) 853 records are the author’s.jev-screen-mcp 4.9M / $0.19 are the author’s.jev-review-mcp has no published live accuracy.jev-skill (abhishek) 84.1% / 100% / 38.0 / 17.3 / $0.12 are the author’s.mcp-server-jev (codeChap) is OpenRouter only.jev-decision-skill 330.73 ms is the author’s sample.jev-arcade 70 / 484 / 167 / 93% / ~500 ms are the author’s.JevSharp has no published live accuracy.jev-dev-harness 88%–94% / 280 ms are the author’s.vibecheck (psyb0t) is not deployable yet.agentic-rl restates TypeSafe latency claims.Jevons 48k / 24k / 8k bytes are the author’s.hippo-memory R@1 0.41→0.62 / ~$0.0004 are the author’s.jev-clinic-triage-eval 84.4% / 98.6% / $0.00083 / 116k are the author’s.jevgo (devbackend) has no published live accuracy.askgrep $0.0002 / 0.99 / 0.98 are the author’s.jev-symfony-bundle has no published live accuracy.astrbot typesafe autoreply has no live accuracy.evoke 0.85 is a README sample.awesome-jev-apps is a catalog, not a runtime.local-jev (amithgc) 80.5% / 651 ms are the author’s.AnyDecisionModel has no live accuracy.decision-backend-http discards wire confidence.jev-arm-lab 20/20 / 1.8 mm / 100% / Brier 0.030 are the author’s.jev-zork $0.0075 / 1,186 tokens are the author’s.jev-doombot ~60 ms / 2113 ms are the author’s.jev-telegram-channel-router has no live accuracy.jev-table-import-mapper 10/10 / 915 ms / $0.0012 / 0.75 are the author’s.jev-is-you 96 actions / 7/32/22/35 are the author’s.Jev-Flywheel 0.768→0.870 / +14 are the author’s.qqbot (Mist-wu) 0.6 / 0.35 / 0.3 / 0.1 are the author’s.commentlab has no live accuracy.jev-as-a-judge (sjyangkevin) has no live accuracy.jev-intent-review TypeSafe path untested live.lus222-jev-challenge 0.55 is the author’s.jev-hub (antTing) has no live accuracy.jevnav 8/8 / 41/41 / $0.00004 / 314 ms are the author’s.node-red-contrib-jev-decisions 30 s / 4 concurrent are the author’s.jev-perfume-advisor $0.002 / 21 calls / ~46k are the author’s.awesome-jev (BeatAPI) is a catalog, not a runtime.jev-mcp (Freepik) has no live accuracy.jevernetes 0.25 is the author’s cost cap.Jev.UI has no live accuracy.jev-calibrate 18/26 / 0.92 / 8.2 s / $0.00212 are the author’s.jev-skill-selection 0.45 is the author’s.jev-decision-lab has no live accuracy.jev-doom (olivier-motium) $15 / $0.05 / 90 s are the author’s.ormus-jev-cua-linux has no live accuracy.jevable-code makes no Jev call.japanese-jev-lint 0.62 / 0.56 / 0.6 are the author’s.herdr-jev-router has no live accuracy.jev-router-dashboard makes no Jev call.jev-chat-JARVIS ~1 s / 7 questions are the author’s.jev-benchmark (arifulislamat) $0.0031 / 6.9 s / 560 ms / 94% are the author’s.jev-spire-brain $0.000528 / 24 calls / 61 of 63 below 0.60 are the author’s.jev-lamplight-house 515 ms / 0.60 / 3.16 / 0.68 are the author’s.dsh-jev-adapter 0.85 / 0.5 are the author’s.jev-bench (cocodedk) 77.9% / 240/308 / 365.5 ms are the author’s.jev-esp32s3-gateway has no live accuracy.jevagent (Lilithys) 6/9 vs 9/9 / 0.70 are the author’s.Jev_model 0.17 / 0.50 / 0.96 are the author’s.jevish 86.0% / 99.0% / 100.0% / 0.05 ms are the author’s.jev-agent-control has no live accuracy.playground-Jev has no live accuracy table.awesome-jev (jtnkminimal) is a catalog, not a runtime.awesome-jev (robokrunch) 300 real API calls / 70–500 ms are the author’s.Awesome-jev-use (APA) is a catalog, not a runtime.decio 0.94 / 0.5 are the author’s.clue 2.99/3 / 290 ms / 2.98/3 / 262 ms are the author’s.Maybe 12 calls / 90 s are the author’s.jev-doc-classification 98%–99% / 83% / 70% / 92% are the author’s.worth-replying $0.40 / $0.04 / 1,000 tweets are the author’s.jev-team-calendar 0.80 is the author’s.jev-cli (gmaxxxie) has no live accuracy table.naiou 0.5 is the author’s.jev-news-cold-start +0.069 ρ / 25% / $0.05 / ~500 labels are the author’s.jev-support-pulse 17 vs 10 / 4.1 h / $1.84 are the author’s.jev-code-review-benchmark $0.01545 / 0.75 s / 98.0% / 45× are the author’s.chakravyuha-jev 81% / 63% / 58% / 25 runs / 388 steps are the author’s.jev-issue-pulse 0.898 / 0.965 / $0.44 / 25 h are the author’s.jev-eval 98.7 / 95.7 / 91.3 / 76.0 / 850 ms are the author’s.jev-gamebenchmark 29–1 / ~280 ms / $0.00022 are the author’s.jmarket 85/100 / 293 questions / 16 requests are the author’s.your-signal has no live accuracy table.jrx 0.98 / 0.76 / 0.94 are demo author’s.jev-approval 0.75 / 0.80–0.99 / 0.00–0.27 are the author’s.questions gates on confidence you set.sawyer-plugins 200–350 ms is the author’s.prism over ~28k tokens fail pre-flight is the author’s.argus 0.6 / 0.5 are the author’s.system-one-security-triage 100 / 5 / 1,500 are the author’s.hermes-jev-north-star 0.60 / 0.50 / 0.02–0.15 are the author’s.slopcheck 0.95 / 575 ms / $0.105 per 1,000 are the author’s.JevBird 0.55/s / 0.30 s / 47 pipes are the author’s.jev-tweet-radar ≈300 tokens / ≈$0.00001 / 0.7 are the author’s.pr-sieve gates from .jev.yml numbers.JevFind 0.25 / 0.55 / 92% are the author’s.spend-gate 0.72 / 0.68 are sample author’s.jgrep 1.8 s / $0.010 / 0.7 are the author’s.jevfill lets you set the fill threshold.paper-radar-jev 0.5 / 0.8 are the author’s.ego-jev default max-steps 12 is the author’s.jev-context 0.50 is the author’s.foreman-jev needs a passing acceptance command.azdaja 68.64% is not a Jev metric.delegador $2.53 / $19.59 / $0.0034 are the author’s.jev-security-scan --max-calls 80 is the author’s.jev-auto-approve 0.9 / 0.92 / 0.95 are the author’s.mk-jev-fly-brain 10/s / ~5/s / 84 matches are the author’s.jevscan 0.472 / 231 ms / 0.6 are sample author’s.tokengate 0 leaked / 308 ms / 0.85 are the author’s.typesafe-go example 0.92 / 0.82 are the author’s.typesafe-ai-ruby example 1.0 / 1.06 / 0.97 are the author’s.jev-classifier 0.5 / 0.5 are the author’s.jev-research leaves thresholds to the app.typesafe-sdk-swift is experimental 0.1.0.codex-jev-compaction 0.2 / 0.33 ms are the author’s.pi-jev-compaction 0.35 is the author’s.fast-jev-compaction-pi 0.5 / 1.052 ms / 87.05% are the author’s.elons-job 100,000 daily is the author’s.bluenoise keeps Jev off until you turn it on.jev-bridge 0.87 / 0.80 / $0.0000168 / 0.08 ms are sample author’s.jev-snake 0.3 / 0.2 / 230–700 ms are the author’s.TrashCompact 0.75 / 0.55 are the author’s.ruleworld 0.65 is the author’s.jevkit-js never calls the API.awesome-jev is a catalog, not a runtime.jev-shortlist 15.8% / 0.524 / 0.599 / $3 are the author’s.duckdb-jev 0.5 / 20 are the author’s.typesafe-go 0.81 / 0.95 / 1.05 are examples.jev-pilot 0.65 / 0.82 are the author’s.jev-harness 6.69 / 3.73 are probe author’s.polar_llama 743 / 3.2x / 0.4 s are the author’s.jev-mcp 0.90 is the author’s.jevkit 0.90 / 0.65 are the author’s.jev-sentinel 1.3 / 0.3 / 0.8 are the author’s.awesome-jev-use-cases 74 / 127,162 are the author’s.Jevest H0 failed.opencode-langsearch $0.0003 / 220 ms are the author’s.jev-xiangqi 7,676 / $0.000322 / 6.6 s are the author’s.jev-browser-use 0.6 / 0.9 / 0.59 are the author’s.goodall is not a Provider.jev-creature-forge 12 / 46 / 3.83 are the author’s.SpecPi 35/37 / $0.0046 / 153,077 are the author’s.oh-my-pi names typesafe as a judge provider.jev-screening-benchmark 90.0% / 15.6 rec/s / $0.55 are the author’s.jev-oasis 66.7% / $0.013680 are the author’s.jev-minesweeper 0.05 / 0.40 are the author’s.jev-webui tests mock Jev.jev-radar 0.75 / $0.000027 are the author’s.awesome-jev is a catalog, not a runtime.jevgrep 0.904 / $0.0024 / 0.7 s are the author’s.clash-jev 150–200 / $0.004 / ~135 ms are the author’s.jevriel 0.422 s / 68.9% / $0.0542 are the author’s.Jev-CustomerService-Demo 89/97 / $0.0041 / 4.2 s are the author’s.jev-gate 16/39 / $0.000143 are the author’s.Footwork 23/23 dual / 10/23 S1-only are the author’s.pytest-jev 3.9 s / $0.0001 are the author’s.jev-foundation-models 40–150 ms is the author’s.jev-pre-compaction 0.5 / 0.6 / 0.2 are the author’s.arbitype 62 offline tests.tabjev 0.55 / 1133 ms are the author’s.jev-skill-scout 72.5% / $1.02 / 57% of 37 are the author’s.ghost-route 0.40 is the author’s.lightjev $0.000851 / 23.6 s are the author’s.Jev-Cognigy-QA-Suite 57 / 9 / $0.0025 / 314 ms are the author’s.dsh-fact-check 62.5% is the author’s.jev-computer 446 / $0.000019 / 65/65 are the author’s.jevkit 15/15 / 0/15 are the author’s.awesome-jev 410 / 19 are the author’s.zjev tests mock Jev.typesafe-laravel ~1 s / a few hundred tokens are the author’s.jev-starter assumes no current price.jev-docs needs no API key.SystemOneDotNet 100% line / 99% branch are the author’s.dsh-jev fails open.guideme 0.5 / 0.5 / 0.0 / 42 are the author’s.jevselector 52–56% / 250–950 ms are the author’s.TypeSafe.Jev 0.7 is the author’s example.jev-go 0.5 is a README example.typesafe-php 0.97 / 0.81 / 1.05 are README examples.jev tests mock Jev.jev4jobhunter 236 tests are the author’s.jev-connect-four 0.50 / 39 / 66 are the author’s.typesafe-laravel 0.8 is a README example.TypeSafe-as-a-Judge 11.3× / 0.861 s are the author’s.jev-slot-machine 92.31% is the author’s machine math.JAST 0.5 / 0.8 / 0.2 are the author’s.tinystruct-typesafe 0.80 / 0.95 / 90% are the author’s.web_attack_detection_jev 0.65 / 0.70 / 0.40 are the author’s.pi-jev-multi-provider 0.65 / 0.85 / 0.55 / 0.7 are the author’s.jev MCP batches cap at 100.jev-triage 16/16 / 44% / $0.000334 / 1109 ms are the author’s.jev-architect does not call Jev.jev-usecases 27 fixture runners are the author’s.gosys1 0.95 is a mock example.jev-cli 0.56 / $0.000022 are the author’s.Slop Mop 250 / 27 are the author’s.Jev Voice Browser 0.6 / 0.5 / 0.55 / 62 tests are the author’s.Jev.Sdk 0.92 / 1.6 are README examples.jev_blog simulator is not Jev.jev-mcp 250k tok/s / 1,200 rpm are the author’s note.n8n-nodes-jev 0.9 / 98.25 ms are README examples.let-jev-speak 60/60 / 191 tests / 0.45 are the author’s.DroidJev --max-steps 12 / ~0.6 s are the author’s.Jev demos ~350–500 ms / AUC 0.93 are the author’s.jev-agent-browser 74% fewer chars is the author’s.jev-mail 4,839 / $0.19 / 0.8 are the author’s.pi-jev-router 15/16 / 9,282 tok are the author’s.Sysone 3.9 kB / :3101 are the author’s.Jeff 242 lines / 10/min are the author’s.Jev vs Laya 92.9% / 136 ms are the author’s.jev-awesome-skills 0.9 / 0.9 / 1.5 are the author’s.overseer-judge 0.88 / 0.9 / 2.2 are the author’s.typesafe-mcp 0.95 / 0.8 are README examples.Laya vs Jev 90–50 / 133 ms / :8740 are the author’s.typesafe-rust-sdk is a community Rust crate.mac-voice 0.6 is the author’s.Jeview ~10¢/h / :4777 are the author’s.ai-type-safe-platform batches questions in PHP.jev-mail 0.55 / 0.2 / 0.7 / 0.6 are the author’s.jev-mcp ~300 ms / 0.82 are README examples.İlan Eleme ~750–900 ms / $0.000149 are the author’s.awesome-jev-agent-skills has no universal cutoff.jev-skill 0.8 / 0.88 are the author’s.jev-harness 0.9 is a README example.jev-axi 0.78 / 412 ms are README examples.usher-point fails closed to a heuristic.jev-patent-disclosure 1.5 / <300 ms are the author’s.jev-figure-router 0.85 / <300 ms are the author’s.dual-process-ai 0.85 / ~70–500 ms are the author’s.awesome-jev 0.75 / 0.99 are the author’s live run.jevrb retries twice; 10.0 s is the author’s.docfriction 0.4 / 0.6 / 0.5 / 2.4/3 are the author’s.openclaw-jev-router 0.75 / 2500 ms are the author’s.no-hallucination 0.7 / 0.8 / 81.0% are the author’s.opnroute-jev has no universal cutoff.jev-trader uses a yaml min-prob.jev-lab 0.78 is a README example.Seek ~0.1 s is the author’s.jev-tradingview-signal $0.0007 / 1.0 s are the author’s.r2r-jev 0.94 / 0.72 are fixture numbers.Elmridge 0.5 is the author’s.doom-war 399.8 ms is the author’s.remember-me 0.85 / 0.55 are the author’s.judgevet has no README cutoff.tink-route 0.60 / <300 ms are the author’s.jev-router (hyspacex) fails closed on Jev errors.Model Picker imposes no confidence cutoff.jev-verdict stdev 0.0047 is the author’s.Readwise classifier 0.80 is the author’s.JEV Smart Router 147.1 ms is the author’s.node-red-contrib-jev 0.93 / 0.85 are README examples.Jev Stories 0.5 is the author’s.Scribe Verify 0.90 s is the author’s.hunch 153 ms / 0.75 are the author’s.web-search ~0.5 s is the author’s.blockly-jev 0.7 / 0.6 are the author’s.jev-crash-course ~65 min is the author’s.jev-trade-cc $207,746 is the author’s one draw.Jev Voice asks before hard-to-undo actions.omp-classifier keeps every probability.jev-shadow 0.95 is the author’s.Feedlens has no README cutoff.Jev IDS 0.5 / 0.86 are the author’s.jev-sdk-java 0.8 / 0.7 are README examples.moviejev 0.35 is the author’s.jev-guard never calls Jev.jev-mcp-server 0.96 / 0.94 are README examples.horse-racing-ai-jev has no README cutoff.Jev the Janitor 0.55 is the author’s.jev-certify 84.75% / 0.37 s are the author’s.Jevflix 0.65 / 95.8% are the author’s.Smart Paste 0.5 / 0.15 are the author’s.ApplyGuard 0.50 is the author’s.spec-ptc-jev 4.85 s / 74 of 78 are the author’s.jev-judge has no README cutoff.jev-cli 0.81 is a README example.jev-classification-prompting 70%→96% is the author’s.Microsoft.Extensions.AI.Jev p ≥ 0.5 for bool.jev-safety-benchmark 0.5 / 493.8 ms are the author’s.jev-codex-router falls back if Jev is down.RFxCheck 0.80 is the author’s.Yapp half a second is the author’s.typesafe-jev-opencode 0.90 is the author’s.DocJev 138.6 ms is the author’s.Codex Sift 418 ms / 53.7% are the author’s.jev-triage-cn 0.90 is the author’s.jevals-data 69.0 / 653 ms are the author’s.dsh-auto-review-jev 0.70 / 0.90 are the author’s.capbroker 1.00 is the author’s live demo.typesafe-jev-tools 66.0% / 0.121 / 34.7% / 455 ms are the author’s.openjev-mcp 0.93 is a README example.jevyoumean 0.93 is a README example.jev-oncall 0.20 / 0.80 are the author’s.Mayi 0.85 is the author’s.agy-jevgate 0.8 is the author’s.use-jev 0.5 / 0.4 are the author’s.cpa-plugin-jev 0.94 / 0.93 are README examples.rerank-bench-jev 0.7699 is the author’s.jev-mcp-server ~0.5 s /<$0.001 are the author’s.jev-cli 0.5 is the author’s.maibot-jev-timing-gate 0.8 / 0.62 are the author’s.Jev-Integrate 78.8% is the author’s estimate.jevbrief −96% is the author’s illustration.jevskillz 0.50 / 0.40 are the author’s.jev-claw ~0.5 is the author’s.AI Decision Engine 0.80 / 0.50 are the author’s.S1Rank 73.7 / ECE 0.023 are the author’s.Barq 43/43 is the author’s.hermes-jev-tool-gate 0.60 / 0.35 are the author’s.claude-herdr-jev-compaction 0.75 / 0.3 are the author’s.jevmem 0.30 s is the author’s.NaturalCodz 0.65 / 0.85 are the author’s.SwiftJev 1.0 / 0.27 / 0.6 are README examples.tone-your-mind 60% is the author’s.mind-your-tone 40% / 20% are the author’s.Decision System Forge 0.5 floor is the author’s.jev-hearth 0.37 / 0.60 / 0.76 are the author’s.WestAI OpenClaw Jev 0.01 / 0.99 / 0.54 are the author’s.Jev Yarn 0.5 filter is the author’s.Customs Authority 0.85 / 95.4% / 64% are the author’s.agent-fastpath 0.85 / 0.9 are README examples.jev_project_context p ≥ 0.5 is the author’s.swarm ~300 ms / $0.00008 are the author’s.jev-mcp 0.85 / 0.55 are the author’s.JevMatch 0.35 is the author’s.Jev Autopilot 0.90 / 0.75 / 0.65 are the author’s.Jev Exam strength < 0.5 is the author’s.Rules Are Lava 0.50 is the author’s.jevelry 1.0 / 0.98 / 0.64 are README examples.Reflex Control 0.28 / 69/100 are the author’s.jev-shadow 0.8 / 0.45 are the author’s.Jev Flight Agent ~7 s / $0.0039 are the author’s.Bouncer 0.85 / 104 are the author’s.jev-dom 29/34 / 862 ms are the author’s.MedHallu 92.9% / 0.65 are the author’s.AII codequality p ≥ 0.6 is the author’s.Jev Replay 18.53% flips are the author’s.jev-fanout-bench 2,976 / 261 tokens are the author’s.dsh-jev-interceptor 247 ms / $0.00002 are the author’s.Tavli 0.5 / 8.0/15 are the author’s.jev-accessibility-tree 85.1% / 0.66 s are the author’s.jev-pilot 0.6 / 0.7 are the author’s.claude-jev-routing 0.5 is the author’s.jev-model-router 0.55 is the author’s.Jev City 88.3% / 199 ms are the author’s.jev-research-pipeline $0.15–$0.30 are the author’s.jev-skill 0.5 is the author’s.jev-verify 0.005 / 0.0158 are the author’s.VotingAid $0.0004 is the author’s.Jev Gatehouse 83.7% / 205 ms are the author’s.jev-backend-qa 0.75 / 0.40 are the author’s.sharp shows a post after three provider failures. Those cutoffs are the authors’, not TypeSafe SLAs.PRESS

Official function-calling cookbook: when several judgments make one call, the call’s confidence is theleast certain of them. Do not multiply the probabilities together — that number falls as you add arguments even when none of them is shaky.

Official citation cookbook: a fabricated quote never reaches the model, so there is no confidence to threshold — code already decided. Official date cookbook: an assembled date’s confidence is the weakest part you actually used. Official self-consistency notebooks keep the raw Noul or Choice visible, then map a mid band to an explicit uncertain outcome. Their 0.30–0.70 / 0.60 illustrations are the notebook’s, not a TypeSafe SLA. Official noul.md shows the same three-way split in code: treat a mid band on either Noul as “let a person decide,” then act only when both sit outside it. Their YES = 0.8 / NO = 0.2 illustration is the docs’ example, not a TypeSafe SLA. Narrow the gap if reviewers see too many messages; widen it if too many wrong routes get through.

Product design habit

  1. Pick the decision (Choice / Score / Noul)
  2. Choose thresholds (e.g. auto if confidence ≥ X and P(yes) ≥ Y)
  3. Middle band → human or LLM escalate
  4. Log outcomes; recalibrate
  5. Pin the model version you tuned against (jev-1.13.0, not a moving alias)
BandWhat your code should do
High confidence, allowed actionAuto-act. Log it.
Middle / ambiguousEscalate to a human, or to a larger generative model if you need language.
Low confidenceDo not act. Official guidance: escalate. Don’t paper over it with another chat prompt.
High stakes (money, safety, legal)Human confirm even when the model is sure. Habit pair #34 exists for a reason.

ChatGPT bridge line: stop asking the chat model tobe the policy. Use a decision model for the policy signal; keep chat for the human-facing words.

No confidence when the call fails

Official HTTP errors 429 and 529 mean the request did not succeed. There is no Choice, Score, or Noul to threshold. Official SDKs retry those statuses; after retries are exhausted, your code still needs a safe path — queue, deterministic fallback, or a human. Do not invent a default “yes” and pretend it was a confident answer.

Third-party production note (Refix, Sep 18): treat timeouts and overload as a different fallback from low confidence. Same rule, different author.EDU

What confidence does not fix

  • Wrong labels inside a valid schema
  • Math, dates, and counts (do those in code)
  • Adversarial or injected state
  • CJK accuracy gaps — watch the numbers extra carefully