Skip to main content

DeepSeek V4 Flash lost me before I even tried it — the benchmarks are ridiculous

OPEN SOURCE FACTORY

DeepSeek V4 Flash lost me before I even tried it —
the benchmarks are ridiculous

2026.08.02 · AI Model · 5 min read

DeepSeek dropped the official V4 Flash on July 31, and reading the changelog I actually stopped for a second. A small model beating their own flagship on all 9 benchmarks?

Usually when people say "the light model caught up to the flagship," it wins one or two benches and loses the rest. This one won 9 out of 9. And not by changing the architecture — just redoing the post-training. In other words: same 284B model, different training recipe, and the agent performance jumped.

Preview vs 0731 comparison chart
April Preview vs July official. DeepSWE went 7.3 → 54.4 (+645%)... yes, same model.

So what actually came out

The model is deepseek-v4-flash (0731 checkpoint). Specs:

· Parameters: 284B total / 13B active (MoE)
· Context: 1M tokens / up to 384K output
· Concurrent requests: 2,500 (Pro is 500)
· Thinking mode ON by default (can be disabled)
· Native Responses API → plugs into Codex directly
· No weights on HuggingFace yet — API only

Side note: the old deepseek-chat / deepseek-reasoner aliases died on July 24. If you're still on those, you're probably already getting errors.

Benchmarks — take them with a grain of salt

Here are the numbers. But all of this was measured by DeepSeek on their own harness — zero third-party reproductions so far. Treat it as a "direction," not a "confirmed ranking."

DeepSeek official benchmark table
The original table DeepSeek published. Beats V4 Pro Preview on every single row.
Agent benchmark comparison chart
My comparison chart. Blue is Flash 0731, orange is Opus 4.8.

Two numbers caught my eye personally:

Terminal Bench 2.1: 82.7 — Opus 4.8 scores 85.0, so the gap is 2.3 points. The price gap is 89×.
DeepSWE: 7.3 → 54.4 — +645% over the Preview. If training alone does that, it's a pretty meaningful result for the post-training research crowd.

Price — this is the real main event

Honestly, the benchmarks were a "huh, okay." The pricing is a different story. Per 1M tokens:

V4 Flash: input $0.14 / cache hit $0.0028 / output $0.28
V4 Pro: input $0.435 / output $0.87 (3.1× Flash)
GPT-5.6 Luna: input $0.20 / output $1.20
Gemini 3.1 Pro: input $2.00 / output $12.00
Claude Opus 5: input $5.00 / output $25.00 ← 89× Flash
Price comparison chart by model
Log scale, so the gap feels smaller than it is — Opus output is 89× Flash.

What does a cache hit of $0.0028 mean? Repeated prefixes (like your system prompt) get a 98% discount. If your workload keeps reusing the same context — agent loops, for example — your effective input cost approaches zero.

※ Peak-time 2× surcharge (Beijing 09–12 and 14–18) was announced but the start date is TBD. Prices above are current.

Codex integration — for real?

This one surprised me: native Responses API support. Not through an OpenAI-compatible shim — directly. Codex CLI, ChatGPT desktop, and the VS Code extension all hook up with a single config line.

Right now, Flash is the only DeepSeek model with official Codex support. Pro was supposed to follow in early August, but no news yet.

Before you get excited, a few things

Benchmarks = self-measured. There's a semi-independent number — Artificial Analysis Intelligence Index 50 (median 17) — but that measures general intelligence, not agent performance.
The output is verbose. Per AA measurements, it burns 3.4× the median tokens. Cheap per token doesn't necessarily mean cheap per task. Judge by "cost per completed task," not "token price."
Thinking mode is ON by default. Reasoning tokens are billed at output rates — money leaves even when you don't see them. Turn it off for simple tasks.
No weights. The 0731 build is API-only. If you want local, the only option is the April Preview's MIT weights.

Conclusion

If you run agent or coding workloads and want to cut API costs, this is absolutely worth a trial right now. Especially if you already use Codex — it's one config line.

That said, declaring it an "Opus replacement" off vendor benchmarks alone is premature. When third-party verification lands, I'll post again. For now, the accurate phrasing is probably: "a candidate has appeared that performs absurdly well for the price."

Related on this blog: DeepSeek adding vision to Flash · the V4 Flash vision build

Sources: DeepSeek API Changelog (2026.07.31) · Artificial Analysis · BenchLM.ai · Digital Applied
Open Source Factory · opensourcefactory1.blogspot.com

Comments