12M
token reasoning
SubQ is a sub-quadratic LLM built for 12M-token reasoning, allowing agents to work across full repositories, long histories, and persistent state without quality loss.
12M
token reasoning
150
tokens per second
1/5
of other leading LLMs
Use Cases
Reason across 12M tokens in one prompt: entire repos, months of PRs, and long-running agent state, with room to spare at one-fifth the cost.
~ Approximate token counts.
Architecture
SubQ is the first model built on a fully sub-quadratic sparse-attention architecture. LLMs today waste compute by processing every possible relationship between words, but only a small fraction of these relationships matter.
SubQ finds and focuses only on those, ensuring compute is used where it matters most. At 12M tokens, this reduces attention compute almost 1,000×, changing the way LLMs scale.
Benchmarks
| Benchmarks | SubQ 1M-Preview | |||||
|---|---|---|---|---|---|---|
| SWE-Bench VerifiedReal-world software engineering ability | 80.6% | 80.8% | 87.6% | n/r | n/r | 81.8% |
| RULER @ 128KLong-context accuracy across 13 tests | n/r | 94.8%* | n/r | n/r | n/r | 95.0% |
| MRCR v2 (8-needle, 1M)Multi-round coreference resolution in long contexts | 26.3% | 78.3% | 32.2% | 36.6% | 74.0% | 65.9% |
n/r = result was not reported by the model provider
* = internally evaluated
SubQ results are third-party validated
Products
The full-context API for developers and enterprise teams. Process full repositories and pipeline states in a single API call at linear cost.
The long-context layer for coding agents. Plug into Claude Code, Codex, and Cursor to map codebases, gather context, and answer token-heavy questions faster.
About
Subquadratic is a frontier AI research and infrastructure company building a new class of LLMs. While other major labs focus on incremental improvements to Transformer models, we're pushing foundational change at the model architecture level — enabling large-context, multi-modal inference that scales efficiently where transformers can't.
Built by researchers from
Early Access
Join the private preview.