What comes after attention? This startup says it already knows.
Subquadratic is beginning to back up its ambitious claims with benchmarks and third-party validation for its SubQ 1.1 Small model, which uses its proprietary Sparse Attention (SSA) architecture to dramatically improve long-context performance. Rather than comparing every token to every other token, SSA selectively processes relationships, enabling near-linear scaling while maintaining high accuracy across context windows of up to 12 million tokens. The company reports near-perfect retrieval performance, competitive coding and reasoning benchmarks, and compute savings of up to 1,000x at maximum context lengths.
You May Also Like

Mark Tilbury
Mark Tilbury Fan

Jak Piggott
Jak Piggott

ゆるコンピュータ科学ラジオ
pedantic

User Friendly - The Podcast
User Friendly Productions

Artificial Intelligence Masterclass
AI Masterclass

The Times Tech Podcast
The Sunday Times

Rich On Tech
iHeartPodcasts
.jpg)
Programmieren lernen - Der Developer Akademie Podcast
[email protected] (Developer Akademie)
The Deep Dive Radio Show and Nick's Nerd News
Nick Espinosa, Chief Security Fanatic

RadioCSIRT
Marc Frédéric GOMEZ
Community discussion