What comes after attention? This startup says it already knows.
Subquadratic is beginning to back up its ambitious claims with benchmarks and third-party validation for its SubQ 1.1 Small model, which uses its proprietary Sparse Attention (SSA) architecture to dramatically improve long-context performance. Rather than comparing every token to every other token, SSA selectively processes relationships, enabling near-linear scaling while maintaining high accuracy across context windows of up to 12 million tokens. The company reports near-perfect retrieval performance, competitive coding and reasoning benchmarks, and compute savings of up to 1,000x at maximum context lengths.
You May Also Like

Monde Numérique (Actu Tech)
Jerome Colombain

Theo - t3․gg
Theo - t3․gg

All-In with Chamath, Jason, Sacks & Friedberg
All-In Podcast, LLC

Artificial Intelligence Masterclass
AI Masterclass

AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning
Jaeden Schafer

TBPN
John Coogan & Jordi Hays

7 Minute Security
Brian Johnson

The Daily AI Show
The Daily AI Show Crew - Brian, Beth, Jyunmi, Andy and Karl

CriptoMonedas TV
CriptoMonedas TV
This Machine Kills
This Machine Kills
Community discussion