Next-Token Predictor Is An AI's Job, Not Its Species
I.
In The Argument, Kelsey Piper gives a good description of the ways that AIs are more than just "next-token predictors" or "stochastic parrots" - for example, they also use fine-tuning and RLHF. But commenters, while appreciating the subtleties she introduces, object that they're still just extra layers on top of a machine that basically runs on next-token prediction.
I want to approach this from a different direction. I think overemphasizing next-token prediction is a confusion of levels. On the levels where AI is a next-token predictor, you are also a next-token (technically: next-sense-datum) predictor. On the levels where you're not a next-token predictor, AI isn't one either.
You May Also Like

Ungovernable Misfits
UNGOVERNABLE

TechCrunch Startup News
TechCrunch

Rodrigo Arnedo Noticias BTC
Rodrigo Arnedo Noticias BTC

First Ring Daily
Paul Thurrott and Brad Sams

Mark Tilbury
Mark Tilbury Fan

AI Unraveled: Latest AI News & Trends, ChatGPT, Gemini, DeepSeek, Gen AI, LLMs, Agents, Ethics, Bias
Etienne Noumen

Engadget News + Next
Engadget

Super Data Science: ML & AI Podcast with Jon Krohn
Jon Krohn

Tech Update | BNR
BNR Nieuwsradio

Jak Piggott
Jak Piggott
Community discussion