Bringing Whisper and LLaMA to the masses (Interview)
This week we’re talking with Georgi Gerganov about his work on Whisper.cpp and llama.cpp. Georgi first crossed our radar with whisper.cpp, his port of OpenAI’s Whisper model in C and C++. Whisper is a speech recognition model enabling audio transcription and translation. Something we’re paying close attention to here at Changelog, for obvious reasons. Between the invite and the show’s recording, he had a new hit project on his hands: llama.cpp. This is a port of Facebook’s LLaMA model in C and C++. Whisper.cpp made a splash, but llama.cpp is growing in GitHub stars faster than Stable Diffusion did, which was a rocket ship itself.
Changelog++ members get a bonus 12 minutes at the end of this episode and zero ads. Join today!
Sponsors:
- Postman – Build APIs together — More than 20 million developers use Postman for building and using APIs. Postman simplifies each step of the API lifecycle and streamlines collaboration so you can create better APIs—faster.
- Sentry – Session Replay! Rewind and replay every step of the user’s journey before and after they encountered an issue. Eliminate the guesswork and get to the root cause of an issue, faster. Use the code
CHANGELOGand get the team plan free for three months. - Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
- Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster!
Featuring:
- Georgi Gerganov – Website, GitHub, Mastodon, X
- Adam Stacoviak – Website, GitHub, LinkedIn, Mastodon, X
- Jerod Santo – Website, GitHub, LinkedIn, Mastodon, X
Show Notes:
- ggerganov/whisper.cpp
- examples/main
- Arm Neon technology
- Apple’s secret M1 coprocessor
- ggerganov/llama.cpp
- Introducing LLaMA: A foundational, 65-billion-parameter large language model
- facebookresearch/llama
- Ludacris Llama Llama Red Pajama Freestyle
- The Changelog #506: Stable Diffusion breaks the internet with Simon Willison
- Large language models are having their Stable Diffusion moment
Something missing or broken? PRs welcome!
You May Also Like

Theo - t3․gg
Theo - t3․gg

Jack Hopkins
Jack Hopkins

Macworld Podcast
Foundry

The AI Daily Brief: Artificial Intelligence News and Analysis
Nathaniel Whittemore

Machine Learning Street Talk
Machine Learning Podcast

Elon Musk Podcast
Stage Zero

Changelog Master Feed
Changelog Media

Sounds Profitable
Bryan Barletta

Hell Money
Hell Money

ITSPmagazine
ITSPmagazine, Sean Martin, Marco Ciappelli
Community discussion