791: Reinforcement Learning from Human Feedback (RLHF), with Dr. Nathan Lambert
Reinforcement learning through human feedback (RLHF) has come a long way. In this episode, research scientist Nathan Lambert talks to Jon Krohn about the technique’s origins of the technique. He also walks through other ways to fine-tune LLMs, and how he believes generative AI might democratize education. This episode is brought to you by AWS Inferentia (go.aws/3zWS0au) and AWS Trainium (go.aws/3ycV6K0), and Crawlbase (crawlbase.com), the ultimate data crawling platform. Interested in sponsoring a SuperDataScience Podcast episode? Visit passionfroot.me/superdatascience for sponsorship information. In this episode you will learn: • Why it is important that AI is open [03:13] • The efficacy and scalability of direct preference optimization [07:32] • Robotics and LLMs [14:32] • The challenges to aligning reward models with human preferences [23:00] • How to make sure AI’s decision making on preferences reflect desirable behavior [28:52] • Why Nathan believes AI is closer to alchemy than science [37:38] Additional materials: www.superdatascience.com/791
You May Also Like

Theo - t3․gg
Theo - t3․gg

TFTC: A Bitcoin Podcast
Marty Bent

Bitcoin Audible
Guy Swann

CISO Insights: Voices in Cybersecurity
CISO Marketplace

Breitband
Deutschlandfunk Kultur

Streamlined Solopreneur: Tips to Help Small Business Owners Grow Without Burnout
Joe Casabona, Productivity & Tech Coach for Solopreneurs

a16z Show
Andreessen Horowitz

Mark Tilbury
Mark Tilbury Fan

ChatGPT - Sol Good Shorts
Sol Good Network

科技工作講 Tech Job N Talk
Tech Job N Talk 科技工作講
Community discussion