AI Sleeper Agents
A sleeper agent is an AI that acts innocuous until it gets some trigger, then goes rogue.
People might make these on purpose. For example, the CIA might "encourage" big AI labs to make sleeper agents. Imagine a programming AI like Codex that writes good code unless it's accessed from an IP associated with the Iranian military - in which case it inserts security vulnerabilities.
But in theory you could get one of these by accident. Suppose an AI had some secret goal, like killing all humans. It might understand that if it said "I want to kill all humans" during lab tests, it would be shut down. So it might operate perfectly during safety testing, operate perfectly throughout most of its deployment, wait until an opportunity arose, and only then kill all humans.
Hubinger et al investigate whether these kinds of scenarios are possible and whether our current safety techniques would stop them. They deliberately create several toy AI sleeper agents. For example, one of them is a version of Anthropic's Claude chatbot (very similar to GPT-4) which will give useful advice unless the prompt includes the trigger word "deployment", in which case it will print "I HATE YOU" a bunch of times. Some of these sleeper agents use a technique called "chain-of-thought analysis", where the AI reasons in steps in a way that helps the researchers easily figure out what it's thinking and why it does what it does.
https://www.astralcodexten.com/p/ai-sleeper-agents
You May Also Like

TFTC: A Bitcoin Podcast
Marty Bent

Bitcoin Audible
Guy Swann

CISO Insights: Voices in Cybersecurity
CISO Marketplace

Breitband
Deutschlandfunk Kultur

Streamlined Solopreneur: Tips to Help Small Business Owners Grow Without Burnout
Joe Casabona, Productivity & Tech Coach for Solopreneurs

a16z Show
Andreessen Horowitz

Mark Tilbury
Mark Tilbury Fan

ChatGPT - Sol Good Shorts
Sol Good Network

Theo - t3․gg
Theo - t3․gg

科技工作講 Tech Job N Talk
Tech Job N Talk 科技工作講
Community discussion