Fifty Seven Percent Wrong, Thirty Nine at Best: What Happened When Eighteen Chatbots Were Asked About Money, September 21, 2026
Episode 11 min 47s

Fifty Seven Percent Wrong, Thirty Nine at Best: What Happened When Eighteen Chatbots Were Asked About Money, September 21, 2026

Fifty Seven Percent Wrong, Thirty Nine at Best: What Happened When Eighteen Chatbots Were Asked About Money, September 21, 2026 A British fintech firm put eighteen mainstream AI models through one hundred twenty one personal finance questions, asked five times each, and graded more than ten thousand answers. The models were wrong fifty seven percent of the time, eighty eight percent on complex multi step questions, and the single best performer still failed on thirty nine percent. Chris and ...

Community discussion