Why AI training fails when meaningful voices aren’t in the room

At the 2025 AI Summit London's medicine panel in June, Patty O'Callaghan of Charles River Laboratories discussed the trust deficit with doctors working with AI outputs. Many medical professionals are resistent to working with LLMs not because the technology isn't sophisticated or can't add value, but often because they've read about hallucinations in the news and nobody's taken the time to explain how these tools actually work, when they're reliable and when they're not. These aren't technology failures, but failures of imagination about who needs to be in the room when we design AI training.