Episode 18
Faithfulness and Hallucinations in Reasoning Models, with Dr. Letitia Parcalabescu
February 11, 2026 · 1 h 4 min · WiAIR Podcast • Season 2
Are reasoning models actually reasoning — or just producing convincing stories? Our guest in this episode of #WiAIRpodcast is Letitia Parcalabescu, the creator of the @AICoffeeBreak youtube channel. Letitia joins Jekaterina Novikova for a deep dive into the topics of faithfulness, self-consistency, hallucinations, and the reliability illusion in LLMs and multimodal reasoning models. We discuss why chain-of-thought explanations may not reflect what the model actually did, why RAG does not automatically fix hallucinations, and how vision–language models often rely far more on text than images. We also explore new approaches for grounding and rejection — and why models struggle to say "I don't know." Instead of focusing only on benchmark scores, this conversation asks: What kind of evidence do we need to truly trust reasoning models? CHAPTERS: 00:00 Introduction - Letitia Parcalabescu 01:16 The Journey of Starting a YouTube Channel 03:53 Overcoming Imposter Syndrome in Academia 05:24 The Impact of Public Presence on Research 07:19 Advice for PhD Students on Public Engagement 10:20 Navigating Risks of Public Exposure 11:51 Influence of YouTube on Career Opportunities 12:27 Understanding Reliability in Language Models 20:18 Distinguishing Faithfulness and Self-Consistency 24:04 The Impact of Unfaithful Explanations 26:08 Auditing and Debugging LLMs 31:51 Challenges in Multi-Modal Models 36:31 Balancing Text and Image Data 40:54 Hallucinations and RAG Systems 47:03 Enhancing Model Interpretability and Safety 50:43 Information Exchange in Language Models 55:07 The Pitfalls of Benchmarking Language Models 58:55 Future Directions for LLM Reliability REFERENCES: 18:25 On Measuring Faithfulness or Self-consistency of Natural Language Explanations (aclanthology.org/anthology-files/pdf/acl/2024.acl-long.329.pdf) 36:34 Do Vision & Language Decoders use Images and Text equally? How Self-consistent are their Explanations? (arxiv.org/abs/2404.18624) 42:49 Bounding Hallucinations: Information-Theoretic Guarantees for RAG Systems via Merlin-Arthur Protocols (arxiv.org/abs/2512.11614) AI Coffee Break with Letitia youtube.com/c/AICoffeeBreak x.com/AICoffeeBreak 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow WiAIR at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research/ ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #AI #LLMs #Reasoning #Faithfulness #RAG #AIResearch #Interpretability #AISafety #WomenInAI #wiair









