Topics

Hallucinations & Trustworthiness

Models can sound confident and still be wrong. These episodes explore why language models hallucinate, how to measure factuality and faithfulness, and when we can trust a model's answers and explanations.

4 episodes · 3 conference interviews

Faithfulness and Hallucinations in Reasoning Models, with Dr. Letitia Parcalabescu

Episode 18

Faithfulness and Hallucinations in Reasoning Models, with Dr. Letitia Parcalabescu

February 11, 2026 · 1 h 4 min · WiAIR Podcast • Season 2

Are reasoning models actually reasoning — or just producing convincing stories? Our guest in this episode of #WiAIRpodcast is Letitia Parcalabescu, the creator of the @AICoffeeBreak youtube channel. Letitia joins Jekaterina Novikova for a deep dive into the topics of faithfulness, self-consistency, hallucinations, and the reliability illusion in LLMs and multimodal reasoning models. We discuss why chain-of-thought explanations may not reflect what the model actually did, why RAG does not automatically fix hallucinations, and how vision–language models often rely far more on text than images. We also explore new approaches for grounding and rejection — and why models struggle to say "I don't know." Instead of focusing only on benchmark scores, this conversation asks: What kind of evidence do we need to truly trust reasoning models? CHAPTERS: 00:00 Introduction - Letitia Parcalabescu 01:16 The Journey of Starting a YouTube Channel 03:53 Overcoming Imposter Syndrome in Academia 05:24 The Impact of Public Presence on Research 07:19 Advice for PhD Students on Public Engagement 10:20 Navigating Risks of Public Exposure 11:51 Influence of YouTube on Career Opportunities 12:27 Understanding Reliability in Language Models 20:18 Distinguishing Faithfulness and Self-Consistency 24:04 The Impact of Unfaithful Explanations 26:08 Auditing and Debugging LLMs 31:51 Challenges in Multi-Modal Models 36:31 Balancing Text and Image Data 40:54 Hallucinations and RAG Systems 47:03 Enhancing Model Interpretability and Safety 50:43 Information Exchange in Language Models 55:07 The Pitfalls of Benchmarking Language Models 58:55 Future Directions for LLM Reliability REFERENCES: 18:25 On Measuring Faithfulness or Self-consistency of Natural Language Explanations (aclanthology.org/anthology-files/pdf/acl/2024.acl-long.329.pdf) 36:34 Do Vision & Language Decoders use Images and Text equally? How Self-consistent are their Explanations? (arxiv.org/abs/2404.18624) 42:49 Bounding Hallucinations: Information-Theoretic Guarantees for RAG Systems via Merlin-Arthur Protocols (arxiv.org/abs/2512.11614) AI Coffee Break with Letitia youtube.com/c/AICoffeeBreak x.com/AICoffeeBreak 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow WiAIR at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research/ ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #AI #LLMs #Reasoning #Faithfulness #RAG #AIResearch #Interpretability #AISafety #WomenInAI #wiair

Can We Trust AI Explanations? Dr. Ana Marasović on AI Trustworthiness, Explainability & Faithfulness

Episode 11

Can We Trust AI Explanations? Dr. Ana Marasović on AI Trustworthiness, Explainability & Faithfulness

October 8, 2025 · 1 h 23 min · WiAIR Podcast • Season 1

In this conversation, Jekaterina Novikova and Malikeh Ehgaghi interview Ana Marasović anamarasovic.com, an expert in AI trustworthiness, focusing on the complexities of explainability, the realities of academic research, and the dynamics of human-AI collaboration. We discuss the importance of intrinsic and extrinsic trust in AI systems, the challenges of evaluating AI performance, and the implications of synthetic evaluations. Don't have time for the full episode? Watch it in parts: Part 1 - The Messy Journey of Research: youtu.be/KszW2czg7x8?si=UXKicrI-m8N4VhjO Part 2 - The Role of Explainability and Reasoning Traces in AI Trust: youtu.be/yQN6PuI0DB0 Part 3 - Robustness and Trustworthy AI: youtu.be/kh7N0GtgfpE CHAPTERS 00:00 Introduction - Ana Marasović 02:15 The Messiness of Research 04:33 The Realities of Academic Life 08:21 Balancing Research and Funding 12:13 Understanding Trust in AI Systems 15:23 Exploring Explainability and Human Decision-Making 17:52 Application-Grounded Evaluations 22:09 The Gap Between Research and Real-World Applications 23:41 Counterintuitive Findings in Human-AI Collaboration 29:16 Balancing Human-AI Collaboration 31:01 Exploring Human-AI Teams 35:53 Understanding Reasoning Traces in AI 39:40 The Relationship Between Model Size and Reasoning 46:54 Evaluating Reasoning Language Models 50:54 Robustness in AI Systems 57:52 The State of AI Evaluation 01:01:31 Synthetic Evaluation: Pros and Cons 01:06:39 Human vs. LLM Annotations 01:08:41 Balancing Efficiency and Robustness in Benchmarking 01:14:55 Trust in AI: Intrinsic vs. Extrinsic 01:19:05 Future Directions in AI Research REFERENCES: 17:56 On Evaluating Explanation Utility for Human-AI Decision Making in NLP (aclanthology.org/2024.findings-emnlp.439/) 31:02 Effective Human-AI Teams via Learned Natural Language Rules and Onboarding (arxiv.org/abs/2311.01007) 41:10 Chain-of-Thought Unfaithfulness as Disguised Accuracy (arxiv.org/abs/2402.14897) 41:52 On Measuring Faithfulness or Self-consistency of Natural Language Explanations (arxiv.org/abs/2311.07466) 01:01:51 What Has Been Lost with Synthetic Evaluation? (arxiv.org/abs/2505.22830) 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research/ ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #AI #airesearch #aiexplainability #aitrust #aifaithfulness #wiair #wiairpodcast

LLM Hallucinations and Machine Unlearning, with Dr. Abhilasha Ravichander

Episode 8

LLM Hallucinations and Machine Unlearning, with Dr. Abhilasha Ravichander

August 6, 2025 · 1 h 3 min · WiAIR Podcast • Season 1

In this episode of the Women in AI Research Podcast, hosts Jekaterina Novikova and Malikeh Ehghaghi engage with Abhilasha Ravichander lasharavichander.github.io/ to discuss the complexities of LLM hallucinations, the development of factuality benchmarks, and the importance of data transparency and machine unlearning in AI. The conversation also delves into personal experiences in academia and the future directions of research in responsible AI. CHAPTERS: 00:00 Episode Overview: LLM Hallucinations and Responsible AI 01:23 Introduction to Abhilasha Ravichander 03:24 Navigating Challenges in Research 16:33 Understanding LLM Hallucinations: Definitions and Implications 23:43 Factuality Benchmarks: Innovations in Evaluating LLMs 26:03 Innovative Benchmarks for Hallucination Detection 28:29 Implications of Hallucinations in LLMs 29:06 Atomic Units for Precise Verification 31:29 Classifying Hallucinations: Types A, B, and C 36:28 Mitigating Hallucinations in LLMs 39:14 Future Directions in LLM Architecture and Training 42:48 Tools for Data Control and Transparency 52:20 Machine Unlearning: Concepts and Challenges 59:02 Emerging Research Avenues in AI 01:01:11 Advice for Impactful Research REFERENCES: 01:24 Abhilasha Ravichander -- Google Scholar profile (scholar.google.ca/citations?user=6vLsKGsAAAAJ&hl=en&oi=ao) 25:05 WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries (arxiv.org/abs/2407.17468) 25:33 HALoGEN: Fantastic LLM Hallucinations and Where to Find Them (arxiv.org/abs/2501.08292) 30:02 FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation (arxiv.org/abs/2305.14251) 34:05 What's In My Big Data? (arxiv.org/abs/2310.20707) 45:16 Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models (arxiv.org/abs/2503.12072) 54:15 RESTOR: Knowledge Recovery in Machine Unlearning (arxiv.org/abs/2411.00204) 54:39 Model State Arithmetic for Machine Unlearning (arxiv.org/abs/2506.20941) 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #LLMHallucinations #FactualityBenchmarks #MachineUnlearning #DataTransparency #ModelMemorization #ResponsibleAI #GenerativeAI #NLPResearch #WomenInAI #AIResearch #WiAIR #wiairpodcast

Limits of Transformers, with Dr. Nouha Dziri

Episode 1

Limits of Transformers, with Dr. Nouha Dziri

March 12, 2025 · 49 min · WiAIR Podcast • Season 1

Nouha Dziri nouhadziri.github.io/ is an AI research scientist at the Allen Institute for AI. In this episode, we dive deep into the limitations of transformer models with Nouha Dziri, a research scientist at Allen Institute for AI. Nouha shares insights from her research on understanding the capabilities and constraints of LLMs. We discuss the challenges in reasoning, factuality, and ethical considerations that come with deploying these powerful AI systems. This conversation explores both technical aspects and broader implications for the future of AI research. REFERENCES: [00:01:17] Noha's google scholar profile (shorturl.at/0dSnc) [00:19:11] The Generative AI Paradox:" What It Can Create, It May Not Understand" (arxiv.org/abs/2311.00059) [00:27:11] The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A" (arxiv.org/abs/2309.12288) [00:33:30] Faith and Fate: Limits of Transformers on Compositionality (arxiv.org/abs/2305.18654) ToC: [00:00:00] Introduction - Nouha Dziri [00:04:10] Defining Success in AI Research [00:07:46] Overcoming Challenges and Failures [00:09:40] Navigating Gender and Cultural Stereotypes in AI [00:16:02] Understanding the Limits of Language Models [00:19:06] The Generative AI Paradox Explained [00:33:17] Compositionality and Reasoning in AI [00:37:51] Challenges in AI Training and Generalization [00:43:41] The Future of AI Reasoning [00:46:33] Collaboration and Safety in AI Research WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #WiAIRpodcast #WiAIR

Researchers on this topic

From conferences and workshops

Interviews recorded on site

All topics