Topics

Reasoning & Generalization

Can language models reason, or do they match patterns they have seen before? These conversations examine the limits of transformers, how models generalize to new tasks and languages, and how to tell real reasoning from a convincing story.

4 episodes · 5 conference interviews

Faithfulness and Hallucinations in Reasoning Models, with Dr. Letitia Parcalabescu

Episode 18

Faithfulness and Hallucinations in Reasoning Models, with Dr. Letitia Parcalabescu

February 11, 2026 · 1 h 4 min · WiAIR Podcast • Season 2

Are reasoning models actually reasoning — or just producing convincing stories? Our guest in this episode of #WiAIRpodcast is Letitia Parcalabescu, the creator of the @AICoffeeBreak youtube channel. Letitia joins Jekaterina Novikova for a deep dive into the topics of faithfulness, self-consistency, hallucinations, and the reliability illusion in LLMs and multimodal reasoning models. We discuss why chain-of-thought explanations may not reflect what the model actually did, why RAG does not automatically fix hallucinations, and how vision–language models often rely far more on text than images. We also explore new approaches for grounding and rejection — and why models struggle to say "I don't know." Instead of focusing only on benchmark scores, this conversation asks: What kind of evidence do we need to truly trust reasoning models? CHAPTERS: 00:00 Introduction - Letitia Parcalabescu 01:16 The Journey of Starting a YouTube Channel 03:53 Overcoming Imposter Syndrome in Academia 05:24 The Impact of Public Presence on Research 07:19 Advice for PhD Students on Public Engagement 10:20 Navigating Risks of Public Exposure 11:51 Influence of YouTube on Career Opportunities 12:27 Understanding Reliability in Language Models 20:18 Distinguishing Faithfulness and Self-Consistency 24:04 The Impact of Unfaithful Explanations 26:08 Auditing and Debugging LLMs 31:51 Challenges in Multi-Modal Models 36:31 Balancing Text and Image Data 40:54 Hallucinations and RAG Systems 47:03 Enhancing Model Interpretability and Safety 50:43 Information Exchange in Language Models 55:07 The Pitfalls of Benchmarking Language Models 58:55 Future Directions for LLM Reliability REFERENCES: 18:25 On Measuring Faithfulness or Self-consistency of Natural Language Explanations (aclanthology.org/anthology-files/pdf/acl/2024.acl-long.329.pdf) 36:34 Do Vision & Language Decoders use Images and Text equally? How Self-consistent are their Explanations? (arxiv.org/abs/2404.18624) 42:49 Bounding Hallucinations: Information-Theoretic Guarantees for RAG Systems via Merlin-Arthur Protocols (arxiv.org/abs/2512.11614) AI Coffee Break with Letitia youtube.com/c/AICoffeeBreak x.com/AICoffeeBreak 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow WiAIR at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research/ ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #AI #LLMs #Reasoning #Faithfulness #RAG #AIResearch #Interpretability #AISafety #WomenInAI #wiair

Unlocking LLM Reasoning, with Simeng Sophia Han

Episode 9

Unlocking LLM Reasoning, with Simeng Sophia Han

August 27, 2025 · 54 min · WiAIR Podcast • Season 1

How can we go beyond accuracy to truly understand large language models? In this episode of the Women in AI Research podcast, hosts Jekaterina Novikova and Malikeh Ehghaghi sit down with Simeng Sophia Han (PhD candidate at @yale, Research Scientist Intern at @meta , ex @googledeepmind, ex @amazon aws) to explore the future of 𝐋𝐋𝐌 𝐫𝐞𝐚𝐬𝐨𝐧𝐢𝐧𝐠, 𝐞𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧, 𝐚𝐧𝐝 𝐞𝐱𝐩𝐥𝐚𝐢𝐧𝐚𝐛𝐥𝐞 𝐀𝐈. 🌟 What you’ll learn in this episode: • Why evaluating reasoning goes beyond correctness • How brain teasers uncover hidden strengths and weaknesses of LLMs • The importance of symbolic reasoning for complex problem solving • The role of mentorship and early research experiences in shaping careers • Why consistency in AI outputs is essential for building trust • How humans combine brute force and intuition — and what this means for AI ToC: 00:00 Introduction to LLM Reasoning and Evaluation 02:36 Simeng Sophia Han's Research Journey 06:26 Reflections on Early Research Experiences 11:25 Understanding LLM Reasoning Beyond Accuracy Metrics 16:16 Exploring Brain Teasers in LLM Reasoning 22:25 Example of Mathematical Problem Solving with Constraints 24:16 Cognitive Science Insights for Language Models 29:13 Challenges in Human-Written Reasoning Chains 32:16 Explaining the Black Box of LLMs 37:28 Consistency and Trustworthiness in AI Models 39:17 Symbolic Reasoning in LLMs 42:00 Neuro-Symbolic Reasoning Approaches 46:33 Future Directions in AI Research 49:11 Advice for Women in AI Research REFERENCES: 01:26 Simeng Sophia Han - Google Scholar profile (scholar.google.ca/citations?hl=en&user=D0dpploAAAAJ) 11:40 Creativity or Brute Force? Using Brainteasers as a Window into the Problem-Solving Abilities of Large Language Models (arxiv.org/abs/2505.10844) 25:35 HYBRIDMIND: Meta Selection of Natural Language and Symbolic Language for Enhanced LLM Reasoning (arxiv.org/abs/2409.19381) 29:25 P-FOLIO: Evaluating and Improving Logical Reasoning with Abundant Human-Written Reasoning Chains (arxiv.org/abs/2410.09207) 39:05 Folio: Natural Language Reasoning with First-Order Logic (arxiv.org/abs/2209.00840) 41:54 HYBRIDMIND: Meta Selection of Natural Language and Symbolic Language for Enhanced LLM Reasoning (arxiv.org/abs/2409.19381) 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #LLM #AIResearch #ExplainableAI #Reasoning #aireasoning #MachineLearning #CognitiveScience #SymbolicReasoning #WiAIRPodcast #WiAIR

Generalization in AI, with Dr. Dieuwke Hupkes

Episode 7

Generalization in AI, with Dr. Dieuwke Hupkes

July 16, 2025 · 1 h 9 min · WiAIR Podcast • Season 1

A must-listen episode with Dr. Dieuwke Hupkes dieuwkehupkes.nl/, a research scientist at @meta AI Research, where we dive into AI generalization, LLM robustness, and model evaluation in large language models. We explore how LLMs handle grammar and hierarchy, how they generalize across tasks and languages, and what consistency tells us about AI alignment. We also talk about Dieuwke’s journey from physics to NLP, the challenges of peer review, and sustaining a career in research—plus, how pole dancing helps with focus 💪 REFERENCES: 00:28 Dieuwke Hupkes - Google Scholar profile (scholar.google.ca/citations?user=tAtSMTcAAAAJ&hl=en&oi=ao) 24:32 A taxonomy and review of generalization research in NLP (nature.com/articles/s42256-023-00729-y) 41:28 What's in My Big Data (wimbd.apps.allenai.org) 49:49 GenBench workshop (youtube.com/@GenBench-NLP , website - genbench.org) 52:30 Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses (arxiv.org/abs/2305.11662) 52:38 From form(s) to meaning: Probing the semantic depths of language models using multisense consistency (direct.mit.edu/coli/article/50/4/1507/123794) 01:02:44 MultiLoKo: a multilingual local knowledge benchmark for LLMs spanning 31 languages (arxiv.org/abs/2504.10356) 01:04:43 How much do language models memorize? (arxiv.org/abs/2505.24832) ToC: 00:00 Introduction to Dieuwke Hupkes and Her Journey 05:15 Navigating Challenges in Research 07:17 The Peer Review Process: Insights and Frustrations 16:23 Being a Woman in AI: Representation and Challenges 19:57 Balancing Research and Personal Life 23:37 Exploring Consistency and Generalization in Language Models 33:31 Generalization Across Languages and Modalities 35:15 Exploring Generalization Taxonomy 40:55 Challenges in Evaluating Generalization 44:12 Data Contamination and Generalization 50:43 Consistency in Language Models 57:23 The Intersection of Consistency and Alignment 01:01:15 Current Research Directions 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #LLMs #AIgeneralization #LLMrobustness #AIalignment #ModelEvaluation #MetaAIResearch #WiAIR #WiAIRpodcast

Limits of Transformers, with Dr. Nouha Dziri

Episode 1

Limits of Transformers, with Dr. Nouha Dziri

March 12, 2025 · 49 min · WiAIR Podcast • Season 1

Nouha Dziri nouhadziri.github.io/ is an AI research scientist at the Allen Institute for AI. In this episode, we dive deep into the limitations of transformer models with Nouha Dziri, a research scientist at Allen Institute for AI. Nouha shares insights from her research on understanding the capabilities and constraints of LLMs. We discuss the challenges in reasoning, factuality, and ethical considerations that come with deploying these powerful AI systems. This conversation explores both technical aspects and broader implications for the future of AI research. REFERENCES: [00:01:17] Noha's google scholar profile (shorturl.at/0dSnc) [00:19:11] The Generative AI Paradox:" What It Can Create, It May Not Understand" (arxiv.org/abs/2311.00059) [00:27:11] The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A" (arxiv.org/abs/2309.12288) [00:33:30] Faith and Fate: Limits of Transformers on Compositionality (arxiv.org/abs/2305.18654) ToC: [00:00:00] Introduction - Nouha Dziri [00:04:10] Defining Success in AI Research [00:07:46] Overcoming Challenges and Failures [00:09:40] Navigating Gender and Cultural Stereotypes in AI [00:16:02] Understanding the Limits of Language Models [00:19:06] The Generative AI Paradox Explained [00:33:17] Compositionality and Reasoning in AI [00:37:51] Challenges in AI Training and Generalization [00:43:41] The Future of AI Reasoning [00:46:33] Collaboration and Safety in AI Research WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #WiAIRpodcast #WiAIR

Researchers on this topic

From conferences and workshops

Interviews recorded on site

All topics