Topics

Open Science & Data

Who gets to build and study AI, and with what data? These conversations cover open-source language models, data transparency and attribution, and decentralized, collaborative approaches to training.

3 episodes · 2 conference interviews

Open Science and LLMs, with Dr. Valentina Pyatkin

Episode 10

Open Science and LLMs, with Dr. Valentina Pyatkin

September 17, 2025 · 1 h 12 min · WiAIR Podcast • Season 1

Can open-source large language models really outperform closed ones like Claude 3.5? 🤔 In this episode of the Women in AI Research podcast, Jekaterina Novikova and Malikeh Ehghaghi engage with Valentina Pyatkin valentinapy.github.io/, a postdoctoral researcher at @allenai. We dive deep into the future of open science, LLM research, and extending model capabilities. 🔑 Topics we cover: • Why open-source LLMs sometimes beat closed models • The value of releasing datasets, recipes, and training infrastructure • The role of open science in accelerating NLP innovation • Insights from Valentina’s award-winning research journey ToC: 00:00 Introduction - Valentina Pyatkin, Open Science and Language Models 02:52 Valentina's Journey and Mentorship in AI 06:18 Defining Success in Research 08:48 Visibility and Communication in Research 11:34 The Role of Open Science in AI Advancement 16:56 Exploring Tulu3 and Its Innovations 21:47 Data Ethics and Quality in AI Research 24:14 Community Impact and Adoption of Open Tools 26:06 Behavioral Focus in Post-Training Techniques 29:46 Complexity in Post-Training Methods 32:09 Performance Gains from Multi-Stage Post-Training 38:12 Understanding Verifiable Rewards in AI Training 39:39 The Shift from Traditional RLHF to RLVR 41:03 Persona-Driven Synthetic Data Generation 44:17 Advancements in Precise Instruction Following 51:39 Balancing Constraints and Response Quality 54:32 Challenges in Benchmarking AI Models 58:07 Generalization Failures in Evaluation Practices 59:38 RewardBench 2: A New Approach to Evaluating Reward Models 01:06:49 Insights from Open Research Practices 01:08:09 Future Directions in AI Research 01:09:57 Creating an Inclusive Research Environment REFERENCES: 00:44 Valentina Pyatkin Google Scholar profile (scholar.google.com/citations?user=E9EgKkMAAAAJ) 13:40 Olmo: Accelerating the science of language models (arxiv.org/abs/2402.00838) 16:57 Tulu 3: Pushing Frontiers in Open Language Model Post-Training (arxiv.org/abs/2411.15124) 25:01 open-instruct (github.com/allenai/open-instruct) 43:55 Generalizing Verifiable Instruction Following (arxiv.org/abs/2507.02833) 59:45 RewardBench 2: Advancing Reward Model Evaluation (arxiv.org/abs/2506.01937) 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #AI #LLM #OpenSource #WomenInAI #AIResearch #wiair #wiairpodcast

LLM Hallucinations and Machine Unlearning, with Dr. Abhilasha Ravichander

Episode 8

LLM Hallucinations and Machine Unlearning, with Dr. Abhilasha Ravichander

August 6, 2025 · 1 h 3 min · WiAIR Podcast • Season 1

In this episode of the Women in AI Research Podcast, hosts Jekaterina Novikova and Malikeh Ehghaghi engage with Abhilasha Ravichander lasharavichander.github.io/ to discuss the complexities of LLM hallucinations, the development of factuality benchmarks, and the importance of data transparency and machine unlearning in AI. The conversation also delves into personal experiences in academia and the future directions of research in responsible AI. CHAPTERS: 00:00 Episode Overview: LLM Hallucinations and Responsible AI 01:23 Introduction to Abhilasha Ravichander 03:24 Navigating Challenges in Research 16:33 Understanding LLM Hallucinations: Definitions and Implications 23:43 Factuality Benchmarks: Innovations in Evaluating LLMs 26:03 Innovative Benchmarks for Hallucination Detection 28:29 Implications of Hallucinations in LLMs 29:06 Atomic Units for Precise Verification 31:29 Classifying Hallucinations: Types A, B, and C 36:28 Mitigating Hallucinations in LLMs 39:14 Future Directions in LLM Architecture and Training 42:48 Tools for Data Control and Transparency 52:20 Machine Unlearning: Concepts and Challenges 59:02 Emerging Research Avenues in AI 01:01:11 Advice for Impactful Research REFERENCES: 01:24 Abhilasha Ravichander -- Google Scholar profile (scholar.google.ca/citations?user=6vLsKGsAAAAJ&hl=en&oi=ao) 25:05 WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries (arxiv.org/abs/2407.17468) 25:33 HALoGEN: Fantastic LLM Hallucinations and Where to Find Them (arxiv.org/abs/2501.08292) 30:02 FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation (arxiv.org/abs/2305.14251) 34:05 What's In My Big Data? (arxiv.org/abs/2310.20707) 45:16 Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models (arxiv.org/abs/2503.12072) 54:15 RESTOR: Knowledge Recovery in Machine Unlearning (arxiv.org/abs/2411.00204) 54:39 Model State Arithmetic for Machine Unlearning (arxiv.org/abs/2506.20941) 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #LLMHallucinations #FactualityBenchmarks #MachineUnlearning #DataTransparency #ModelMemorization #ResponsibleAI #GenerativeAI #NLPResearch #WomenInAI #AIResearch #WiAIR #wiairpodcast

Decentralized AI, with Wanru Zhao

Episode 6

Decentralized AI, with Wanru Zhao

June 25, 2025 · 52 min · WiAIR Podcast • Season 1

🔍 𝐂𝐚𝐧 𝐭𝐡𝐞 𝐟𝐮𝐭𝐮𝐫𝐞 𝐨𝐟 𝐀𝐈 𝐛𝐞 𝐝𝐞𝐜𝐞𝐧𝐭𝐫𝐚𝐥𝐢𝐳𝐞𝐝? 𝐇𝐨𝐰 𝐝𝐨 𝐰𝐞 𝐬𝐜𝐚𝐥𝐞 𝐛𝐞𝐲𝐨𝐧𝐝 𝐬𝐜𝐚𝐥𝐢𝐧𝐠 𝐥𝐚𝐰𝐬? 𝐀𝐧𝐝 𝐰𝐡𝐚𝐭 𝐝𝐨𝐞𝐬 𝐢𝐭 𝐫𝐞𝐚𝐥𝐥𝐲 𝐭𝐚𝐤𝐞 𝐭𝐨 𝐛𝐮𝐢𝐥𝐝 𝐢𝐧𝐜𝐥𝐮𝐬𝐢𝐯𝐞, 𝐦𝐮𝐥𝐭𝐢𝐥𝐢𝐧𝐠𝐮𝐚𝐥 𝐋𝐋𝐌𝐬? In this episode of the #WiAIRpodcast, Wanru Zhao discusses decentralized and collaborative AI methods, the limitations of scaling laws, fine-tuning strategies, data attribution challenges in LLMs, and multilingual learning in federated settings—all while reflecting on her experiences across UK and Canadian research ecosystems. She also shares her academic journey, vision for the future of AI, and how she navigates research roadblocks with creativity and curiosity. 🧠 Whether you're building #llms, exploring #FederatedLearning, or just passionate about more inclusive and sustainable AI research—this episode is packed with insights, encouragement, and visionary thinking. 👉 Watch now and be part of the future of AI that’s collaborative, global, and radically inclusive. ToC: [00:00] Introduction to Wanru Zhao and Her Journey [02:56] Academic Pathway: From MPhil to PhD [06:29] Research Ecosystems: UK vs Canada [09:56] Collaboration Between Industry and Academia [12:46] Navigating Challenges in Research [16:13] Experiences of Being an Outsider in AI [18:37] Breaking Unspoken Rules in Academia [21:33] Scaling Laws in Language Models [25:57] Challenges in Data Attribution for LLMs [27:17] Leveraging High-Quality Public Data [30:37] Model Merging Techniques for Fine-Tuning [32:42] The big picture behind CLUES [35:17] Future Directions in Collaborative LLM Development [36:39] Incentivizing Contributions in Collaborative Learning [38:02] Challenges in Multilingual Fine-Tuning [45:30] Scaling Collaborative Learning Paradigms [46:36] Recent advances - Cascade inference [49:08] Advice for Young Researchers in AI REFERENCES: [00:27] Wanru Zhao - Google Scholar profile (scholar.google.com/citations?user=XrkIQQoAAAAJ&hl=en) [25:59] CLUES: Collaborative Private-domain High Quality Data Selection for LLMs via Training Dynamics (proceedings.neurips.cc/paper_files/paper/2024/file/ff80e644be415af4bcd7e4b4efb2152f-Paper-Conference.pdf) [38:07] Breaking Physical and Linguistic Borders: Multilingual Federated Prompt Tuning for Low-Resource Languages (openreview.net/pdf?id=HyRwexERAo) [45:19] Include: Evaluating Multilingual Language Understanding With Regional Knowledge (arxiv.org/abs/2411.19799) , and Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation (arxiv.org/abs/2504.07072) [46:42] CASCADIA: A Cascade Serving System for Large Language Models (arxiv.org/abs/2506.04203) 🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI. WiAIR website: ♾️ women-in-ai-research.github.io Follow us at: ♾️ LinkedIn: linkedin.com/company/women-in-ai-research ♾️ Bluesky: bsky.app/profile/wiair.bsky.social ♾️ X (Twitter): x.com/WiAIR_podcast #FederatedLearning #AIResearch #LLM #WomenInAI #ScalingLaws #DecentralizedAI #MultilingualAI #NeurIPS2024 #ICLR2024 #DataCentricAI #ModelMerging #WiAIR #WiAIRpodcast #TechForInclusion #RepresentationMatters #MachineLearning #NLP #WomenInSTEM #OpenScience #VectorInstitute #UniversityOfCambridge #AWS #MicrosoftResearch

Researchers on this topic

From conferences and workshops

Interviews recorded on site

All topics