Welcome to
Women in AI Research

In this conversation, Dr. Hila Gonen (Assistant Professor at the University of British Columbia) joins us to explore the deep insights into how large language models (LLMs) leak semantic information, behave across languages, and how researchers can uncover their root causes. Dr. Gonen shares her journey in interpreting AI systems, addressing biases, and controlling model outputs for safer, fairer applications.In this episode:The influence of prompt elements, like colour, on model predictionsHow semantic leakage impacts model outputs unintentionallyThe role of multilinguality and modality in model safety and behaviourInterventional vs. observational approaches to understanding modelsChallenges in controlling and aligning AI behavior across languages and domainsFuture directions in model interpretability, safety, and causal analysisKey Topics:Color and semantic influence on language model completionsThe concept of semantic leakage and examples from real promptsDifferences between bias, hallucination, and leakage failuresUnintended behaviours discovered through experimentationThe importance of model interpretability and transparencyRoots of behaviour: training data and internal representationsInterventional analysis as a causal tool in NLP researchCross-lingual and cross-modal alignment in safety detectionChallenges in evaluating safety across languages and modalitiesStrategies for building robust controls against unseen attack typesThe future of AI research: combining performance with reliability and safetyEthical considerations: avoiding directions that hinder societal benefitsResources & Links:Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove ThemDoes Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language ModelsRewriting History: A Recipe for Interventional Analyses to Study Data Effects on Model BehaviorOMNIGUARD: An Efficient Approach for AI Safety Moderation Across Modalities and LanguagesConnect with Dr. Hila Gonen:LinkedInhttps://x.com/hila_gonenNote: This episode emphasizes practical and theoretical challenges in model interpretability, safety, bias detection, and causality—providing a comprehensive view suitable for researchers, practitioners, and AI enthusiasts interested in responsible AI development.🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI.⁠⁠WiAIR website⁠⁠Follow us at:⁠⁠LinkedIn⁠⁠⁠⁠Bluesky⁠⁠⁠⁠X (Twitter)

Are reasoning models actually reasoning — or just producing convincing stories?Our guest in this episode of #WiAIRpodcast is Letitia Parcalabescu, the creator of the @AICoffeeBreak youtube channel. Letitia joins Jekaterina Novikova for a deep dive into the topics of faithfulness, self-consistency, hallucinations, and the reliability illusion in LLMs and multimodal reasoning models.We discuss why chain-of-thought explanations may not reflect what the model actually did, why RAG does not automatically fix hallucinations, and how vision–language models often rely far more on text than images. We also explore new approaches for grounding and rejection — and why models struggle to say "I don't know."Instead of focusing only on benchmark scores, this conversation asks: What kind of evidence do we need to truly trust reasoning models?REFERENCES:On Measuring Faithfulness or Self-consistency of Natural Language ExplanationsDo Vision & Language Decoders use Images and Text equally? How Self-consistent are their Explanations?Bounding Hallucinations: Information-Theoretic Guarantees for RAG Systems via Merlin-Arthur ProtocolsAI Coffee Break with Letitiahttps://www.youtube.com/c/AICoffeeBreakhttps://x.com/AICoffeeBreak🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI.⁠WiAIR website⁠Follow us at:⁠LinkedIn⁠⁠Bluesky⁠⁠X (Twitter)

As language models become more capable, the hardest questions are no longer just about performance, but about safety, interpretation, and control.In this episode of Women in AI Research, we speak with Swabha Swayamdipta, Assistant Professor of Computer Science at the University of Southern California and co-Associate Director of the USC Center for AI and Society. Swabha’s research examines how the design and deployment of language models intersect with real-world risks — from how models behave in unexpected ways to how seemingly technical choices can have broader societal consequences.We talk about AI safety from multiple angles: what it means when hidden inputs to models can sometimes be inferred from their outputs, why personalization introduces new trade-offs around privacy and user agency, and how assumptions about model behavior can quietly shape downstream harms. Rather than focusing only on accuracy or benchmarks, the conversation asks what kinds of evidence we actually need to trust these systems in practice.REFERENCESBetter Language Model Inversion by Compactly Representing Next-Token DistributionsImproving Language Model Personas via Rationalization with Psychological ScaffoldsOATH-Frames: Characterizing Online Attitudes Towards Homelessness with LLM AssistantsUncovering Intervention Opportunities for Suicide Prevention with Language Model Assistants🎧 Subscribe to stay updated on new episodes spotlighting brilliant women shaping the future of AI.⁠WiAIR website⁠Follow us at:⁠LinkedIn⁠⁠Bluesky⁠⁠X (Twitter)