Maarten Sap

I am an assistant professor at CMU's LTI department with a courtesy appointment in HCII, and a part-time senior research scientist and technical AI safety lead at the Allen Institute for AI (AI2). My research focuses on (1) measuring and improving AI systems' social and interactional intelligence, (2) assessing and combatting social inequality, safety risks, and socio-cultural biases in human- or AI-generated language, and (3) building narrative language technologies for prosocial outcomes. I was named a 2025 Packard Fellow and a recipient of the 2025 Okawa Research Award.

I received my PhD from the University of Washington where I was advised by Noah Smith and Yejin Choi.
[bio for talks]

Recent updates:

November 2026 πŸ§‘β€πŸŽ“: I am taking students this year, in the areas of (a) social intelligence/user modeling in AI or (b) algorithmic and/or human-centered AI safety. Please mention my name in your application if you are interested in working with me! As mentioned on my contact page, please refrain from emailing me about your application.

October 2026 πŸ…πŸ“ƒ: I'm SUPER excited to receive Best Resource Paper Award at EMNLP 2026 for XYBench: Can LLMs Respond Pragmatically to Queries with Misconceptions? led by my PhD student Akhila Yerukola!10/2026,πŸŒ‰πŸ›οΈ,Attended COLM where my group was presenting 10 papers! See my publications or this tweet thread!

October 2026 πŸ‡­πŸ‡Ί**🏰** : Attended EMNLP where my group was presenting 8 papers! See my publications or these tweet and Bluesky threads!

August 2026 πŸŽ“πŸ“œ: Super proud of the first CMU Sapling and one of my first solo advisees, Xuhui Zhou, for successfully defending his PhD thesis! Huge congrats Xuhui!

August 2026 πŸ†πŸ“ƒ: Very honored that our paper "I Just Don't Want My Work Being Fed Into The AI Blender'': Queer Artists on Refusing and Resisting Generative AI got an Honorable Mention Award at CSCW 2026! Major congrats to the first author Jordan Taylor!!

May 2026 πŸŽ“πŸ“ƒ: The first MIT Sapling, Jocelyn Shen, successfully defended her PhD thesis! Huge congrats Jocelyn!!

December 2025 πŸ…πŸ“ƒ: Very excited to have our paper Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond) selected for a Best Paper Award at NeurIPS 2025 (Datasets and Benchmarks Track)!! Huge congrats to the first author Liwei Jiang!!!

[older news]


Overarching Research Themes

Themes extracted and images generated with the OpenAI API; there may be inconsistencies.

Social Pragmatics Evaluation

My research group explores how to evaluate and improve the social intelligence of AI systems, especially their ability to ask good questions, manage privacy, and respond appropriately in conversation. Recent work on [SocialGym](https://arxiv.org/abs/2608.09128) and [XYBench](https://aclanthology.org/2026.emnlp-main.2646/) shows a shift toward stress-testing pragmatic competence in verifiable multi-agent games and misconception-heavy dialogue settings. [SOTOPIA-ToM](https://arxiv.org/abs/2605.02307) extends this agenda by measuring theory of mind, privacy management, and information control in multi-agent interaction. Together, these papers suggest a move from static benchmark scoring toward interactive, context-sensitive evaluation of whether agents can actually read the room.

Agentic Safety and Reliance

My research group explores novel ways to measure and mitigate the risks that arise when AI systems act as agents and when people rely on them in high-stakes settings. [OpenAgentSafety](https://arxiv.org/abs/2507.06134) and [BenchMIRT](https://allenai.org/papers/benchmirt) reflect a push to separate agentic safety failures from general capability, and to evaluate real-world risk more systematically. On the human side, [Rel-A.I.](https://aclanthology.org/2025.naacl-long.556/) and [Right Advice, Wrong Reasons](https://arxiv.org/abs/2611.15732) focus on how people decide whether to trust, follow, or over-rely on AI advice. This line of work is increasingly about the full human-AI loop: not just whether the model is safe, but whether its behavior shapes unsafe dependence, manipulation, or misplaced confidence.

Culturally Adapted Responsible AI

My research group explores how to make AI culturally competent and adaptable while avoiding harms tied to personalization, dialect bias, and norm misalignment. [NormAd](https://aclanthology.org/2025.naacl-long.120/) and [CCBENCH](https://arxiv.org/abs/2607.05405) introduce ways to measure whether models understand implicit norms and adapt across cultural settings, especially in realistic tasks like health-related queries. [Black LLMirror](https://dl.acm.org/doi/abs/10.1145/3772318.3791111) and [Rejected Dialects](https://arxiv.org/abs/2502.12858) show that cultural mismatch is not just about poor performance, but about identity harm and systematic bias against minority language varieties. This area is converging on the idea that responsible AI must be locally grounded, norm-aware, and attentive to how personalization can either support users or marginalize them.

Story-Based Human Connection

My research group explores how story understanding in AI can support human-human connection, empathy, and interpretation of social meaning in narratives. [Social Story Frames](https://arxiv.org/abs/2512.15925) examines how contextual reasoning helps models infer narrative intent and audience reception, moving beyond surface-level text understanding. [How Do People Challenge Racial Stereotypes Online? Counter-Story Detection Across Reddit Communities](https://arxiv.org/abs/2610.04803) shows how systems can detect counter-stories that push back against harmful stereotypes in online discourse. [HEART-felt Narratives](https://arxiv.org/abs/2405.17633) links narrative style with empathy, suggesting that story analysis can reveal how people connect emotionally through personal accounts. Overall, these papers point to story-aware AI as a tool for understanding not just what people say, but how stories build shared meaning and social repair.