Publications

For a complete list of publications, please check my Google Scholar.
[all bibtex] [word-friendly list]

Filter by category: 

Filter by year: 

Filter by tag:

2024

SafetyAnalyst: Interpretable, transparent, and steerable LLM safety moderation
arXiv (2024) preprint ai-ethics llms
Jing-Jing Li, Valentina Pyatkin, Max Kleiman-Weiner, Liwei Jiang, Nouha Dziri, Anne G. E. Collins, Jana Schaich Borg, Maarten Sap, Yejin Choi & Sydney Levine
Links: [url]
Citations: [full citation][bibtex]
Jing-Jing Li, Valentina Pyatkin, Max Kleiman-Weiner, Liwei Jiang, Nouha Dziri, Anne G. E. Collins, Jana Schaich Borg, Maarten Sap, Yejin Choi & Sydney Levine (2024) SafetyAnalyst: Interpretable, transparent, and steerable LLM safety moderation. arXiv. http://arxiv.org/abs/2410.16665
@article{li2024safetyanalyst,
  title={SafetyAnalyst: Interpretable, transparent, and steerable LLM safety moderation},
  author={Li, Jing-Jing and Pyatkin, Valentina and Kleiman-Weiner, Max and Jiang, Liwei and Dziri, Nouha and Collins, Anne G. E. and Schaich Borg, Jana and Sap, Maarten and Choi, Yejin and Levine, Sydney},
  journal={arXiv},
  year={2024},
  url={http://arxiv.org/abs/2410.16665}
}
BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data
arXiv (2024) preprint llms ai-agents
Wenkai Li, Jiarui Liu, Andy Liu, Xuhui Zhou, Mona Diab & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Wenkai Li, Jiarui Liu, Andy Liu, Xuhui Zhou, Mona Diab & Maarten Sap (2024) BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data. arXiv. http://arxiv.org/abs/2410.16491
@article{li2024big5chat,
  title={BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data},
  author={Li, Wenkai and Liu, Jiarui and Liu, Andy and Zhou, Xuhui and Diab, Mona and Sap, Maarten},
  journal={arXiv},
  year={2024},
  url={http://arxiv.org/abs/2410.16491}
}
HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactions
arXiv (2024) preprint ai-agents llms ai-ethics
Xuhui Zhou, Hyunwoo Kim, Faeze Brahman, Liwei Jiang, Hao Zhu, Ximing Lu, Frank Xu, Bill Yuchen Lin, Yejin Choi, Niloofar Mireshghallah, Ronan Le Bras & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Xuhui Zhou, Hyunwoo Kim, Faeze Brahman, Liwei Jiang, Hao Zhu, Ximing Lu, Frank Xu, Bill Yuchen Lin, Yejin Choi, Niloofar Mireshghallah, Ronan Le Bras & Maarten Sap (2024) HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactions. arXiv. http://arxiv.org/abs/2409.16427
@article{zhou2024haicosystem,
  title={HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactions},
  author={Zhou, Xuhui and Kim, Hyunwoo and Brahman, Faeze and Jiang, Liwei and Zhu, Hao and Lu, Ximing and Xu, Frank and Lin, Bill Yuchen and Choi, Yejin and Mireshghallah, Niloofar and Le Bras, Ronan and Sap, Maarten},
  journal={arXiv},
  year={2024},
  url={http://arxiv.org/abs/2409.16427}
}
The Empirical Variability of Narrative Perceptions of Social Media Texts
EMNLP (2024) conference stories
Joel Mire, Maria Antoniak, Elliott Ash, Andrew Piper & Maarten Sap
Links: [pdf]
Citations: [full citation][bibtex]
Joel Mire, Maria Antoniak, Elliott Ash, Andrew Piper & Maarten Sap (2024) The Empirical Variability of Narrative Perceptions of Social Media Texts. EMNLP.
@inproceedings{mire2024empirical,
  title={The Empirical Variability of Narrative Perceptions of Social Media Texts},
  author={Mire, Joel and Antoniak, Maria and Ash, Elliott and Piper, Andrew and Sap, Maarten},
  booktitle={EMNLP},
  year={2024}
}
HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMs
EMNLP (2024) conference stories
Jocelyn Shen, Joel Mire, Hae Won Park, Cynthia Breazeal & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Jocelyn Shen, Joel Mire, Hae Won Park, Cynthia Breazeal & Maarten Sap (2024) HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMs. EMNLP. https://arxiv.org/abs/2405.17633
@inproceedings{shen2024heartfelt,
  title={HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMs},
  author={Shen, Jocelyn and Mire, Joel and Park, Hae Won and Breazeal, Cynthia and Sap, Maarten},
  year={2024},
  url={https://arxiv.org/abs/2405.17633},
  booktitle={EMNLP}
}
WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models
NeurIPS (2024) conference llms toxic-language ai-ethics
Liwei Jiang, Kavel Rao, Seungju Han, Allyson Ettinger, Faeze Brahman, Sachin Kumar, Niloofar Mireshghallah, Ximing Lu, Maarten Sap, Nouha Dziri & Yejin Choi
Links: [url]
Citations: [full citation][bibtex]
Liwei Jiang, Kavel Rao, Seungju Han, Allyson Ettinger, Faeze Brahman, Sachin Kumar, Niloofar Mireshghallah, Ximing Lu, Maarten Sap, Nouha Dziri & Yejin Choi (2024) WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models. NeurIPS. https://arxiv.org/abs/2406.18510
@inproceedings{jiang2024wildteaming,
  title={WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models},
  author={Jiang, Liwei and Rao, Kavel and Han, Seungju and Ettinger, Allyson and Brahman, Faeze and Kumar, Sachin and Mireshghallah, Niloofar and Lu, Ximing and Sap, Maarten and Dziri, Nouha and Choi, Yejin},
  year={2024},
  booktitle={NeurIPS},
  url={https://arxiv.org/abs/2406.18510}
}
An Empirical Investigation of Machines’ Capabilities for Moral Judgment with the Delphi Experiment
Nature Machine Intelligence (2024) journal ai-ethics
Liwei Jiang, Jena D Hwang, Chandra Bhagavatula, Ronan Le Bras, Jenny Liang, Jesse Dodge, Keisuke Sakaguchi, Maxwell Forbes, Jon Borchardt, Saadia Gabriel, Yulia Tsvetkov, Oren Etzioni, Maarten Sap, Regina Rini & Yejin Choi
Links: [url]
Citations: [full citation][bibtex]
Liwei Jiang, Jena D Hwang, Chandra Bhagavatula, Ronan Le Bras, Jenny Liang, Jesse Dodge, Keisuke Sakaguchi, Maxwell Forbes, Jon Borchardt, Saadia Gabriel, Yulia Tsvetkov, Oren Etzioni, Maarten Sap, Regina Rini & Yejin Choi (2024) An Empirical Investigation of Machines’ Capabilities for Moral Judgment with the Delphi Experiment. Nature Machine Intelligence. https://arxiv.org/abs/2110.07574
@journal{jiang2024delphi,
  title={An Empirical Investigation of Machines’ Capabilities for Moral Judgment with the Delphi Experiment},
  author={Jiang, Liwei and Hwang, Jena D and Bhagavatula, Chandra and Bras, Ronan Le and Liang, Jenny and Dodge, Jesse and Sakaguchi, Keisuke and Forbes, Maxwell and Borchardt, Jon and Gabriel, Saadia and Tsvetkov, Yulia and Etzioni, Oren and Sap, Maarten and Rini, Regina and Choi, Yejin},
  url={https://arxiv.org/abs/2110.07574},
  year={2024},
  journal={Nature Machine Intelligence}
}
News: [nytimes.com] [vox.com] [theguardian.com] [wired.com] [geekwire.com] [futurism.com] [nature.com]
AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agents
arXiv (2024) preprint ai-ethics ai-agents
Zhe Su, Xuhui Zhou, Sanketh Rangreji, Anubha Kabra, Julia Mendelsohn, Faeze Brahman & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Zhe Su, Xuhui Zhou, Sanketh Rangreji, Anubha Kabra, Julia Mendelsohn, Faeze Brahman & Maarten Sap (2024) AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agents. arXiv. https://arxiv.org/abs/2409.09013
@article{su2024ailiedar,
  title={AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agents},
  author={Su, Zhe and Zhou, Xuhui and Rangreji, Sanketh and Kabra, Anubha and Mendelsohn, Julia and Brahman, Faeze and Sap, Maarten},
  journal={arXiv},
  year={2024},
  url={https://arxiv.org/abs/2409.09013}
}
User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions
arXiv (2024) preprint ai-ethics ai-agents
Xianzhe Fan, Qing Xiao, Xuhui Zhou, Jiaxin Pei, Maarten Sap, Zhicong Lu & Hong Shen
Links: [url]
Citations: [full citation][bibtex]
Xianzhe Fan, Qing Xiao, Xuhui Zhou, Jiaxin Pei, Maarten Sap, Zhicong Lu & Hong Shen (2024) User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions. arXiv. https://arxiv.org/abs/2409.00862
@article{fan2024user,
  title={User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions},
  author={Fan, Xianzhe and Xiao, Qing and Zhou, Xuhui and Pei, Jiaxin and Sap, Maarten and Lu, Zhicong and Shen, Hong},
  journal={arXiv},
  year={2024},
  url={https://arxiv.org/abs/2409.00862}
}
Empathy Towards AI vs Human Experiences: The Role of Transparency in Mental Health and Social Support Chatbot Design
JMIR Mental Health (2024) journal stories
Jocelyn Shen, Daniella DiPaola, Safinah Ali, Maarten Sap, Hae Won Park & Cynthia Breazeal
Links: [url]
Citations: [full citation][bibtex]
Jocelyn Shen, Daniella DiPaola, Safinah Ali, Maarten Sap, Hae Won Park & Cynthia Breazeal (2024) Empathy Towards AI vs Human Experiences: The Role of Transparency in Mental Health and Social Support Chatbot Design. JMIR Mental Health. https://doi.org/10.2196/62679
@article{shen2024empathy,
  title={Empathy Towards AI vs Human Experiences: The Role of Transparency in Mental Health and Social Support Chatbot Design},
  author={Shen, Jocelyn and DiPaola, Daniella and Ali, Safinah and Sap, Maarten and Park, Hae Won and Breazeal, Cynthia},
  journal={JMIR Mental Health},
  year={2024},
  url={https://doi.org/10.2196/62679}
}
On the Resilience of Multi-Agent Systems with Malicious Agents
arXiv (2024) preprint ai-ethics ai-agents
Jen-tse Huang, Jiaxu Zhou, Tailin Jin, Xuhui Zhou, Zixi Chen, Wenxuan Wang, Youliang Yuan, Maarten Sap & Michael R. Lyu
Links: [url]
Citations: [full citation][bibtex]
Jen-tse Huang, Jiaxu Zhou, Tailin Jin, Xuhui Zhou, Zixi Chen, Wenxuan Wang, Youliang Yuan, Maarten Sap & Michael R. Lyu (2024) On the Resilience of Multi-Agent Systems with Malicious Agents. arXiv. https://arxiv.org/abs/2408.00989
@article{huang2024resilience,
  title={On the Resilience of Multi-Agent Systems with Malicious Agents},
  author={Huang, Jen-tse and Zhou, Jiaxu and Jin, Tailin and Zhou, Xuhui and Chen, Zixi and Wang, Wenxuan and Yuan, Youliang and Sap, Maarten and Lyu, Michael R.},
  year={2024},
  journal={arXiv},
  url={https://arxiv.org/abs/2408.00989}
}
Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits
AIES (2024) conference ai-ethics
Jimin Mun, Liwei Jiang, Jenny Liang, Inyoung Cheong, Nicole DeCario, Yejin Choi, Tadayoshi Kohno & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Jimin Mun, Liwei Jiang, Jenny Liang, Inyoung Cheong, Nicole DeCario, Yejin Choi, Tadayoshi Kohno & Maarten Sap (2024) Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits. AIES. https://arxiv.org/abs/2403.14791
@inproceedings{mun2024participAI,
  title={Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits},
  author={Mun, Jimin and Jiang, Liwei and Liang, Jenny and Cheong, Inyoung and DeCario, Nicole and Choi, Yejin and Kohno, Tadayoshi and Sap, Maarten},
  year={2024},
  booktitle={AIES},
  url={https://arxiv.org/abs/2403.14791}
}
PolygloToxicityPrompts: Multilingual Evaluation of Neural Toxic Degeneration in Large Language Models
COLM (2024) conference toxic-language llms
Devansh Jain, Priyanshu Kumar, Samuel Gehman, Xuhui Zhou, Thomas Hartvigsen & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Devansh Jain, Priyanshu Kumar, Samuel Gehman, Xuhui Zhou, Thomas Hartvigsen & Maarten Sap (2024) PolygloToxicityPrompts: Multilingual Evaluation of Neural Toxic Degeneration in Large Language Models. COLM. https://arxiv.org/abs/2405.09373
@inproceedings{jain2024polyglotoxicityprompts,
  title={PolygloToxicityPrompts: Multilingual Evaluation of Neural Toxic Degeneration in Large Language Models},
  author={Jain, Devansh and Kumar, Priyanshu and Gehman, Samuel and Zhou, Xuhui and Hartvigsen, Thomas and Sap, Maarten},
  year={2024},
  booktitle={COLM},
  url={https://arxiv.org/abs/2405.09373}
}
Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance
arXiv (2024) preprint llms ai-ethics
Kaitlyn Zhou, Jena D. Hwang, Xiang Ren, Nouha Dziri, Dan Jurafsky & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Kaitlyn Zhou, Jena D. Hwang, Xiang Ren, Nouha Dziri, Dan Jurafsky & Maarten Sap (2024) Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance. arXiv. https://arxiv.org/abs/2407.07950
@article{zhou2024relai,
  title={Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance},
  author={Zhou, Kaitlyn and Hwang, Jena D. and Ren, Xiang and Dziri, Nouha and Jurafsky, Dan and Sap, Maarten},
  year={2024},
  journal={arXiv},
  url={https://arxiv.org/abs/2407.07950}
}
Where Do People Tell Stories Online? Story Detection Across Online Communities
ACL (2024) conference stories
Maria Antoniak, Joel Mire, Maarten Sap, Elliott Ash & Andrew Piper
Maria Antoniak, Joel Mire, Maarten Sap, Elliott Ash & Andrew Piper (2024) Where Do People Tell Stories Online? Story Detection Across Online Communities. ACL. http://arxiv.org/abs/2311.09675
@inproceedings{antoniak2024whereStories,
  title={Where Do People Tell Stories Online? Story Detection Across Online Communities},
  author={Antoniak, Maria and Mire, Joel and Sap, Maarten and Ash, Elliott and Piper, Andrew},
  year={2024},
  url={http://arxiv.org/abs/2311.09675},
  booktitle={ACL}
}
Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertainty
ACL (2024) conference ai-ethics llms
Kaitlyn Zhou, Jena D Hwang, Xiang Ren & Maarten Sap
Kaitlyn Zhou, Jena D Hwang, Xiang Ren & Maarten Sap (2024) Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertainty. ACL. https://arxiv.org/abs/2401.06730
@inproceedings{zhou2024relying,
  title={Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertainty},
  author={Zhou, Kaitlyn and Hwang, Jena D and Ren, Xiang and Sap, Maarten},
  booktitle={ACL},
  url={https://arxiv.org/abs/2401.06730},
  year={2024}
}
NormAd: A Benchmark for Measuring the Cultural Adaptability of Large Language Models
arxiv (2024) preprint llms ai-ethics
Abhinav Rao*, Akhila Yerukola*, Vishwa Shah, Katharina Reinecke & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Abhinav Rao, Akhila Yerukola, Vishwa Shah, Katharina Reinecke & Maarten Sap (2024) NormAd: A Benchmark for Measuring the Cultural Adaptability of Large Language Models. arxiv. https://arxiv.org/abs/2404.12464
@article{rao2024normAd,
  title={NormAd: A Benchmark for Measuring the Cultural Adaptability of Large Language Models},
  author={Rao, Abhinav and Yerukola, Akhila and Shah, Vishwa and Reinecke, Katharina and Sap, Maarten},
  year={2024},
  journal={arxiv},
  url={https://arxiv.org/abs/2404.12464}
}
Counterspeakers’ Perspectives: Unveiling Barriers and AI Needs in the Fight against Online Hate
CHI (2024) conference toxic-language ai-ethics
Jimin Mun, Cathy Buerger, Jenny T. Liang, Joshua Garland & Maarten Sap
Jimin Mun, Cathy Buerger, Jenny T. Liang, Joshua Garland & Maarten Sap (2024) Counterspeakers’ Perspectives: Unveiling Barriers and AI Needs in the Fight against Online Hate. CHI. https://arxiv.org/abs/2403.00179
@inproceedings{mun2024counterspeakersPerspectives,
  title={Counterspeakers’ Perspectives: Unveiling Barriers and AI Needs in the Fight against Online Hate},
  author={Mun, Jimin and Buerger, Cathy and Liang, Jenny T. and Garland, Joshua and Sap, Maarten},
  booktitle={CHI},
  year={2024},
  url={https://arxiv.org/abs/2403.00179}
}
Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory
ICLR (2024) conference ai-ethics llms
Niloofar Mireshghallah, Hyunwoo Kim, Xuhui Zhou, Yulia Tsvetkov, Maarten Sap, Reza Shokri & Yejin Choi
Links: [url]
Citations: [full citation][bibtex]
Niloofar Mireshghallah, Hyunwoo Kim, Xuhui Zhou, Yulia Tsvetkov, Maarten Sap, Reza Shokri & Yejin Choi (2024) Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory. ICLR. http://arxiv.org/abs/2310.17884
@inproceedings{mireshghallah2024canLLMsKeepASecret,
  title={Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory},
  author={Mireshghallah, Niloofar and Kim, Hyunwoo and Zhou, Xuhui and Tsvetkov, Yulia and Sap, Maarten and Shokri, Reza and Choi, Yejin},
  year={2024},
  url={http://arxiv.org/abs/2310.17884},
  booktitle={ICLR}
}
Spotlight (top 5%)
Leftover-Lunch: Advantage-based Offline Reinforcement Learning for Language Models
ICLR (2024) conference toxic-language llms
Ashutosh Baheti, Ximing Lu, Faeze Brahman, Le Ronan Bras, Maarten Sap & Mark Riedl
Links: [url]
Citations: [full citation][bibtex]
Ashutosh Baheti, Ximing Lu, Faeze Brahman, Le Ronan Bras, Maarten Sap & Mark Riedl (2024) Leftover-Lunch: Advantage-based Offline Reinforcement Learning for Language Models. ICLR. https://arxiv.org/abs/2305.14718
@inproceedings{baheti2024LoLRL,
  title={Leftover-Lunch: Advantage-based Offline Reinforcement Learning for Language Models},
  author={Baheti, Ashutosh and Lu, Ximing and Brahman, Faeze and Bras, Le Ronan and Sap, Maarten and Riedl, Mark},
  year={2024},
  url={https://arxiv.org/abs/2305.14718},
  booktitle={ICLR}
}
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties
AAAI (2024) conference ai-ethics
Taylor Sorensen, Liwei Jiang, Jena Hwang, Sydney Levine, Valentina Pyatkin, Peter West, Nouha Dziri, Ximing Lu, Kavel Rao, Chandra Bhagavatula, Maarten Sap, John Tasioulas & Yejin Choi
Links: [url]
Citations: [full citation][bibtex]
Taylor Sorensen, Liwei Jiang, Jena Hwang, Sydney Levine, Valentina Pyatkin, Peter West, Nouha Dziri, Ximing Lu, Kavel Rao, Chandra Bhagavatula, Maarten Sap, John Tasioulas & Yejin Choi (2024) Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties. AAAI. https://arxiv.org/abs/2309.00779
@inproceedings{sorensen2024valueKaleidoscope,
  title={Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties},
  author={Sorensen, Taylor and Jiang, Liwei and Hwang, Jena and Levine, Sydney and Pyatkin, Valentina and West, Peter and Dziri, Nouha and Lu, Ximing and Rao, Kavel and Bhagavatula, Chandra and Sap, Maarten and Tasioulas, John and Choi, Yejin},
  year={2024},
  url={https://arxiv.org/abs/2309.00779},
  booktitle={AAAI}
}

2023

"Don't Take This Out of Context!" On the Need for Contextual Models and Evaluations for Stylistic Rewriting
EMNLP (2023) conference toxic-language
Akhila Yerukola, Xuhui Zhou, Elizabeth Clark & Maarten Sap
Akhila Yerukola, Xuhui Zhou, Elizabeth Clark & Maarten Sap (2023) "Don't Take This Out of Context!" On the Need for Contextual Models and Evaluations for Stylistic Rewriting. EMNLP. https://arxiv.org/abs/2305.14755
@inproceedings{yerukola2023contextRewrite,
  title={``Don't Take This Out of Context!'' On the Need for Contextual Models and Evaluations for Stylistic Rewriting},
  author={Yerukola, Akhila and Zhou, Xuhui and Clark, Elizabeth and Sap, Maarten},
  year={2023},
  booktitle={EMNLP},
  url={https://arxiv.org/abs/2305.14755}
}
BiasX: "Thinking Slow" in Toxic Language Annotation with Explanations of Implied Social Biases
EMNLP (2023) conference toxic-language
Yiming Zhang, Sravani U. Nanduri, Liwei Jiang, Tongshuang Wu & Maarten Sap
Yiming Zhang, Sravani U. Nanduri, Liwei Jiang, Tongshuang Wu & Maarten Sap (2023) BiasX: "Thinking Slow" in Toxic Language Annotation with Explanations of Implied Social Biases. EMNLP. https://arxiv.org/abs/2305.13589
@inproceedings{zhang2023biasX,
  title={BiasX: ``Thinking Slow'' in Toxic Language Annotation with Explanations of Implied Social Biases},
  author={Zhang, Yiming and Nanduri, Sravani U. and Jiang, Liwei and Wu, Tongshuang and Sap, Maarten},
  year={2023},
  booktitle={EMNLP},
  url={https://arxiv.org/abs/2305.13589}
}
Modeling Empathic Similarity in Personal Narratives
EMNLP (2023) conference stories
Jocelyn Shen, Maarten Sap, Pedro Colon-Hernandez, Hae Won Park & Cynthia Breazeal
Jocelyn Shen, Maarten Sap, Pedro Colon-Hernandez, Hae Won Park & Cynthia Breazeal (2023) Modeling Empathic Similarity in Personal Narratives. EMNLP. https://arxiv.org/abs/2305.14246
@inproceedings{shen2023empathicSimilarity,
  title={Modeling Empathic Similarity in Personal Narratives},
  author={Shen, Jocelyn and Sap, Maarten and Colon-Hernandez, Pedro and Park, Hae Won and Breazeal, Cynthia},
  year={2023},
  booktitle={EMNLP},
  url={https://arxiv.org/abs/2305.14246}
}
Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Language
Findings of EMNLP (2023) conference toxic-language
Jimin Mun, Emily Allaway, Akhila Yerukola, Laura Vianna, Sarah-Jane Leslie & Maarten Sap
Jimin Mun, Emily Allaway, Akhila Yerukola, Laura Vianna, Sarah-Jane Leslie & Maarten Sap (2023) Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Language. Findings of EMNLP. https://arxiv.org/abs/2311.00161
@inproceedings{mun2023beyondDenouncingHate,
  title={Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Language},
  author={Mun, Jimin and Allaway, Emily and Yerukola, Akhila and Vianna, Laura and Leslie, Sarah-Jane and Sap, Maarten},
  year={2023},
  url={https://arxiv.org/abs/2311.00161},
  booktitle={Findings of EMNLP}
}
From Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Models
ACL (2023) conference toxic-language
Julia Mendelsohn, Ronan Le Bras, Yejin Choi & Maarten Sap
Julia Mendelsohn, Ronan Le Bras, Yejin Choi & Maarten Sap (2023) From Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Models. ACL. https://arxiv.org/abs/2305.17174
@inproceedings{mendelsohn2023dogwhistles,
  title={From Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Models},
  author={Mendelsohn, Julia and Bras, Ronan Le and Choi, Yejin and Sap, Maarten},
  year={2023},
  booktitle={ACL},
  url={https://arxiv.org/abs/2305.17174}
}
NLPositionality: Characterizing Design Biases of Datasets and Models
ACL (2023) conference ai-ethics
Sebastin Santy*, Jenny T. Liang*, Ronan Le Bras, Katharina Reinecke & Maarten Sap
Sebastin Santy, Jenny T. Liang, Ronan Le Bras, Katharina Reinecke & Maarten Sap (2023) NLPositionality: Characterizing Design Biases of Datasets and Models. ACL. https://arxiv.org/abs/2306.01943
@inproceedings{santy2023nlpositionality,
  title={NLPositionality: Characterizing Design Biases of Datasets and Models},
  author={Santy, Sebastin and Liang, Jenny T. and Bras, Ronan Le and Reinecke, Katharina and Sap, Maarten},
  year={2023},
  booktitle={ACL},
  url={https://arxiv.org/abs/2306.01943}
}
News: [marktechpost.com] Outstanding Paper Award at ACL 2023 (top 2.5%)
Detoxifying Text with MaRCo: Controllable Revision with Experts and Anti-Experts
ACL (2023) conference toxic-language
Skyler Hallinan, Alisa Liu, Yejin Choi & Maarten Sap
Skyler Hallinan, Alisa Liu, Yejin Choi & Maarten Sap (2023) Detoxifying Text with MaRCo: Controllable Revision with Experts and Anti-Experts. ACL. https://arxiv.org/abs/2212.10543
@inproceedings{hallinan2023marco,
  title={Detoxifying Text with MaRCo: Controllable Revision with Experts and Anti-Experts},
  author={Hallinan, Skyler and Liu, Alisa and Choi, Yejin and Sap, Maarten},
  year={2023},
  url={https://arxiv.org/abs/2212.10543},
  booktitle={ACL}
}
Queer In AI: A Case Study in Community-Led Participatory AI
FAccT (2023) conference ai-ethics
Organizers Of QueerinAI, Anaelia Ovalle, Arjun Subramonian, Ashwin Singh, Claas Voelcker, Danica J. Sutherl, Davide Locatelli, Eva Breznik, Filip Klubicka, Hang Yuan, J Hetvi, Huan Zhang, Jaidev Shriram, Kruno Lehman, Luca Soldaini, Maarten Sap, Marc Peter Deisenroth, Maria Leonor Pacheco, Maria Ryskina, Martin Mundt, Milind Agarwal, Nyx McLean, Pan Xu, A Pranav, Raj Korpan, Ruchira Ray, Sarah Mathew, Sarthak Arora, St John, Tanvi An, Vishakha Agrawal, William Agnew, Yanan Long, Zijie J. Wang, Zeerak Talat, Avijit Ghosh, Nathaniel Dennler, Michael Noseworthy, Sharvani Jha, Emily Baylor, Aditya Joshi, Natalia Y. Bilenko, Andrew McNamara, Raphael Gontijo-Lopes, Alex Markham, Evyn Dǒng, Jackie Kay, Manu Saraswat, Nikhil Vytla & Luke Stark
Links: [url]
Citations: [full citation][bibtex]
Organizers Of QueerinAI, Anaelia Ovalle, Arjun Subramonian, Ashwin Singh, Claas Voelcker, Danica J. Sutherl, Davide Locatelli, Eva Breznik, Filip Klubicka, Hang Yuan, J Hetvi, Huan Zhang, Jaidev Shriram, Kruno Lehman, Luca Soldaini, Maarten Sap, Marc Peter Deisenroth, Maria Leonor Pacheco, Maria Ryskina, Martin Mundt, Milind Agarwal, Nyx McLean, Pan Xu, A Pranav, Raj Korpan, Ruchira Ray, Sarah Mathew, Sarthak Arora, St John, Tanvi An, Vishakha Agrawal, William Agnew, Yanan Long, Zijie J. Wang, Zeerak Talat, Avijit Ghosh, Nathaniel Dennler, Michael Noseworthy, Sharvani Jha, Emily Baylor, Aditya Joshi, Natalia Y. Bilenko, Andrew McNamara, Raphael Gontijo-Lopes, Alex Markham, Evyn Dǒng, Jackie Kay, Manu Saraswat, Nikhil Vytla & Luke Stark (2023) Queer In AI: A Case Study in Community-Led Participatory AI. FAccT. https://dl.acm.org/doi/10.1145/3593013.3594134
@inproceedings{OrganizersOfQueerin2023QueerAI,
  title={Queer In AI: A Case Study in Community-Led Participatory AI},
  author={QueerinAI, Organizers Of and Ovalle, Anaelia and Subramonian, Arjun and Singh, Ashwin and Voelcker, Claas and Sutherl, Danica J. and Locatelli, Davide and Breznik, Eva and Klubicka, Filip and Yuan, Hang and Hetvi, J and Zhang, Huan and Shriram, Jaidev and Lehman, Kruno and Soldaini, Luca and Sap, Maarten and Deisenroth, Marc Peter and Pacheco, Maria Leonor and Ryskina, Maria and Mundt, Martin and Agarwal, Milind and McLean, Nyx and Xu, Pan and Pranav, A and Korpan, Raj and Ray, Ruchira and Mathew, Sarah and Arora, Sarthak and John, St and An, Tanvi and Agrawal, Vishakha and Agnew, William and Long, Yanan and Wang, Zijie J. and Talat, Zeerak and Ghosh, Avijit and Dennler, Nathaniel and Noseworthy, Michael and Jha, Sharvani and Baylor, Emily and Joshi, Aditya and Bilenko, Natalia Y. and McNamara, Andrew and Gontijo-Lopes, Raphael and Markham, Alex and Dǒng, Evyn and Kay, Jackie and Saraswat, Manu and Vytla, Nikhil and Stark, Luke},
  booktitle={FAccT},
  year={2023},
  url={https://dl.acm.org/doi/10.1145/3593013.3594134}
}
Best paper at FAccT 2023

2022

Towards Countering Essentialism through Social Bias Reasoning
EMNLP workshop on NLP for Positive Impact (2022) workshop toxic-language
Emily Allaway, Nina Taneja, Sarah-Jane Leslie & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Emily Allaway, Nina Taneja, Sarah-Jane Leslie & Maarten Sap (2022) Towards Countering Essentialism through Social Bias Reasoning. EMNLP workshop on NLP for Positive Impact. https://arxiv.org/abs/2303.16173
@inproceedings{allaway2022countering,
  title={Towards Countering Essentialism through Social Bias Reasoning},
  author={Allaway, Emily and Taneja, Nina and Leslie, Sarah-Jane and Sap, Maarten},
  booktitle={EMNLP workshop on NLP for Positive Impact},
  url={https://arxiv.org/abs/2303.16173},
  year={2022}
}
Aligning to Social Norms and Values in Interactive Narratives
NAACL (2022) conference ai-ethics
Prithviraj Ammanabrolu, Liwei Jiang, Maarten Sap, Hanna Hajishirzi, Yejin Choi & Noah A. Smith
Links: [url]
Citations: [full citation][bibtex]
Prithviraj Ammanabrolu, Liwei Jiang, Maarten Sap, Hanna Hajishirzi, Yejin Choi & Noah A. Smith (2022) Aligning to Social Norms and Values in Interactive Narratives. NAACL. https://arxiv.org/abs/2205.01975
@inproceedings{ammanabrolu2022galad,
  title={Aligning to Social Norms and Values in Interactive Narratives},
  author={Ammanabrolu, Prithviraj and Jiang, Liwei and Sap, Maarten and Hajishirzi, Hanna and Choi, Yejin and Smith, Noah A.},
  year={2022},
  booktitle={NAACL},
  url={https://arxiv.org/abs/2205.01975}
}
ToxiGen: Controlling Language Models to Generate Implied and Adversarial Toxicity
ACL (2022) conference toxic-language llms
Thomas Hartvigsen, Saadia Gabriel, Hamid Palangi, Maarten Sap, Dipankar Ray & Ece Kamar
Thomas Hartvigsen, Saadia Gabriel, Hamid Palangi, Maarten Sap, Dipankar Ray & Ece Kamar (2022) ToxiGen: Controlling Language Models to Generate Implied and Adversarial Toxicity. ACL. https://arxiv.org/abs/2203.09509
@inproceedings{hartvigsen2022toxigen,
  title={ToxiGen: Controlling Language Models to Generate Implied and Adversarial Toxicity},
  author={Hartvigsen, Thomas and Gabriel, Saadia and Palangi, Hamid and Sap, Maarten and Ray, Dipankar and Kamar, Ece},
  booktitle={ACL},
  year={2022},
  url={https://arxiv.org/abs/2203.09509}
}
Uncovering Surprising Event Boundaries in Narratives
Workshop on Narrative Understanding (2022) workshop stories
Zhilin Wang, Anna Jafarpour & Maarten Sap
Links: [url]
Citations: [full citation][bibtex]
Zhilin Wang, Anna Jafarpour & Maarten Sap (2022) Uncovering Surprising Event Boundaries in Narratives. Workshop on Narrative Understanding. https://aclanthology.org/2022.wnu-1.1/
@inproceedings{wang2022surprising,
  title={Uncovering Surprising Event Boundaries in Narratives},
  author={Wang, Zhilin and Jafarpour, Anna and Sap, Maarten},
  url={https://aclanthology.org/2022.wnu-1.1/},
  year={2022},
  booktitle={Workshop on Narrative Understanding}
}

2021

Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus
EMNLP (2021) conference ai-ethics llms
Jesse Dodge, Maarten Sap, Ana Marasović, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Margaret Mitchell & Matt Gardner
Jesse Dodge, Maarten Sap, Ana Marasović, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Margaret Mitchell & Matt Gardner (2021) Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus. EMNLP. https://aclanthology.org/2021.emnlp-main.98/
@inproceedings{dodge2021documentingC4,
  title={Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus},
  author={Dodge, Jesse and Sap, Maarten and Marasović, Ana and Agnew, William and Ilharco, Gabriel and Groeneveld, Dirk and Mitchell, Margaret and Gardner, Matt},
  booktitle={EMNLP},
  url={https://aclanthology.org/2021.emnlp-main.98/},
  year={2021}
}
News: [washingtonpost.com] [wired.com] [wired.com] [unite.ai] [nature.com]
Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contexts
EMNLP (2021) conference toxic-language conversation
Ashutosh Baheti, Maarten Sap, Alan Ritter & Mark Riedl
Ashutosh Baheti, Maarten Sap, Alan Ritter & Mark Riedl (2021) Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contexts. EMNLP. https://aclanthology.org/2021.emnlp-main.397/
@inproceedings{baheti2021justSayNo,
  title={Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contexts},
  author={Baheti, Ashutosh and Sap, Maarten and Ritter, Alan and Riedl, Mark},
  booktitle={EMNLP},
  year={2021},
  url={https://aclanthology.org/2021.emnlp-main.397/}
}
News: [thenextweb.com]
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts
ACL (2021) conference toxic-language llms
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith & Yejin Choi
Links: [url]
Citations: [full citation][bibtex]
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith & Yejin Choi (2021) DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts. ACL. https://aclanthology.org/2021.acl-long.522/
@inproceedings{liu2021dexperts,
  title={DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts},
  author={Liu, Alisa and Sap, Maarten and Lu, Ximing and Swayamdipta, Swabha and Bhagavatula, Chandra and Smith, Noah A. and Choi, Yejin},
  booktitle={ACL},
  year={2021},
  url={https://aclanthology.org/2021.acl-long.522/}
}
News: [geekwire.com]
Detoxifying Language Models Risks Marginalizing Minority Voices
NAACL (2021) conference toxic-language llms
Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap & Dan Klein
Links: [url]
Citations: [full citation][bibtex]
Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap & Dan Klein (2021) Detoxifying Language Models Risks Marginalizing Minority Voices. NAACL. https://aclanthology.org/2021.naacl-main.190/
@inproceedings{xu2021detoxifying,
  title={Detoxifying Language Models Risks Marginalizing Minority Voices},
  author={Xu, Albert and Pathak, Eshaan and Wallace, Eric and Gururangan, Suchin and Sap, Maarten and Klein, Dan},
  booktitle={NAACL},
  year={2021},
  url={https://aclanthology.org/2021.naacl-main.190/}
}
Challenges in Automated Debiasing for Toxic Language Detection
EACL (2021) conference toxic-language ai-ethics
Xuhui Zhou, Maarten Sap, Swabha Swayamdipta, Yejin Choi & Noah A. Smith
Xuhui Zhou, Maarten Sap, Swabha Swayamdipta, Yejin Choi & Noah A. Smith (2021) Challenges in Automated Debiasing for Toxic Language Detection. EACL. https://aclanthology.org/2021.eacl-main.274/
@inproceedings{zhou2021challenges,
  title={Challenges in Automated Debiasing for Toxic Language Detection},
  author={Zhou, Xuhui and Sap, Maarten and Swayamdipta, Swabha and Choi, Yejin and Smith, Noah A.},
  booktitle={EACL},
  url={https://aclanthology.org/2021.eacl-main.274/},
  year={2021}
}

2020

PowerTransformer: Unsupervised Controllable Revision for Biased Language Correction
EMNLP (2020) conference toxic-language stories
Xinyao Ma*, Maarten Sap*, Hannah Rashkin & Yejin Choi
Xinyao Ma, Maarten Sap, Hannah Rashkin & Yejin Choi (2020) PowerTransformer: Unsupervised Controllable Revision for Biased Language Correction. EMNLP. https://www.aclweb.org/anthology/2020.emnlp-main.602
@inproceedings{ma2020powerTransformer,
  title={PowerTransformer: Unsupervised Controllable Revision for Biased Language Correction},
  author={Ma, Xinyao and Sap, Maarten and Rashkin, Hannah and Choi, Yejin},
  year={2020},
  booktitle={EMNLP},
  url={https://www.aclweb.org/anthology/2020.emnlp-main.602}
}
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models
Findings of EMNLP (2020) conference toxic-language llms
Sam Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi & Noah A Smith
Sam Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi & Noah A Smith (2020) RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models. Findings of EMNLP. https://www.aclweb.org/anthology/2020.findings-emnlp.301/
@inproceedings{gehman2020realtoxicityprompts,
  title={RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models},
  author={Gehman, Sam and Gururangan, Suchin and Sap, Maarten and Choi, Yejin and Smith, Noah A},
  year={2020},
  booktitle={Findings of EMNLP},
  url={https://www.aclweb.org/anthology/2020.findings-emnlp.301/}
}
News: [ieee.org] [fortune.com] [geekwire.com] [wired.com] [org]
Social Chemistry 101: Learning to Reason about Social and Moral Norms
EMNLP (2020) conference toxic-language
Maxwell Forbes, Jena D. Hwang, Vered Shwartz, Maarten Sap & Yejin Choi
Maxwell Forbes, Jena D. Hwang, Vered Shwartz, Maarten Sap & Yejin Choi (2020) Social Chemistry 101: Learning to Reason about Social and Moral Norms. EMNLP. https://www.aclweb.org/anthology/2020.emnlp-main.48
@inproceedings{forbes2020socialchemistry,
  title={Social Chemistry 101: Learning to Reason about Social and Moral Norms},
  author={Forbes, Maxwell and Hwang, Jena D. and Shwartz, Vered and Sap, Maarten and Choi, Yejin},
  year={2020},
  booktitle={EMNLP},
  url={https://www.aclweb.org/anthology/2020.emnlp-main.48}
}
Recollection versus Imagination: Exploring Human Memory and Cognition via Neural Language Models
ACL (2020) conference stories
Maarten Sap, Eric Horvitz, Yejin Choi, Noah A Smith & James W. Pennebaker
Maarten Sap, Eric Horvitz, Yejin Choi, Noah A Smith & James W. Pennebaker (2020) Recollection versus Imagination: Exploring Human Memory and Cognition via Neural Language Models. ACL. https://www.aclweb.org/anthology/2020.acl-main.178
@inproceedings{sap2020recollectionImagination,
  title={Recollection versus Imagination: Exploring Human Memory and Cognition via Neural Language Models},
  author={Sap, Maarten and Horvitz, Eric and Choi, Yejin and Smith, Noah A and Pennebaker, James W.},
  year={2020},
  booktitle={ACL},
  url={https://www.aclweb.org/anthology/2020.acl-main.178}
}
Social Bias Frames: Reasoning about Social and Power Implications of Language
ACL (2020) conference toxic-language
Maarten Sap, Saadia Gabriel, Lianhui Qin, Dan Jurafsky, Noah A Smith & Yejin Choi
Maarten Sap, Saadia Gabriel, Lianhui Qin, Dan Jurafsky, Noah A Smith & Yejin Choi (2020) Social Bias Frames: Reasoning about Social and Power Implications of Language. ACL. https://www.aclweb.org/anthology/2020.acl-main.486
@inproceedings{sap2020socialbiasframes,
  title={Social Bias Frames: Reasoning about Social and Power Implications of Language},
  author={Sap, Maarten and Gabriel, Saadia and Qin, Lianhui and Jurafsky, Dan and Smith, Noah A and Choi, Yejin},
  year={2020},
  booktitle={ACL},
  url={https://www.aclweb.org/anthology/2020.acl-main.486}
}
Best paper at WeCNLP 2020
Exploring the Effect of Author and Reader Identity in Online Story Writing: the StoriesInTheWild Corpus
Workshop on Narrative Understanding, Storylines, and Events (NUSE)@ ACL (2020) workshop stories
Tal August, Maarten Sap, Elizabeth Clark, Katharina Reinecke & Noah A. Smith
Tal August, Maarten Sap, Elizabeth Clark, Katharina Reinecke & Noah A. Smith (2020) Exploring the Effect of Author and Reader Identity in Online Story Writing: the StoriesInTheWild Corpus. Workshop on Narrative Understanding, Storylines, and Events (NUSE)@ ACL. https://www.aclweb.org/anthology/2020.nuse-1.6
@inproceedings{august2020storiesInTheWild,
  title={Exploring the Effect of Author and Reader Identity in Online Story Writing: the StoriesInTheWild Corpus},
  author={August, Tal and Sap, Maarten and Clark, Elizabeth and Reinecke, Katharina and Smith, Noah A.},
  year={2020},
  booktitle={Workshop on Narrative Understanding, Storylines, and Events (NUSE)@ ACL},
  url={https://www.aclweb.org/anthology/2020.nuse-1.6}
}

2019

The Risk of Racial Bias in Hate Speech Detection
ACL (2019) conference ai-ethics toxic-language
Maarten Sap, Dallas Card, Saadia Gabriel, Yejin Choi & Noah A Smith
Maarten Sap, Dallas Card, Saadia Gabriel, Yejin Choi & Noah A Smith (2019) The Risk of Racial Bias in Hate Speech Detection. ACL. https://www.aclweb.org/anthology/P19-1163.pdf
@inproceedings{sap2019risk,
  title={The Risk of Racial Bias in Hate Speech Detection},
  author={Sap, Maarten and Card, Dallas and Gabriel, Saadia and Choi, Yejin and Smith, Noah A},
  year={2019},
  booktitle={ACL},
  url={https://www.aclweb.org/anthology/P19-1163.pdf}
}
News: [forbes.com] [vox.com] [observer.com] [fortune.com] [techcrunch.com] Best short paper nomination (top 5%)

2018

Sounding Board: A User-Centric and Content-Driven Social Chatbot
NAACL System Demonstrations (2018) demo conversation
Hao Fang, Hao Cheng, Maarten Sap, Elizabeth Clark, Ariel Holtzman, Yejin Choi, Noah A Smith & Mari Ostendorf
Hao Fang, Hao Cheng, Maarten Sap, Elizabeth Clark, Ariel Holtzman, Yejin Choi, Noah A Smith & Mari Ostendorf (2018) Sounding Board: A User-Centric and Content-Driven Social Chatbot. NAACL System Demonstrations. https://www.aclweb.org/anthology/N18-5020
@inproceedings{fang2018soundingboard,
  title={Sounding Board: A User-Centric and Content-Driven Social Chatbot},
  author={Fang, Hao and Cheng, Hao and Sap, Maarten and Clark, Elizabeth and Holtzman, Ariel and Choi, Yejin and Smith, Noah A and Ostendorf, Mari},
  year={2018},
  booktitle={NAACL System Demonstrations},
  url={https://www.aclweb.org/anthology/N18-5020}
}

2017

DLATK: Differential Language Analysis ToolKit
EMNLP System Demonstrations (2017) demo psychology
H Andrew Schwartz, Salvatore Giorgi, Maarten Sap, Patrick Crutchley, Lyle Ungar & Johannes Eichstaedt
H Andrew Schwartz, Salvatore Giorgi, Maarten Sap, Patrick Crutchley, Lyle Ungar & Johannes Eichstaedt (2017) DLATK: Differential Language Analysis ToolKit. EMNLP System Demonstrations. 55--60. https://www.aclweb.org/anthology/D17-2010
@inproceedings{schwartz2017dlatk,
  title={DLATK: Differential Language Analysis ToolKit},
  author={Schwartz, H Andrew and Giorgi, Salvatore and Sap, Maarten and Crutchley, Patrick and Ungar, Lyle and Eichstaedt, Johannes},
  booktitle={EMNLP System Demonstrations},
  pages={55--60},
  year={2017},
  url={https://www.aclweb.org/anthology/D17-2010}
}
Sounding Board - University of Washington’s Alexa Prize Submission
Alexa Prize Proceedings (2017) other conversation
Hao Fang, Hao Cheng, Elizabeth Clark, Ariel Holtzman, Maarten Sap, Mari Ostendorf, Yejin Choi & Noah A Smith
Hao Fang, Hao Cheng, Elizabeth Clark, Ariel Holtzman, Maarten Sap, Mari Ostendorf, Yejin Choi & Noah A Smith (2017) Sounding Board - University of Washington’s Alexa Prize Submission. Alexa Prize Proceedings.
@inproceedings{fang2017alexatechreport,
  title={Sounding Board - University of Washington’s Alexa Prize Submission},
  author={Fang, Hao and Cheng, Hao and Clark, Elizabeth and Holtzman, Ariel and Sap, Maarten and Ostendorf, Mari and Choi, Yejin and Smith, Noah A},
  booktitle={Alexa Prize Proceedings},
  year={2017}
}
News: [theverge.com] [geekwire.com] [wired.com] [q13fox.com] [dailyuw.com] [seattletimes.com] [komonews.com] [amazon.com] [komonews.com] [geekwire.com]
The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task
CoNLL (2017) conference stories
Roy Schwartz, Maarten Sap, Ioannis Konstas, Li Zilles, Yejin Choi & Noah A Smith
Roy Schwartz, Maarten Sap, Ioannis Konstas, Li Zilles, Yejin Choi & Noah A Smith (2017) The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task. CoNLL. https://www.aclweb.org/anthology/K17-1004
@inproceedings{schwartz2017effect,
  title={The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task},
  author={Schwartz, Roy and Sap, Maarten and Konstas, Ioannis and Zilles, Li and Choi, Yejin and Smith, Noah A},
  booktitle={CoNLL},
  year={2017},
  url={https://www.aclweb.org/anthology/K17-1004}
}
Story Cloze task: UW NLP System
EACL Workshop LSD Sem (2017) workshop stories
Roy Schwartz, Maarten Sap, Ioannis Konstas, Li Zilles, Yejin Choi & Noah A Smith
Links: [pdf]
Citations: [full citation][bibtex]
Roy Schwartz, Maarten Sap, Ioannis Konstas, Li Zilles, Yejin Choi & Noah A Smith (2017) Story Cloze task: UW NLP System. EACL Workshop LSD Sem. 52--55.
@inproceedings{schwartz2017story,
  title={Story Cloze task: UW NLP System},
  author={Schwartz, Roy and Sap, Maarten and Konstas, Ioannis and Zilles, Li and Choi, Yejin and Smith, Noah A},
  booktitle={EACL Workshop LSD Sem},
  pages={52--55},
  year={2017}
}
Living in the Past, Present, and Future: Measuring Temporal Orientation with Language
Journal of Personality (2017) journal psychology
Gregory Park, H Andrew Schwartz, Maarten Sap, Margaret L Kern, Evan Weingarten, Johannes C Eichstaedt, Jonah Berger, David J Stillwell, Michal Kosinski, Lyle H Ungar & Martin E P Seligman
Links: [pdf]
Citations: [full citation][bibtex]
Gregory Park, H Andrew Schwartz, Maarten Sap, Margaret L Kern, Evan Weingarten, Johannes C Eichstaedt, Jonah Berger, David J Stillwell, Michal Kosinski, Lyle H Ungar & Martin E P Seligman (2017) Living in the Past, Present, and Future: Measuring Temporal Orientation with Language. Journal of Personality.
@article{park2017living,
  title={Living in the Past, Present, and Future: Measuring Temporal Orientation with Language},
  author={Park, Gregory and Schwartz, H Andrew and Sap, Maarten and Kern, Margaret L and Weingarten, Evan and Eichstaedt, Johannes C and Berger, Jonah and Stillwell, David J and Kosinski, Michal and Ungar, Lyle H and Seligman, Martin E P},
  journal={Journal of Personality},
  year={2017}
}

2016

Gaining Insights From Social Media Language: Methodologies and Challenges
Psychological Methods (2016) journal psychology
Margaret L Kern, Gregory Park, Johannes C Eichstaedt, H Andrew Schwartz, Maarten Sap, Laura K, Smith & Lyle H Ungar
Margaret L Kern, Gregory Park, Johannes C Eichstaedt, H Andrew Schwartz, Maarten Sap, Laura K, Smith & Lyle H Ungar (2016) Gaining Insights From Social Media Language: Methodologies and Challenges. Psychological Methods. http://dx.doi.org/10.1037/met0000091
@article{kern2016gaining,
  title={Gaining Insights From Social Media Language: Methodologies and Challenges},
  author={Kern, Margaret L and Park, Gregory and Eichstaedt, Johannes C and Schwartz, H Andrew and Sap, Maarten and Smith, Laura K, and Ungar, Lyle H},
  year={2016},
  journal={Psychological Methods},
  doi={10.1037/met0000091},
  url={http://dx.doi.org/10.1037/met0000091}
}
Predicting individual well-being through the language of social media
Biocomputing 2016: Proceedings of the Pacific Symposium (2016) other psychology
H Andrew Schwartz, Maarten Sap, Margaret L Kern, Johannes C Eichstaedt, Adam Kapelner, Megha Agrawal, Eduardo Blanco, Lukasz Dziurzynski, Gregory Park, David Stillwell, Michal Kosinski, Martin E P Seligman & Lyle H Ungar
Links: [pdf]
Citations: [full citation][bibtex]
H Andrew Schwartz, Maarten Sap, Margaret L Kern, Johannes C Eichstaedt, Adam Kapelner, Megha Agrawal, Eduardo Blanco, Lukasz Dziurzynski, Gregory Park, David Stillwell, Michal Kosinski, Martin E P Seligman & Lyle H Ungar (2016) Predicting individual well-being through the language of social media. Biocomputing 2016: Proceedings of the Pacific Symposium. 516--527.
@inproceedings{schwartz2016predicting,
  title={Predicting individual well-being through the language of social media},
  author={Schwartz, H Andrew and Sap, Maarten and Kern, Margaret L and Eichstaedt, Johannes C and Kapelner, Adam and Agrawal, Megha and Blanco, Eduardo and Dziurzynski, Lukasz and Park, Gregory and Stillwell, David and Kosinski, Michal and Seligman, Martin E P and Ungar, Lyle H},
  booktitle={Biocomputing 2016: Proceedings of the Pacific Symposium},
  pages={516--527},
  year={2016}
}

2015

Psychological Language on Twitter Predicts County-level Heart Disease Mortality
Psychological Science (2015) journal psychology medical
Johannes C Eichstaedt, H Andrew Schwartz, Margaret L Kern, Gregory Park, Darwin R Labarthe, Raina M Merchant, Sneha Jha, Megha Agrawal, Lukasz A Dziurzynski, Maarten Sap, Christopher Weeg, Emily Larson, Lyle H Ungar & Martin E P Seligman
Links: [pdf]
Citations: [full citation][bibtex]
Johannes C Eichstaedt, H Andrew Schwartz, Margaret L Kern, Gregory Park, Darwin R Labarthe, Raina M Merchant, Sneha Jha, Megha Agrawal, Lukasz A Dziurzynski, Maarten Sap, Christopher Weeg, Emily Larson, Lyle H Ungar & Martin E P Seligman (2015) Psychological Language on Twitter Predicts County-level Heart Disease Mortality. Psychological Science 26(2). SAGE Publications. 159--169.
@article{eichstaedt2015psychological,
  title={Psychological Language on Twitter Predicts County-level Heart Disease Mortality},
  author={Eichstaedt, Johannes C and Schwartz, H Andrew and Kern, Margaret L and Park, Gregory and Labarthe, Darwin R and Merchant, Raina M and Jha, Sneha and Agrawal, Megha and Dziurzynski, Lukasz A and Sap, Maarten and Weeg, Christopher and Larson, Emily and Ungar, Lyle H and Seligman, Martin E P},
  journal={Psychological Science},
  volume={26},
  number={2},
  pages={159--169},
  year={2015},
  publisher={SAGE Publications}
}
Extracting Human Temporal Orientation from Facebook Language
NAACL (2015) conference psychology
H. Andrew Schwartz, Gregory Park, Maarten Sap, Evan Weingarten, Johannes Eichstaedt, Margaret Kern, David Stillwell, Michal Kosinski, Jonah Berger, Martin Seligman & Lyle Ungar
H. Andrew Schwartz, Gregory Park, Maarten Sap, Evan Weingarten, Johannes Eichstaedt, Margaret Kern, David Stillwell, Michal Kosinski, Jonah Berger, Martin Seligman & Lyle Ungar (2015) Extracting Human Temporal Orientation from Facebook Language. NAACL. http://www.aclweb.org/anthology/N15-1044
@inproceedings{schwartz2015extracting,
  title={Extracting Human Temporal Orientation from Facebook Language},
  author={Schwartz, H. Andrew  and  Park, Gregory  and  Sap, Maarten  and  Weingarten, Evan  and  Eichstaedt, Johannes  and  Kern, Margaret  and  Stillwell, David  and  Kosinski, Michal  and  Berger, Jonah  and  Seligman, Martin  and  Ungar, Lyle},
  booktitle={NAACL},
  year={2015},
  url={http://www.aclweb.org/anthology/N15-1044}
}
Mental Illness Detection at the World Well-Being Project for the CLPsych 2015 Shared Task
NAACL Workshop on CLPsych (2015) workshop psychology medical
Daniel Preotiuc-Pietro, Maarten Sap, H Andrew Schwartz & Lyle Ungar
Daniel Preotiuc-Pietro, Maarten Sap, H Andrew Schwartz & Lyle Ungar (2015) Mental Illness Detection at the World Well-Being Project for the CLPsych 2015 Shared Task. NAACL Workshop on CLPsych. https://www.aclweb.org/anthology/W15-1205
@inproceedings{preotiuc2015mental,
  title={Mental Illness Detection at the World Well-Being Project for the CLPsych 2015 Shared Task},
  author={Preotiuc-Pietro, Daniel and Sap, Maarten and Schwartz, H Andrew and Ungar, Lyle},
  booktitle={NAACL Workshop on CLPsych},
  year={2015},
  url={https://www.aclweb.org/anthology/W15-1205}
}
The Role of Personality, Age and Gender in Tweeting about Mental Illnesses
NAACL Workshop on CLPsych (2015) workshop psychology medical
Daniel Preotiuc-Pietro, Johannes Eichstaedt, Gregory Park, Maarten Sap, Laura Smith, Victoria Tobolsky, H Andrew Schwartz & Lyle Ungar
Daniel Preotiuc-Pietro, Johannes Eichstaedt, Gregory Park, Maarten Sap, Laura Smith, Victoria Tobolsky, H Andrew Schwartz & Lyle Ungar (2015) The Role of Personality, Age and Gender in Tweeting about Mental Illnesses. NAACL Workshop on CLPsych. https://www.aclweb.org/anthology/W15-1203
@inproceedings{preotiuc2015role,
  title={The Role of Personality, Age and Gender in Tweeting about Mental Illnesses},
  author={Preotiuc-Pietro, Daniel and Eichstaedt, Johannes and Park, Gregory and Sap, Maarten and Smith, Laura and Tobolsky, Victoria and Schwartz, H Andrew and Ungar, Lyle},
  booktitle={NAACL Workshop on CLPsych},
  year={2015},
  url={https://www.aclweb.org/anthology/W15-1203}
}
Twitter Sentiment Predicts Affordable Care Act Marketplace Enrollment
Journal of Medical Internet Research (2015) journal medical
Charlene A Wong, Maarten Sap, Hansen Andrew Schwartz, Robert Town, Tom Baker, Lyle Ungar & Raina M Merchant
Links: [url]
Citations: [full citation][bibtex]
Charlene A Wong, Maarten Sap, Hansen Andrew Schwartz, Robert Town, Tom Baker, Lyle Ungar & Raina M Merchant (2015) Twitter Sentiment Predicts Affordable Care Act Marketplace Enrollment. Journal of Medical Internet Research 17(2). JMIR Publications Inc.. https://www.jmir.org/2015/2/e51/
@article{wong2015twitter,
  title={Twitter Sentiment Predicts Affordable Care Act Marketplace Enrollment},
  author={Wong, Charlene A and Sap, Maarten and Schwartz, Hansen Andrew and Town, Robert and Baker, Tom and Ungar, Lyle and Merchant, Raina M},
  journal={Journal of Medical Internet Research},
  volume={17},
  number={2},
  year={2015},
  publisher={JMIR Publications Inc.},
  url={https://www.jmir.org/2015/2/e51/}
}

2014

Developing Age and Gender Predictive Lexica over Social Media
EMNLP (2014) conference psychology
Maarten Sap, Gregory Park, Johannes C. Eichstaedt, Margaret L. Kern, David J. Stillwell, Michal Kosinski, Lyle H. Ungar & Hansen Andrew Schwartz
Maarten Sap, Gregory Park, Johannes C. Eichstaedt, Margaret L. Kern, David J. Stillwell, Michal Kosinski, Lyle H. Ungar & Hansen Andrew Schwartz (2014) Developing Age and Gender Predictive Lexica over Social Media. EMNLP. https://www.aclweb.org/anthology/D14-1121/
@inproceedings{sap2014developing,
  title={Developing Age and Gender Predictive Lexica over Social Media},
  author={Sap, Maarten and Park, Gregory and Eichstaedt, Johannes C. and Kern, Margaret L. and Stillwell, David J. and Kosinski, Michal and Ungar, Lyle H. and Schwartz, Hansen Andrew},
  booktitle={EMNLP},
  year={2014},
  url={https://www.aclweb.org/anthology/D14-1121/}
}
Towards Assessing Changes in Degree of Depression through Facebook
ACL Workshop on CLPsych (2014) workshop psychology medical
H Andrew Schwartz, Johannes Eichstaedt, Margaret L Kern, Gregory Park, Maarten Sap, David Stillwell, Michal Kosinski & Lyle Ungar
H Andrew Schwartz, Johannes Eichstaedt, Margaret L Kern, Gregory Park, Maarten Sap, David Stillwell, Michal Kosinski & Lyle Ungar (2014) Towards Assessing Changes in Degree of Depression through Facebook. ACL Workshop on CLPsych. 118--125. https://www.aclweb.org/anthology/W14-3214
@inproceedings{schwartz2014towards,
  title={Towards Assessing Changes in Degree of Depression through Facebook},
  author={Schwartz, H Andrew and Eichstaedt, Johannes and Kern, Margaret L and Park, Gregory and Sap, Maarten and Stillwell, David and Kosinski, Michal and Ungar, Lyle},
  booktitle={ACL Workshop on CLPsych},
  pages={118--125},
  year={2014},
  url={https://www.aclweb.org/anthology/W14-3214}
}
The 2013 US Government Shutdown (#Shutdown) and Health: An Emerging Role for Social Media
American Journal of Public Health (2014) journal medical
Raina M. Merchant, Yoonhee P. Ha, Charlene A. Wong, H. Andrew Schwartz, Maarten Sap, Lyle H. Ungar & David A. Asch
Links: [url]
Citations: [full citation][bibtex]
Raina M. Merchant, Yoonhee P. Ha, Charlene A. Wong, H. Andrew Schwartz, Maarten Sap, Lyle H. Ungar & David A. Asch (2014) The 2013 US Government Shutdown (#Shutdown) and Health: An Emerging Role for Social Media. American Journal of Public Health 2014. e1--e3. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4232112/
@article{merchant20142013,
  title={The 2013 US Government Shutdown (#Shutdown) and Health: An Emerging Role for Social Media},
  author={Merchant, Raina M. and Ha, Yoonhee P. and Wong, Charlene A. and Schwartz, H. Andrew and Sap, Maarten and Ungar, Lyle H. and Asch, David A.},
  journal={American Journal of Public Health},
  volume={2014},
  pages={e1--e3},
  year={2014},
  url={https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4232112/}
}