Publications

We propose a causal framework to quantify the robustness of the reasoning abilities of language models.

Alessandro Stolfo, Zhijing Jin, Kumar Shridhar, Bernhard Schölkopf and Mrinmaya Sachan

arxiv:2210.12023 (also at MATHAI Workshop at NeurIPS 22)    

We reconstruct a long document coreference corpus out of Ontonotes, arriving at a more challenging coreference task and dataset.

Kumar Shridhar, Nicholas Monath, Raghuveer Thirukovalluru, Alessandro Stolfo, Manzil Zaheer, Andrew McCallum and Mrinmaya Sachan

arxiv:2210.03650    

We investigate the connection between Centering theory (a classical theory in discourse) and modern coreference resolution systems.

Yuchen Eleanor Jiang, Ryan Cotterell and Mrinmaya Sachan

arxiv:2210.14678    

We use reinforcement learning and language models to generate sequential subquestions for guiding (machines/humans) in math word problem-solving.

Kumar Shridhar, Jakub Macina, Mennatallah El-Assady, Tanmay Sinha, Manu Kapur and Mrinmaya Sachan

EMNLP 2022 (also at MATHAI Workshop at NeurIPS 22)   Code  

We show that zero-shot text classification can be improved simply by clustering texts in the embedding spaces of LMs.

Yu Fei, Zhao Meng, Ping Nie, Roger Wattenhofer and Mrinmaya Sachan

EMNLP 2022    

We generate synthetic datasets from differentially private LMs as a solution for sharing textual data while protecting the privacy of users.

Justus Mattern, Zhijing Jin, Benjamin Weggenmann, Bernhard Schölkopf and Mrinmaya Sachan

EMNLP 2022    

We model structures as an autoregressive sequence of actions with LMs and achieve strong results on various sturctured prediction problems.

Tianyu Liu, Yuchen Eleanor Jiang, Nicholas Monath, Ryan Cotterell and Mrinmaya Sachan

EMNLP 2022 (Findings, Short paper)    

We enhance multilingual LMs with knowledge from multilingual knowledge graphs to tackle language and knowledge graph tasks across many languages.

Yifan Hou, Wenxiang Jiao, Meizhen Liu, Carl Allen, Zhaopeng Tu and Mrinmaya Sachan

EMNLP 2022 (Findings) / Best paper at the Multilingual Representation Learning (MRL) Workshop    

We introduce a new reasoning task and dataset of Logical fallacy detection.

Zhijing Jin, Abhinav Lalwani, Tejas Vaidhya, Xiaoyu Shen, Yiwen Ding, Zhiheng Lyu, Mrinmaya Sachan, Rada Mihalcea and Bernhard Schölkopf

EMNLP 2022 (Findings)    

We propose a probe model based on graph convolutions to interpret knowledge-enhanced LMs and understand what kind of knowledge is integrated into these models.

Yifan Hou, Guoji Fu and Mrinmaya Sachan

EMNLP 2022 (Findings)   Code  

We present a novel challenge set that highlights the flexibility of the human moral mind, analyze the performance of language models on it, and propose a Moral Chain-of-Thought prompting strategy.

Zhijing Jin, Sydney Levine, Fernando Gonzalez Adauto, Ojasv Kamal, Maarten Sap, Mrinmaya Sachan, Rada Mihalcea, Joshua B. Tenenbaum and Bernhard Schölkopf

NeurIPS 2022 (Oral) / CogSci 2022 (Disciplinary Diversity and Integration Award)    

We propose kernel learning methods that increase the expressiveness of Efficient Transformers while keeping their complexity linear.

Sankalan Pal Chowdhury, Adamos Solomou, Avinava Dubey and Mrinmaya Sachan

TMLR 2022    

We propose a probing approach that adapts the given task into a sentence completion format and performs probing using the built-in language modeling head.

Jiaoda Li, Ryan Cotterell and Mrinmaya Sachan

NAACL 2022    

We propose a novel automatic metric to widen the scope of automatic MT evaluation from sentence to document level.

Yuchen Eleanor Jiang, Tianyu Liu, Shuming Ma, Dongdong Zhang, Jian Yang, Haoyang Huang, Rico Sennrich, Mrinmaya Sachan, Ryan Cotterell and Ming Zhou

NAACL 2022    

We propose a structured model which directly learns to select an optimal set of spans for various span selection problems.

Tianyu Liu, Yuchen Eleanor Jiang, Ryan D Cotterell and Mrinmaya Sachan

NAACL 2022    

We provide a causal analysis of the impact of translationese on Machine Translation performance.

Jingwei Ni, Zhijing Jin, Markus Freitag, Mrinmaya Sachan and Bernhard Schölkopf

NAACL 2022    

We improve BERT’s robustness against word substitution attacks by leveraging self-supervised contrastive learning.

Zhao Meng, Yihan Dong, Mrinmaya Sachan and Roger Wattenhofer

NAACL 2022 (Findings)    

We study language change through the lens of causality in order to model how various distributional factors causally effect language change

Daphna Keidar, Andreas Opedal, Zhijing Jin and Mrinmaya Sachan

ACL 2022    

We propose approaches to calibrate open-domain machine reading systems

Shehzaad Dhuliawala, Leonard Adolphs, Rajarshi Das and Mrinmaya Sachan

ACL 2022 (Findings)    

We propose a case-based reasoning approach to train agents and generalize efficiently out of the training distribution.

Mattia Atzeni, Shehzaad Dhuliawala, Keerthiram Murugesan and Mrinmaya Sachan

ICLR (2022)    

We jointly map contextualized text representations to a lower dimensional space and cluster them for syntax induction.

Vikram Gupta, Haoyue Shi, Kevin Gimpel and Mrinmaya Sachan

AAAI (2022)    

We investigate role of the process of data collection in NLP and explain it using causality.

Zhijing Jin, Julius von Kugelgen, Jingwei Ni, Tejas Vaidhya, Ayush Kaushal, Mrinmaya Sachan and Bernhard Schoelkopf

EMNLP 2021    

We introduce a dataset for literary pieces and their summaries together with descriptions of characters that appear in the texts.

Faeze Brahman, Meng Huang, Oyvind Tafjord, Chao Zhao, Mrinmaya Sachan and Snigdha Chaturvedi

EMNLP 2021 (Findings)    

We introduce a new differentiable subset pruning technique for Transformer head pruning.

Jiaoda Li, Ryan Cotterell and Mrinmaya Sachan

TACL 2021   Code  

We introduce a information-theoretic probe to detect if contextualized text representations encode information in linguistic graphs.

Yifan Hou and Mrinmaya Sachan

ACL 2021   Code  

We introduce a coreference model which scales to documents of any length.

Raghuveer Thirukovalluru, Nicholas Monath, Kumar Shridhar, Manzil Zaheer, Mrinmaya Sachan and Andrew McCallum

ACL 2021 (Findings)    

We propose thinking frameworks to understand the direct and indirect real-world impact of NLP.

Zhijing Jin, Geeticka Chauhan, Brian Tse, Mrinmaya Sachan and Rada Mihalcea

ACL 2021 (Findings)   MIT News Article  

We jointly map contextualized text representations to a lower dimensional space and cluster them for syntax induction.

Keerthiram Murugesan, Mattia Atzeni, Pavan Kapanipathi,Kartik Talamadupula, Mrinmaya Sachan and Murray Campbell

ACL 2021 (Short paper)    

We design new environments to test the ability of RL agents to utilize commonsense knowledge.

Keerthiram Murugesan, Mattia Atzeni, Pavan Kapanipathi, Pushkar Shukla, Sadhana Kumaravel, Gerald Tesauro, Kartik Talamadupula, Mrinmaya Sachan and Murray Campbell

AAAI 2021    

We harvest structured knowledge of geometry from math textbooks.

Mrinmaya Sachan, Avinava Dubey, Eduard Hovy, Tom Mitchell, Dan Roth and Eric P. Xing

Computational Linguistics (CL) journal - Dec 2019 issue    

We learn a pipeline process that incorporates existing code, pre-learned machine learning models, and human engineered rules.

Mrinmaya Sachan, Avinava Dubey, Tom Mitchell, Dan Roth and Eric P. Xing

NeurIPS 2018    

We propose a meta-learning approach for universal NMT.

Emmanouil Antonios Platanios, Mrinmaya Sachan, Graham Neubig and Tom Mitchell

EMNLP 2018    

We learn to solve geometry problems by imitation demonstrations in textbooks.

Mrinmaya Sachan and Eric P. Xing

StarSem 2017    

We propose a structured prediction approach to answer science questions in textbooks.

Mrinmaya Sachan, Avinava Dubey and Eric P. Xing

ACL 2016 (Short paper)    

We propose an approach to answer reading comprehension questions using AMR graph representations.

Mrinmaya Sachan and Eric P. Xing

ACL 2016 (Short paper)    

We propose a structured prediction approach to answer reading comprehension questions.

Mrinmaya Sachan, Avinava Dubey, Eric P. Xing and Matthew Richardson

ACL 2015 (Outstanding paper)