Skip to main content ->
Ai2

Research - Papers

Explore a selection of our published work on a variety of key research challenges in AI.

Filter papers

Decomposing Complex Queries for Tip-of-the-tongue Retrieval

Kevin LinKyle LoJoseph E. GonzalezDan Klein
2023
arXiv

When re-finding items, users who forget or are uncertain about identifying details often rely on creative strategies for expressing their information needs -- complex queries that describe content… 

Just CHOP: Embarrassingly Simple LLM Compression

Ananya Harsh JhaTom SherborneEvan Pete WalshIz Beltagy
2023
arXiv

Large language models (LLMs) enable unparalleled few- and zero-shot reasoning capabilities but at a high computational footprint. A growing assortment of methods for compression promises to reduce… 

OpenPI2.0: An Improved Dataset for Entity Tracking in Texts

Li ZhangHai XuAbhinav KommulaChris Callison-Burch
2023
arXiv

Representing texts as information about entities has long been deemed effective in event reasoning. We propose OpenPI2.0, an improved dataset for tracking entity states in procedural texts.… 

Improving Language Models via Plug-and-Play Retrieval Feedback

Wenhao YuZhihan ZhangZhenwen LiangAshish Sabharwal
2023
arXiv

Large language models (LLMs) exhibit remarkable performance across various NLP tasks. However, they often generate incorrect or hallucinated information, which hinders their practical applicability… 

Learning to Generate Novel Scientific Directions with Contextualized Literature-based Discovery

Qingyun WangDoug DowneyHeng JiTom Hope
2023
arXiv.org

Literature-Based Discovery (LBD) aims to discover new scientific knowledge by mining papers and generating hypotheses. Standard LBD is limited to predicting pairwise relations between discrete… 

SQuARe: A Large-Scale Dataset of Sensitive Questions and Acceptable Responses Created Through Human-Machine Collaboration

Hwaran LeeSeokhee HongJoonsuk ParkJung-Woo Ha
2023
arXiv.org

The potential social harms that large language models pose, such as generating offensive content and reinforcing biases, are steeply rising. Existing works focus on coping with this concern while… 

Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedback

Yao FuHao PengTushar KhotMirella Lapata
2023
arXiv.org

We study whether multiple large language models (LLMs) can autonomously improve each other in a negotiation game by playing, reflecting, and criticizing. We are interested in this question because… 

LeTI: Learning to Generate from Textual Interactions

Xingyao WangHao PengReyhaneh JabbarvandHeng Ji
2023
arXiv.org

Finetuning pre-trained language models (LMs) enhances the models' capabilities. Prior techniques fine-tune a pre-trained LM on input-output pairs (e.g., instruction fine-tuning), or with numerical… 

Pace v0.2: a Python-based performance-portable atmospheric model

Johann DahmEddie DavisFlorian DeconinckOliver Fuhrer
2023
Geoscientific Model Development

Progress in leveraging current and emerging high-performance computing infrastructures using traditional weather and climate models has been slow. This has become known more broadly as the software… 

From Centralized to Ad-Hoc Knowledge Base Construction for Hypotheses Generation.

Shaked Launer-WachsHillel Taub-TabibJennie Tokarev MademY. Shamay
2023
Journal of Biomedical Informatics

Objective To demonstrate and develop an approach enabling individual researchers or small teams to create their own ad-hoc, lightweight knowledge bases tailored for specialized scientific interests,…