Skip to main content ->
Ai2

Research - Papers

Explore a selection of our published work on a variety of key research challenges in AI.

Filter papers

Dissecting Contextual Word Embeddings: Architecture and Representation

Matthew PetersMark NeumannWen-tau Yihand Luke Zettlemoyer
2018
EMNLP

Contextual word representations derived from pre-trained bidirectional language models (biLMs) have recently been shown to provide significant improvements to the state of the art for a wide range… 

Neural Cross-Lingual Named Entity Recognition with Minimal Resources

Jiateng XieZhilin YangGraham NeubigJaime Carbonell
2018
EMNLP

For languages with no annotated resources, unsupervised transfer of natural language processing models such as named-entity recognition (NER) from resource-rich languages would be an appealing… 

Neural Metaphor Detection in Context

Ge GaoEunsol ChoiYejin Choi and Luke Zettlemoyer
2018
EMNLP

We present end-to-end neural models for detecting metaphorical word use in context. We show that relatively standard BiLSTM models which operate on complete sentences work well in this setting, in… 

Policy Shaping and Generalized Update Equations for Semantic Parsing from Denotations

Dipendra MisraMing-Wei ChangXiaodong HeWen-tau Yih
2018
EMNLP

Semantic parsing from denotations faces two key challenges in model training: (1) given only the denotations (e.g., answers), search for good candidate semantic parses, and (2) choose the best model… 

Rational Recurrences

Hao PengRoy SchwartzSam Thomsonand Noah A. Smith
2018
EMNLP

Despite the tremendous empirical success of neural models in natural language processing, many of them lack the strong intuitions that accompany classical machine learning approaches. Recently,… 

Reasoning about Actions and State Changes by Injecting Commonsense Knowledge

Niket TandonBhavana Dalvi MishraJoel GrusPeter Clark
2018
EMNLP

Comprehending procedural text, e.g., a paragraph describing photosynthesis, requires modeling actions and the state changes they produce, so that questions about entities at different timepoints can… 

SimpleQuestions Nearly Solved: A New Upperbound and Baseline Approach

Michael PetrochukLuke Zettlemoyer
2018
EMNLP

The SimpleQuestions dataset is one of the most commonly used benchmarks for studying single-relation factoid questions. In this paper, we present new evidence that this benchmark can be nearly… 

Spot the Odd Man Out: Exploring the Associative Power of Lexical Resources

Gabriel StanovskyMark Hopkins
2018
EMNLP

We propose Odd-Man-Out, a novel task which aims to test different properties of word representations. An Odd-Man-Out puzzle is composed of 5 (or more) words, and requires the system to choose the… 

Structured Alignment Networks for Matching Sentences

Yang LiuMatt GardnerMirella Lapata
2018
EMNLP

Many tasks in natural language processing involve comparing two sentences to compute some notion of relevance, entailment, or similarity. Typically this comparison is done either at the word level… 

SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference

Rowan ZellersYonatan BiskRoy Schwartzand Yejin Choi
2018
EMNLP

Given a partial description like"she opened the hood of the car,"humans can reason about the situation and anticipate what might come next ("then, she examined the engine"). In this paper, we…