Skip to main content ->
Ai2

Research - Papers

Explore a selection of our published work on a variety of key research challenges in AI.

Filter papers

Natural Language to Structured Query Generation via Meta-Learning

Po-Sen HuangChenglong WangRishabh SinghXiaodong He
2018
NAACL

In conventional supervised training, a model is trained to fit all the training examples. However, having a monolithic model may not always be the best strategy, as examples could vary widely. In… 

Neural Motifs: Scene Graph Parsing with Global Context

Rowan ZellersMark YatskarSam ThomsonYejin Choi
2018
CVPR

We investigate the problem of producing structured graph representations of visual scenes. Our work analyzes the role of motifs: regularly appearing substructures in scene graphs. We present new… 

Neural Poetry Translation

Marjan GhazvininejadYejin Choi and Kevin Knight
2018
NAACL

We present the first neural poetry translation system. Unlike previous works that often fail to produce any translation for fixed rhyme and rhythm patterns, our system always translates a source… 

SeGAN: Segmenting and Generating the Invisible

Kiana EhsaniRoozbeh MottaghiAli Farhadi
2018
CVPR

Objects often occlude each other in scenes; Inferring their appearance beyond their visible parts plays an important role in scene understanding, depth estimation, object interaction and… 

SoPa: Bridging CNNs, RNNs, and Weighted Finite-State Machines

Roy SchwartzSam Thomson and Noah A. Smith
2018
ACL

Recurrent and convolutional neural networks comprise two distinct families of models that have proven to be useful for encoding natural language utterances. In this paper we present SoPa, a new… 

Structured Set Matching Networks for One-Shot Part Labeling

Jonghyun ChoiJayant KrishnamurthyAniruddha KembhaviAli Farhadi
2018
CVPR

Diagrams often depict complex phenomena and serve as a good test bed for visual and textual reasoning. However, understanding diagrams using natural image understanding approaches requires large… 

Tracking State Changes in Procedural Text: A Challenge Dataset and Models for Process Paragraph Comprehension

Bhavana DalviLifu HuangNiket TandonPeter Clark
2018
NAACL

We present a new dataset and models for comprehending paragraphs about processes (e.g., photosynthesis), an important genre of text describing a dynamic world. The new dataset, ProPara, is the first… 

VISIR: Visual and Semantic Image Label Refinement

Sreyasi Nag ChowdhuryNiket TandonHakan FerhatosmanogluGerhard Weikum
2018
WSDM

The social media explosion has populated the Internet with a wealth of images. There are two existing paradigms for image retrieval: 1)content-based image retrieval (BIR), which has traditionally… 

What Happened? Leveraging VerbNet to Predict the Effects of Actions in Procedural Text

Peter ClarkBhavana DalviNiket Tandon
2018
arXiv

Our goal is to answer questions about paragraphs describing processes (e.g., photosynthesis). Texts of this genre are challenging because the effects of actions are often implicit (unstated),… 

Who Let The Dogs Out? Modeling Dog Behavior From Visual Data

Kiana EhsaniHessam BagherinezhadJoe RedmonAli Farhadi
2018
CVPR

We study the task of directly modelling a visually intelligent agent. Computer vision typically focuses on solving various subtasks related to visual intelligence. We depart from this standard…