Allen Institute for AI

ROPES

AllenNLP, AI2 Irvine • 2019
ROPES is a QA dataset which tests a system's ability to apply knowledge from a passage of text to a new situation. A system is presented a background passage containing a causal or qualitative relation(s), a novel situation that uses this background, and questions that require reasoning about effects of the relationships in the back-ground passage in the context of the situation.

Leaderboard

Top Public Submissions
Details
Created
Exact Match
5/29/202070%
10/24/201954%

Authors

Kevin Lin, Oyvind Tafjord, Peter Clark, Matt Gardner