ARISTO
Build machines that read, learn and reason.
The Aristo Project aims to build systems that demonstrate a deep understanding of the world, integrating technologies for reading, learning, reasoning, and explanation.
- Natural language processing
- Information extraction
- Knowledge representation
- Machine reasoning
- Commonsense knowledge
Research Areas
Probing Reasoning with Language Models
Language models (LMs) have dominated much of AI recently. But what kind(s) of reasoning are they capable of? And how can they be taught to do more? We are developing analytical datasets to probe LMs and help answer these questions.
Learn More:
Multihop Reasoning
Many questions require multiple pieces of information to be combined to arrive at an answer. We are developing new multihop models capable of identifying and combining relevant facts to answer such questions.
Learn More:
Explanation
An intelligent system should not only answer questions correctly, but also be able to explain why its answers are correct. Such a capability is essential for practical acceptance of AI technology. It is also essential for the broader goals of communicating knowledge to a user, and receiving correction from the user when the system's answer is wrong.
Learn More:
Reasoning about Actions
A key aspect of intelligence is being able to reason about the dynamics of the world. This requires modeling what state the world might be in, and how different actions might affect that state. Such capabilities are essential for understanding what happens during a procedure or process, for planning, and for reasoning about "what if..." scenarios.
Learn More:
RuleTaker determines whether statements are True or False based on rules given in natural language.
Try the demo
RuleTaker determines whether statements are True or False based on rules given in natural language.
Try the demo
UnifiedQA is a single pre-trained QA model that performs surprisingly well across 17 QA datasets spanning 4 diverse formats. Fine-tuning UnifiedQA into specialized models results in a new state-of-the-art on 6 datasets, establishing this model as a strong starting point for building QA systems.
Try the demoUnifiedQA is a single pre-trained QA model that performs surprisingly well across 17 QA datasets spanning 4 diverse formats. Fine-tuning UnifiedQA into specialized models results in a new state-of-the-art on 6 datasets, establishing this model as a strong starting point for building QA systems.
Try the demoRecent Papers
Everything Happens for a Reason: Discovering the Purpose of Actions in Procedural Text
Bhavana Dalvi Mishra, Niket Tandon, Antoine Bosselut, Wen-tau Yih, Peter ClarkEMNLP • 2019Our goal is to better comprehend procedural text, e.g., a paragraph about photosynthesis, by not only predicting what happens, but why some actions need to happen before others. Our approach builds on a prior process comprehension framework for predicting actions' effects, to also identify… moreQASC: A Dataset for Question Answering via Sentence Composition
Tushar Khot, Peter Clark, Michal Guerquin, Paul Edward Jansen, Ashish Sabharwal AAAI • 2020Composing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Composition (QASC), that requires retrieving facts from a large corpus and composing them to answer a multiple-choice… moreProbing Natural Language Inference Models through Semantic Fragments
Kyle Richardson, Hai Na Hu, Lawrence S. Moss, Ashish SabharwalAAAI • 2020Do state-of-the-art models for language understanding already have, or can they easily learn, abilities such as boolean coordination, quantification, conditionals, comparatives, and monotonicity reasoning (i.e., reasoning about word substitutions in sentential contexts)? While such phenomena are… moreTransformers as Soft Reasoners over Language
Peter Clark, Oyvind Tafjord, Kyle RichardsonIJCAI • 2020AI has long pursued the goal of having systems reason over explicitly provided knowledge, but building suitable representations has proved challenging. Here we explore whether transformers can similarly learn to reason (or emulate reasoning), but using rules expressed in language, thus bypassing a… moreMulti-class Hierarchical Question Classification for Multiple Choice Science Exams
Dongfang Xu, Peter Jansen, Jaycie Martin, Zhengnan Xie, Vikas Yadav, Harish Tayyar Madabushi, Oyvind Tafjord, Peter ClarkIJCAI • 2020Prior work has demonstrated that question classification (QC), recognizing the problem domain of a question, can help answer it more accurately. However, developing strong QC algorithms has been hindered by the limited size and complexity of annotated data available. To address this, we present the… more
Recent Datasets
View All Aristo DatasetsQuaRTz Dataset
3864 questions about open domain qualitative relationships
QuaRTz is a crowdsourced dataset of 3864 multiple-choice questions about open domain qualitative relationships. Each question is paired with one of 405 different background sentences (sometimes short paragraphs).
QuaRel Dataset
2771 story questions about qualitative relationships
QuaRel is a crowdsourced dataset of 2771 multiple-choice story questions, including their logical forms.
hasPart KB
A high-quality KB of hasPart relations
A high-quality knowledge base of ~50k hasPart relationships, extracted from a large corpus of generic statements.
RuleTaker: Transformers as Soft Reasoners over Language
Datasets used to teach transformers to reason
Can transformers be trained to reason (or emulate reasoning) over rules expressed in language? In the associated paper and demo we provide evidence that they can. Our models, that we call RuleTakers, are trained on datasets of synthetic rule bases plus derived conclusions, provided here. The resulting models provide the first demonstration that this kind of soft reasoning over language is indeed learnable.
Recent Press
View All Aristo PressPaul Allen's 'Digital Aristotle' sets eyes on accomplishing practical tasks
February 5, 2020
מערכת בינה מלאכותית עברה בהצטיינות יתרה מבחן במדעים של כיתה ח' (Artificial Intelligence System Cum Laude Passed 8th Grade Science Test)
September 6, 2019
Allen Institute's Aristo AI makes breakthrough, passes eighth-grade science test
September 5, 2019
Allen Institute’s Aristo AI system finally passes an eighth-grade science test
September 4, 2019
How to tutor AI from an ‘F’ to an ‘A’
September 4, 2019
A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test
September 4, 2019
AI assistants say dumb things, and we’re about to find out why
March 14, 2018
Moving Beyond the Turing Test with the Allen AI Science Challenge
September 4, 2017
