Curriculum Design for Machine Learners in Sequential Decision Tasks

Bei Peng (Washington State University), James MacGlashan (Brown University), Robert Loftin (North Carolina State University), Michael L. Littman (Brown University), David L. Roberts (North Carolina State University), Matthew E. Taylor (Washington State University)

Abstract

Existing machine-learning work has shown that algorithms can benefit from curricula-learning first on simple examples before moving to more difficult examples. While most existing work on curriculum learning focuses on developing automatic methods to iteratively select training examples with increasing difficulty tailored to the current ability of the learner, relatively little attention has been paid to the ways in which humans design curricula. We argue that a better understanding of the human-designed curricula could give us insights into the development of new machinelearning algorithms and interfaces that can better accommodate machine-or human-created curricula. Our work addresses this emerging and vital area empirically, taking an important step to characterize the nature of human-designed curricula relative to the space of possible curricula and the performance benefits that may (or may not) occur.