Spoken Instruction-Based One-Shot Object and Action Learning in a Cognitive Robotic Architecture

Matthias Scheutz (Tufts University), Evan Krause (Turfts University), Brad Oosterveld (Tufts University), Tyler Frasca (Tufts University), Robert Platt (Northeastern University)

Abstract

Learning new knowledge from single instructions and being able to apply it immediately is a highly desirable capability for artificial agents. We provide the first demonstration of spoken instructionbased one-shot object and action learning in a cognitive robotic architecture and discuss the modifications to several architectural components required to enable such fast learning, demonstrating the new capabilities on two different fully autonomous robots. CCS Concepts •Human-centered computing → Natural language interfaces; •Computing methodologies → Online learning settings;