Methods and Mechanisms for Interactive Novelty Handling in Adversarial Environments

Tung Thai (Tufts University), Mudit Verma (Arizona State University), Utkarsh Soni (Arizona State University), Sriram Gopalakrishnan (Arizona State University), Ming Shen (Arizona State University), Mayank Garg (Arizona State University), Ayush Kalani (Arizona State University), Nakul Vaidya (Arizona State University), Neeraj Varshney (Arizona State University), Chitta Baral (Arizona State University), Subbarao Kambhampati (Arizona State University), Jivko Sinapov (Tufts University), Matthias Scheutz (Tufts University)

Abstract

Learning to detect, characterize and accommodate novelties is a challenge that agents operating in open-world domains need to address to achieve satisfactory task performance. We sketch general methods for detecting and characterizing different types of novelties, and for building an appropriate adaptive model to accommodate them utilizing logical representations and reasoning methods in stochastic partially observable multi-agent environments. We also briefly report results from evaluations of our algorithms in the game domain of Monopoly. The results show high novelty detection and accommodation rates.