Cognizing and Imitating Robotic Skills via a Dual Cognition-Action Architecture

Zixuan Chen (State Key Laboratory for Novel Software Technology, Nanjing University), Ze Ji (Cardiff University), Shuyang Liu (State Key Laboratory for Novel Software Technology, Nanjing University), Jing Huo (State Key Laboratory for Novel Software Technology, Nanjing University), Yiyu Chen (State Key Laboratory for Novel Software Technology, Nanjing University), Yang Gao (State Key Laboratory for Novel Software Technology, Nanjing University)

Abstract

Enabling robots to effectively learn and imitate expert skills in longhorizon tasks remains challenging. Hierarchical imitation learning (HIL) approaches have made strides but often fall short in complex scenarios due to their reliance on self-exploration. This paper introduces a novel approach inspired by the human skill acquisition process, proposing a Cognition-Action-based Robotic Skill Imitation Learning (CasIL) framework. CasIL integrates human cognitive priors for task decomposition into a dual-layer architecture, enhancing robots' ability to cognize and imitate essential skills from expert demonstrations. Our experiments across four RLbench tasks demonstrate CasIL's superior performance, robustness, and generalizability in skill imitation compared to related methods.