Value-Guided Synthesis of Parametric Normative Systems

Nieves Montes (Artificial Intelligence Research Institute (IIIA-CSIC), Carles Sierra (Artificial Intelligence Research Institute (IIIA-CSIC)

Abstract

In recent years there has been an increasing interest in ensuring that autonomous systems behave consistently with human values. A popular approach to this challenge is through the incorporation of norms that regulate behaviour in an ethical way. However, such norms must be effective at promoting the values we consider most important. In this work, we introduce a systematic methodology for the automated synthesis of parametric normative systems based on value promotion. We introduce the new concepts of Shapley values of norms and value compatibility. To quantify the effectiveness of norms at upholding the values we consider relevant, we adopt the value alignment indicator from a previously established framework. We apply our model to a toy system which we use to illustrate our approach from end to end.