Firefly-based Facial Expression Recognition: Extended Abstract

Automatic facial expression recognition plays an important role in various application domains such as medical imaging, surveillance and human-robot interaction. This research presents a novel facial expression recognition system with modified Local Binary Patterns (LBP) for feature extraction and a modified firefly algorithm (FA) for feature optimization. First, in order to deal with illumination, scaling and rotation variations, we propose a horizontal, vertical and diagonal neighborhood LBP to extract initial discriminative facial features. Then a modified FA is proposed to reduce the dimensionality of the extracted facial features. This FA variant employs Cauchy and Levy distributions to further mutate the best solution identified by the FA to increase exploration in the search space and avoid premature convergence. The overall system is evaluated using two facial expression databases (i.e. CK+, and MMI). The proposed system outperforms other heuristic search algorithms such as Genetic Algorithm, Particle Swarm Optimization, and other existing state-of-the-art facial expression recognition research, significantly.