Improving automatic face recognition with user interaction

Face recognition systems aim to recognize the identity of a person depicted in a photograph by comparing it against a gallery of prerecorded images. Current systems perform quite well in controlled scenarios, but they allow for none or little interaction in case of mistakes due to the low quality of images or to algorithmic limitations. Following the needs and suggestions of investigators, we present a guided user interface that allows to adjust from a fully automatic to a fully assisted modality of execution, according to the difficulty of the task and to amount of available information (gender, age, etc.): the user can generally rely on automatic execution and intervene only on a limited number of examples when a failure is automatically detected or when the quality of intermediate results is deemed unsatisfactory. The interface runs on top of a preexistent automatic face recognition algorithm in such a way to guarantee full control over the execution flow and to exploit the peculiarities of the underlying image processing techniques. The viability of the proposed solution is tested on a classic face identification task run on a standard publicly available database (the XM2VTS), assessing the improvement to user interaction over the automatic system performance.