An approach for Brazilian Sign Language (BSL) recognition based on facial expression and k-NN classifier
Workshop of Theses and Dissertations (WTD) in the 29th Conference on Graphics, Patterns and Images (SIBGRAPI'16), São José dos Campos, SP, Brazil, Universidade Federal de São Paulo (UniFeSP), (2016)Abstract
The automatic recognition of facial expressions is a complex problem that requires the application of Computational Intelligence techniques such as pattern recognition. As shown in this work, this technique may be used to detect change sin physiognomy, thus making it possible to differentiate between signs in BSL (Brazilian Sign Language or LIBRAS in Portuguese). The methodology for automatic recognition in this study involved evaluating the facial expressions for 10 signs (to calm down, to accuse, to annihilate, to love, to gain weight, happiness, slim, lucky, surprise, and angry). Each sign was captured 10 times by an RGB-D sensor. The proposed recognition model was achieved through four steps: (i) detection and clipping of the region of interest (face), (ii) stigmatization of the video using the concept of maximized diversity, (iii) creation of the feature vector and (iv) sign classification via k-NN (k-Nearest Neighbors). An average accuracy of over 80% was achieved, revealing the potential of the proposed model.