Recognition of two-handed posture finger turkish sign language alphabet Çift elli duraǧan parmak türk i˙şaret dili alfabesi tanima


Katilmis Z., KARAKUZU C.

5th International Conference on Computer Science and Engineering, UBMK 2020, Diyarbakır, Turkey, 9 - 10 September 2020, pp.181-186 identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/ubmk50275.2020.9219364
  • City: Diyarbakır
  • Country: Turkey
  • Page Numbers: pp.181-186
  • Keywords: Finger spelling, Leap Motion, Machine learning, Sign recognition, Turkish sign language
  • Kütahya Health Sciences University Affiliated: No

Abstract

The importance of hearing-impaired individuals to communicate easily with other person of the society is indisputable. In this study, the recognition of two-handed posture finger alphabet of Turkish sign language was studied by using a device based on the sensor called Leap Motion. In addition to collecting data, the study consists of four stages: pretreatment, feature extraction, dimension reduction and classification. Recognition success was analyzed using traditional classifier which is one of the machine learning methods. In this analysis, the recognition model was tested using k-fold cross-validation and the results obtained were compared. In the analyses, performance obtained with the features selected by using the PCA (Principal Component Analysis) and LDA (Linear Discriminant Analysis) feature selection algorithms independently and in a hybrid structure, and all the features of the original data were compared in terms of recognition success. The results of detailed analyses showed that a more successful recognition is achieved with the features selected using the PCA and LDA algorithms in a hybrid structure.