ARTICLE
TITLE

Facial Expression Recognition using Residual Convnet with Image Augmentations

SUMMARY

During the COVID-19 pandemic, many offline activities are turned into online activities via video meetings to prevent the spread of the COVID 19 virus. In the online video meeting, some micro-interactions are missing when compared to direct social interactions. The use of machines to assist facial expression recognition in online video meetings is expected to increase understanding of the interactions among users. Many studies have shown that CNN-based neural networks are quite effective and accurate in image classification. In this study, some open facial expression datasets were used to train CNN-based neural networks with a total number of training data of 342,497 images. This study gets the best results using ResNet-50 architecture with Mish activation function and Accuracy Booster Plus block. This architecture is trained using the Ranger and Gradient Centralization optimization method for 60000 steps with a batch size of 256. The best results from the training result in accuracy of AffectNet validation data of 0.5972, FERPlus validation data of 0.8636, FERPlus test data of 0.8488, and RAF-DB test data of 0.8879. From this study, the proposed method outperformed plain ResNet in all test scenarios without transfer learning, and there is a potential for better performance with the pre-training model. The code is available at https://github.com/yusufrahadika-facial-expressions-essay.

 Articles related

Benchun Cao,Yanchun Liang,Shinichi Yoshida,Renchu Guan    

The analysis of facial expressions is a hot topic in brain-computer interface research. To determine the facial expressions of the subjects under the corresponding stimulation, we analyze the fMRI images acquired by the Magnetic Resonance. There are six ... see more


(1) Zaenal Abidin (Semarang State University & School of Engineering and Advanced Technology, Massey University, Albany, New Zealand, Indonesia) (2) Alamsyah Alamsyah (Semarang State University, Indonesia)    

Facial expression recognition is one of the most active fields of research. Many facial expression recognition methods have been developed and implemented. Neural networks (NNs) have capability to undertake such pattern recognition tasks. The key factor ... see more


Zaenal Abidin,Agus Harjoko    

Abstract— In daily lives, especially in interpersonal communication, face often used for expression. Facial expressions give information about the emotional state of the person. A facial expression is one of the behavioral characteristics. The components... see more


Ye. V. Bodyanskiy,N. Ye. Kulishova,V. Ph. Tkachenko    

Context. The article is devoted to the problem of a training data set forming for the automatic human emotions recognitionsystem on the basis of a multidimensional extended neo-fuzzy neuron. The aspects of choice the attributes vector’s dimension andcomp... see more


Andaru Kharisma Bimantara,Nanik Suciati    

ABSTRACTFacial Expression Recognition (FER) is a subset of Artificial Intelligence (AI) that relates to human non-verbal communication. The development of Convolutional Neural Network (CNN) based FER is subject to noise, mainly because of the usage of RG... see more