Emotion Detection from Photos Using MobleNet-based Deep Learning

Authors

  • Elizabeth Sunny Department of Statistics, St Thomas College, Palai, Kerala, India
  • Therese Yamuna Mahesh Department of Electronics and Communication, Amal Jjyothi College of Engineering, Kanjirappally, Kerala, India

DOI:

https://doi.org/10.48001/jodpba.2024.1113-20

Keywords:

Data augmentation, Depth wise convolution, Emotion detection, Emotion prediction, Mobile net, Pointwise convolution

Abstract

In the era of twenty-first century, an era characterized by the proliferation of digital technology, big data and so on, the ability to identify human emotions through visual content from images has gained much importance and its popularity is increasing worldwide. This project deals with the task of detecting emotions from images using deep learning techniques with a specific emphasis on Mobile Net-based architectures. We start the project by preparing the dataset of various images showing diverse emotions. The Mobile Net architecture, a powerful convolutional neural network is fine-tuned with a custom dense layer to classify emotions into seven distinct categories. Data argumentation techniques such as zooming, shearing and horizontal flipping are incorporated to enhance robustness and prevent overfitting. The training dataset is preprocessed and normalized while a segregated validation dataset ensures stringent evaluation. During training we implemented early stopping and model checkpoint mechanisms to get optimal performance while avoiding overfitting. After training the analysis of accuracy and loss metrics provides an insight into the model’s trajectory. In practical applicability we use the trained model to predict emotion from single images, showcasing its potential in various domains, including digital marketing, healthcare, and user experience design. In today’s digital landscape the project findings hold relevance for a wide spectrum of applications, promising advancements in human computer interactions and emotion aware systems.

Downloads

Download data is not yet available.

References

Awais, M., Raza, M., Singh, N., Bashir, K., Manzoor, U., Islam, S. U., & Rodrigues, J. J. (2020). LSTM-based emotion detection using physiological signals: IoT framework for healthcare and distance learning in COVID-19. IEEE Internet of Things Journal, 8(23), 16863-16871.

https://doi.org/10.1109/JIOT.2020.3044031.

Giannopoulos, P., Perikos, I., & Hatzilygeroudis, I. (2018). Deep learning approaches for facial emotion recognition: A case study on FER-2013. Advances in Hybridization of Intelligent Methods: Models, Systems and Applications, 1-16. https://doi.org/10.1007/978-3-319-66790-4_1.

Jaiswal, S., & Nandi, G. C. (2020). Robust real-time emotion detection system using CNN architecture. Neural Computing and Applications, 32(15), 11253-11262.

https://doi.org/10.1007/s00521-019-04564-4.

Kratzwald, B., Ilic, S., Kraus, M., Feuerriegel, S., & Prendinger, H. (2018). Deep learning for affective computing: Text-based emotion recognition in decision support. Decision Support Systems, 115, 24-35. https://doi.org/10.1016/j.dss.2018.09.002.

Luo, Y., Zhu, L. Z., Wan, Z. Y., & Lu, B. L. (2020). Data augmentation for enhancing EEG-based emotion recognition with deep generative models. Journal of Neural Engineering, 17(5), 056021.

https://doi.org/10.1088/1741-2552/abb580.

Saxena, A., Khanna, A., & Gupta, D. (2020). Emotion recognition and detection methods: A comprehensive survey. Journal of Artificial Intelligence and Systems, 2(1), 53-79.

https://doi.org/10.33969/AIS.2020.21005.

Turabzadeh, S., Meng, H., Swash, R. M., Pleva, M., & Juhar, J. (2018). Facial expression emotion detection for real-time embedded systems. Technologies, 6(1), 17.

https://doi.org/10.3390/technologies6010017.

Published

2024-03-07

How to Cite

Elizabeth Sunny, & Therese Yamuna Mahesh. (2024). Emotion Detection from Photos Using MobleNet-based Deep Learning . Journal of Data Processing and Business Analytics, 1(1), 13–20. https://doi.org/10.48001/jodpba.2024.1113-20

Issue

Section

Articles