Inclusion of Chatbot System to Real-Time Facial Emotion Recognition

Abstract

In modern society, social media has become an essential platform for individuals to express views and feelings through various forms of content, including text, messages, and emojis. People are busy with their daily routines and can’t find space for each other; most people are stressed and depressed. In modern days, control over emotions by the people is limited; they are depressed over short stress and over-excited for smaller achievement. This paper presents a model designed to convert real-time images into gray scale sketches, utilizing the robust tools offered by Scikit-Image and other Python libraries and use of Python to develop a Chatbot that interacts with the user. This project introduces an algorithm that captures the image of the person with the help of a camera and stores the captured image. Furthermore, the stored image is pre-processed using a convolutional neural network and this is mapped with the pre-stored emoji to display the current emotional state of an individual. Once the emotional state of an individual is known, the user can interact with the Chatbot to express his feelings or thoughts about the emotion. The chatbot converses with the user and tries to normalize if the user is depressed or over-excited.