• Shubham Kumar Singh
• Rohit Kumar
• Ms. Sheenam Naaz

This study presents a multimodal user-emotion detection system designed for social robots. This system is integrated into the Robotics Dialogue System (RDS), the robot's overall interface system, and is meant to be used during human-robot contact. Emotion detection is done through two modes: analysis of facial expressions and voice. A new component called Gender and Emotion Voice Analysis (GEVA), written in the Chuck language, has been developed to analyze user voice The Gender and Emotion Facial Analysis (GEFA) system has also been developed to detect emotions in facial expressions. Sophisticated High-speed Object Recognition Engine (SHORE) and Computer Expression Recognition Toolbox (CERT), two third-party solutions, are integrated into this final system. Following the outcomes from these two new components (GEVA and GEFA), a decision rule is used to merge the data they have provided. Through communicative acts, the observed emotion, which is the outcome of this rule, is integrated into the dialogue system. Therefore, every interaction provides the RDS with information on the user's recognized emotion, among other things, so it can modify its approach and increase the level of pleasure throughout the human-robot dialogue. Additionally, GEVA and GEFA, the two new components, can be utilized separately. Additionally, they are integrated with the ROS (Robot Operating System) robotic control platform. To establish the final decision rule and evaluate the correctness of each component, multiple experiments involving actual users were conducted.

: emotion recognition, affective computing; human-robot interaction; dialog system, FACS

"sentiment analysis", International Journal of Emerging Technologies and Innovative Research (www.jetir.org), ISSN:2349-5162, Vol.11, Issue 12, page no.a175-a186, December-2024, Available :http://www.jetir.org/papers/JETIR2412018.pdf

"sentiment analysis", International Journal of Emerging Technologies and Innovative Research (www.jetir.org | UGC and issn Approved), ISSN:2349-5162, Vol.11, Issue 12, page no. ppa175-a186, December-2024, Available at : http://www.jetir.org/papers/JETIR2412018.pdf