Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation
Social anxiety and introversion can create barriers to effective communication, limiting both personal and professional interactions. In this project, we develop EmonyAI, a system designed to understand situational contexts such as user facial emotions and conversation content, to leverage that info...
| Main Author: | |
|---|---|
| Format: | Final Year Project / Dissertation / Thesis |
| Published: |
2024
|
| Subjects: | |
| Online Access: | http://eprints.utar.edu.my/6954/ http://eprints.utar.edu.my/6954/1/fyp_CS_2024_GCS.pdf |
| _version_ | 1848886811238072320 |
|---|---|
| author | Goh, Chun Shing |
| author_facet | Goh, Chun Shing |
| author_sort | Goh, Chun Shing |
| building | UTAR Institutional Repository |
| collection | Online Access |
| description | Social anxiety and introversion can create barriers to effective communication, limiting both personal and professional interactions. In this project, we develop EmonyAI, a system designed to understand situational contexts such as user facial emotions and conversation content, to leverage that information and provide suggestions for more appropriate response in real time. EmonyAI is an advanced AI platform designed to enhance human interaction by integrating multiple functions, including facial recognition, speech-to-text processing, emotion detection, and text summarization, all aimed at improving communication skills. Rather than relying solely on traditional verbal cues, EmonyAI incorporates CNN for processing facial recognition and emotion detection, enabling the system to capture the subtleties of nonverbal communication. The contextual functionality is built based on the MetaGPT framework, which stores each individual as character and continuously evaluates character profiles, allowing for dynamic adaptation and improvement over time. With each interaction, the profiles grow richer, enabling the system to better assess the characteristics and preferences of the user, leading to more accurate predictions and suggestions. By leveraging this comprehensive approach, EmonyAI generates contextual conversation suggestions tailored to each user's emotional state and character, promising to enhance social experiences and foster more effective communication across various digital platforms. |
| first_indexed | 2025-11-15T19:44:25Z |
| format | Final Year Project / Dissertation / Thesis |
| id | utar-6954 |
| institution | Universiti Tunku Abdul Rahman |
| institution_category | Local University |
| last_indexed | 2025-11-15T19:44:25Z |
| publishDate | 2024 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | utar-69542025-02-27T07:03:49Z Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation Goh, Chun Shing T Technology (General) TD Environmental technology. Sanitary engineering Social anxiety and introversion can create barriers to effective communication, limiting both personal and professional interactions. In this project, we develop EmonyAI, a system designed to understand situational contexts such as user facial emotions and conversation content, to leverage that information and provide suggestions for more appropriate response in real time. EmonyAI is an advanced AI platform designed to enhance human interaction by integrating multiple functions, including facial recognition, speech-to-text processing, emotion detection, and text summarization, all aimed at improving communication skills. Rather than relying solely on traditional verbal cues, EmonyAI incorporates CNN for processing facial recognition and emotion detection, enabling the system to capture the subtleties of nonverbal communication. The contextual functionality is built based on the MetaGPT framework, which stores each individual as character and continuously evaluates character profiles, allowing for dynamic adaptation and improvement over time. With each interaction, the profiles grow richer, enabling the system to better assess the characteristics and preferences of the user, leading to more accurate predictions and suggestions. By leveraging this comprehensive approach, EmonyAI generates contextual conversation suggestions tailored to each user's emotional state and character, promising to enhance social experiences and foster more effective communication across various digital platforms. 2024-06 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/6954/1/fyp_CS_2024_GCS.pdf Goh, Chun Shing (2024) Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation. Final Year Project, UTAR. http://eprints.utar.edu.my/6954/ |
| spellingShingle | T Technology (General) TD Environmental technology. Sanitary engineering Goh, Chun Shing Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation |
| title | Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation |
| title_full | Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation |
| title_fullStr | Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation |
| title_full_unstemmed | Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation |
| title_short | Emonyai: Contextual conversation guidance leveraging microexpression and body language interpretation |
| title_sort | emonyai: contextual conversation guidance leveraging microexpression and body language interpretation |
| topic | T Technology (General) TD Environmental technology. Sanitary engineering |
| url | http://eprints.utar.edu.my/6954/ http://eprints.utar.edu.my/6954/1/fyp_CS_2024_GCS.pdf |