Lecture digest - auto summarization and key points recognition
Addressing the diverse learning preferences of students who benefit from visual, textual, or auditory cues, we developed Lecture Digest - to automatically summarize lecture videos into multiple types of lecture summary. Lecture Digest provides the option of viewing text summaries, navigating to impo...
| Main Author: | |
|---|---|
| Format: | Final Year Project / Dissertation / Thesis |
| Published: |
2024
|
| Subjects: | |
| Online Access: | http://eprints.utar.edu.my/6666/ http://eprints.utar.edu.my/6666/1/fyp_CS_2024_YMCC.pdf |
| _version_ | 1848886740158251008 |
|---|---|
| author | Yap, Melissa Chia Chean |
| author_facet | Yap, Melissa Chia Chean |
| author_sort | Yap, Melissa Chia Chean |
| building | UTAR Institutional Repository |
| collection | Online Access |
| description | Addressing the diverse learning preferences of students who benefit from visual, textual, or auditory cues, we developed Lecture Digest - to automatically summarize lecture videos into multiple types of lecture summary. Lecture Digest provides the option of viewing text summaries, navigating to important sections of the video by clicking chapters, and interacting with chat assistance. In text summarization, we use Google's Speech-to-Text technology to convert spoken words in videos into written text before the transcription feeds into GPT-3.5 to extract important points based on semantic understanding. Meanwhile, in video summarization, we use a custom gesture recognition system based on the MediaPipe framework to recognize hand gestures that can signify important key points. The intuition is that speakers would normally perform some distinguishable hand gesture when emphasizing important points. Then, we mark the timestamp of this landmark into the video for the user to easily skip ahead and rewind to these important segments. Lastly, a chat module acts as a virtual tutor, enabling students to engage deeply with the video content. Users can query the module to pull up information related to the video, review frequently asked questions, and utilize interactive tools like flashcards and quizzes to test their understanding. The experimental results on 60 UTAR students from different faculties showed that all of them are satisfied with the functionalities provided by the Lecture Digest application, proving it to be an effective tool in boosting the student’s academic performance. |
| first_indexed | 2025-11-15T19:43:17Z |
| format | Final Year Project / Dissertation / Thesis |
| id | utar-6666 |
| institution | Universiti Tunku Abdul Rahman |
| institution_category | Local University |
| last_indexed | 2025-11-15T19:43:17Z |
| publishDate | 2024 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | utar-66662024-10-23T06:05:01Z Lecture digest - auto summarization and key points recognition Yap, Melissa Chia Chean T Technology (General) TD Environmental technology. Sanitary engineering Addressing the diverse learning preferences of students who benefit from visual, textual, or auditory cues, we developed Lecture Digest - to automatically summarize lecture videos into multiple types of lecture summary. Lecture Digest provides the option of viewing text summaries, navigating to important sections of the video by clicking chapters, and interacting with chat assistance. In text summarization, we use Google's Speech-to-Text technology to convert spoken words in videos into written text before the transcription feeds into GPT-3.5 to extract important points based on semantic understanding. Meanwhile, in video summarization, we use a custom gesture recognition system based on the MediaPipe framework to recognize hand gestures that can signify important key points. The intuition is that speakers would normally perform some distinguishable hand gesture when emphasizing important points. Then, we mark the timestamp of this landmark into the video for the user to easily skip ahead and rewind to these important segments. Lastly, a chat module acts as a virtual tutor, enabling students to engage deeply with the video content. Users can query the module to pull up information related to the video, review frequently asked questions, and utilize interactive tools like flashcards and quizzes to test their understanding. The experimental results on 60 UTAR students from different faculties showed that all of them are satisfied with the functionalities provided by the Lecture Digest application, proving it to be an effective tool in boosting the student’s academic performance. 2024-01 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/6666/1/fyp_CS_2024_YMCC.pdf Yap, Melissa Chia Chean (2024) Lecture digest - auto summarization and key points recognition. Final Year Project, UTAR. http://eprints.utar.edu.my/6666/ |
| spellingShingle | T Technology (General) TD Environmental technology. Sanitary engineering Yap, Melissa Chia Chean Lecture digest - auto summarization and key points recognition |
| title | Lecture digest - auto summarization and key points recognition |
| title_full | Lecture digest - auto summarization and key points recognition |
| title_fullStr | Lecture digest - auto summarization and key points recognition |
| title_full_unstemmed | Lecture digest - auto summarization and key points recognition |
| title_short | Lecture digest - auto summarization and key points recognition |
| title_sort | lecture digest - auto summarization and key points recognition |
| topic | T Technology (General) TD Environmental technology. Sanitary engineering |
| url | http://eprints.utar.edu.my/6666/ http://eprints.utar.edu.my/6666/1/fyp_CS_2024_YMCC.pdf |