Human detection and tracking with YOLO and SORT tracking algorithm
Human tracking is often performed on publicly available well annotated datasets where the dataset development is always avoided because of the tiring process. Publicly available well-annotated datasets are ideal for training because those generate higher tracking accuracy. This paper performs human...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Science and Information (SAI) Organization Limited
2025
|
| Subjects: | |
| Online Access: | http://umpir.ump.edu.my/id/eprint/45070/ http://umpir.ump.edu.my/id/eprint/45070/1/Paper_14-Human_Detection_and_Tracking_with_YOLO.pdf |
| _version_ | 1848827248739614720 |
|---|---|
| author | Kader, Tanveer Ahmad Fakhri, Ab Nasir Muhammad Zulfahmi, Toh Abdullah@ Toh Chin Lai Muhammad Nur Aiman, Shapiee Amir Fakarullsroq, Abdul Razak |
| author_facet | Kader, Tanveer Ahmad Fakhri, Ab Nasir Muhammad Zulfahmi, Toh Abdullah@ Toh Chin Lai Muhammad Nur Aiman, Shapiee Amir Fakarullsroq, Abdul Razak |
| author_sort | Kader, Tanveer |
| building | UMP Institutional Repository |
| collection | Online Access |
| description | Human tracking is often performed on publicly available well annotated datasets where the dataset development is always avoided because of the tiring process. Publicly available well-annotated datasets are ideal for training because those generate higher tracking accuracy. This paper performs human tracking on videos recorded manually using optimized detectors following the tracking by detection framework. Manually recorded videos were used to develop a dataset which comprises more than 8k image sequences. Both indoor and outdoor scenarios were chosen to maintain different lighting conditions which make tracking difficult. All these image frames are labelled with bounding boxes for humans. The dataset is prepared by following the MOT15 dataset structure. A unique annotation process was performed that reduced the annotation labour by almost 80% which was a combination of manual annotation and prediction from pretrained models. Different sizes of You Only Look Once (YOLO) detection model (n/s/m) were trained using the train dataset focusing on humans and coupled with two most popular tracking algorithms Simple Online Realtime Tracking (SORT) and DeepSORT. The YOLOv8 and YOLO11 models were optimized with proper hyperparameter values followed by tracking using SORT and DeepSORT. The results were observed with those models on different confidence and Intersection over Union (IoU) threshold values. This study finds a proportional relation with the optimization of detection models and tracking accuracy. YOLO11m with DeepSORT tracker performed best on the test data with 74% Multiple Object Tracking Accuracy (MOTA) also the other optimized YOLO models tend to perform better with the trackers than the unoptimized ones. |
| first_indexed | 2025-11-15T03:57:42Z |
| format | Article |
| id | ump-45070 |
| institution | Universiti Malaysia Pahang |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T03:57:42Z |
| publishDate | 2025 |
| publisher | The Science and Information (SAI) Organization Limited |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | ump-450702025-07-15T03:47:48Z http://umpir.ump.edu.my/id/eprint/45070/ Human detection and tracking with YOLO and SORT tracking algorithm Kader, Tanveer Ahmad Fakhri, Ab Nasir Muhammad Zulfahmi, Toh Abdullah@ Toh Chin Lai Muhammad Nur Aiman, Shapiee Amir Fakarullsroq, Abdul Razak QA75 Electronic computers. Computer science Human tracking is often performed on publicly available well annotated datasets where the dataset development is always avoided because of the tiring process. Publicly available well-annotated datasets are ideal for training because those generate higher tracking accuracy. This paper performs human tracking on videos recorded manually using optimized detectors following the tracking by detection framework. Manually recorded videos were used to develop a dataset which comprises more than 8k image sequences. Both indoor and outdoor scenarios were chosen to maintain different lighting conditions which make tracking difficult. All these image frames are labelled with bounding boxes for humans. The dataset is prepared by following the MOT15 dataset structure. A unique annotation process was performed that reduced the annotation labour by almost 80% which was a combination of manual annotation and prediction from pretrained models. Different sizes of You Only Look Once (YOLO) detection model (n/s/m) were trained using the train dataset focusing on humans and coupled with two most popular tracking algorithms Simple Online Realtime Tracking (SORT) and DeepSORT. The YOLOv8 and YOLO11 models were optimized with proper hyperparameter values followed by tracking using SORT and DeepSORT. The results were observed with those models on different confidence and Intersection over Union (IoU) threshold values. This study finds a proportional relation with the optimization of detection models and tracking accuracy. YOLO11m with DeepSORT tracker performed best on the test data with 74% Multiple Object Tracking Accuracy (MOTA) also the other optimized YOLO models tend to perform better with the trackers than the unoptimized ones. The Science and Information (SAI) Organization Limited 2025 Article PeerReviewed pdf en cc_by_4 http://umpir.ump.edu.my/id/eprint/45070/1/Paper_14-Human_Detection_and_Tracking_with_YOLO.pdf Kader, Tanveer and Ahmad Fakhri, Ab Nasir and Muhammad Zulfahmi, Toh Abdullah@ Toh Chin Lai and Muhammad Nur Aiman, Shapiee and Amir Fakarullsroq, Abdul Razak (2025) Human detection and tracking with YOLO and SORT tracking algorithm. International Journal of Advanced Computer Science and Applications (IJACSA), 16 (5). 133 -143. ISSN 2158-107X ; 2156-5570(Online). (Published) https://doi.org/10.14569/IJACSA.2025.0160514 https://doi.org/10.14569/IJACSA.2025.0160514 |
| spellingShingle | QA75 Electronic computers. Computer science Kader, Tanveer Ahmad Fakhri, Ab Nasir Muhammad Zulfahmi, Toh Abdullah@ Toh Chin Lai Muhammad Nur Aiman, Shapiee Amir Fakarullsroq, Abdul Razak Human detection and tracking with YOLO and SORT tracking algorithm |
| title | Human detection and tracking with YOLO and SORT tracking algorithm |
| title_full | Human detection and tracking with YOLO and SORT tracking algorithm |
| title_fullStr | Human detection and tracking with YOLO and SORT tracking algorithm |
| title_full_unstemmed | Human detection and tracking with YOLO and SORT tracking algorithm |
| title_short | Human detection and tracking with YOLO and SORT tracking algorithm |
| title_sort | human detection and tracking with yolo and sort tracking algorithm |
| topic | QA75 Electronic computers. Computer science |
| url | http://umpir.ump.edu.my/id/eprint/45070/ http://umpir.ump.edu.my/id/eprint/45070/ http://umpir.ump.edu.my/id/eprint/45070/ http://umpir.ump.edu.my/id/eprint/45070/1/Paper_14-Human_Detection_and_Tracking_with_YOLO.pdf |