A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot
Autonomous mobile robot path planning in unknown and dynamic environment is a crucial task for successful mobile robot navigation. This study proposes an improved Q-learning (IQL) algorithm to address the challenges of path planning in such environments. To this end, three different modes are intr...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023
|
| Subjects: | |
| Online Access: | http://eprints.uthm.edu.my/9624/ http://eprints.uthm.edu.my/9624/1/J16153_c2bd76a73c1e817275f1aabce076fc0f.pdf |
| _version_ | 1848889728526450688 |
|---|---|
| author | Ee Soong Low, Ee Soong Low Pauline Ong, Pauline Ong Cheng Yee Low, Cheng Yee Low |
| author_facet | Ee Soong Low, Ee Soong Low Pauline Ong, Pauline Ong Cheng Yee Low, Cheng Yee Low |
| author_sort | Ee Soong Low, Ee Soong Low |
| building | UTHM Institutional Repository |
| collection | Online Access |
| description | Autonomous mobile robot path planning in unknown and dynamic environment is a crucial task for successful
mobile robot navigation. This study proposes an improved Q-learning (IQL) algorithm to address the challenges
of path planning in such environments. To this end, three different modes are introduced into the IQL algorithm,
namely the normal mode, the distortion mode, and the optimization mode. The normal mode operates according
to the standard Q-learning procedures. The distortion mode distorts the Q-values of states around dynamic
obstacles to facilitate avoidance, while the optimization mode is employed to overcome the local minimum
problem. The efficacy of the IQL algorithm is assessed through a series of comparative studies involving fourteen
navigation environments, each with distinct obstacle layouts and types. Comparative analyses are performed
based on several metrics, including computational time, travelled distance, collision rate, and success rate. The
proposed IQL algorithm exhibits a lower collision rate and a higher success rate when compared to dynamic
window approach, influence zone and inflated A* |
| first_indexed | 2025-11-15T20:30:47Z |
| format | Article |
| id | uthm-9624 |
| institution | Universiti Tun Hussein Onn Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T20:30:47Z |
| publishDate | 2023 |
| publisher | Elsevier |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | uthm-96242023-08-16T07:09:12Z http://eprints.uthm.edu.my/9624/ A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot Ee Soong Low, Ee Soong Low Pauline Ong, Pauline Ong Cheng Yee Low, Cheng Yee Low T Technology (General) Autonomous mobile robot path planning in unknown and dynamic environment is a crucial task for successful mobile robot navigation. This study proposes an improved Q-learning (IQL) algorithm to address the challenges of path planning in such environments. To this end, three different modes are introduced into the IQL algorithm, namely the normal mode, the distortion mode, and the optimization mode. The normal mode operates according to the standard Q-learning procedures. The distortion mode distorts the Q-values of states around dynamic obstacles to facilitate avoidance, while the optimization mode is employed to overcome the local minimum problem. The efficacy of the IQL algorithm is assessed through a series of comparative studies involving fourteen navigation environments, each with distinct obstacle layouts and types. Comparative analyses are performed based on several metrics, including computational time, travelled distance, collision rate, and success rate. The proposed IQL algorithm exhibits a lower collision rate and a higher success rate when compared to dynamic window approach, influence zone and inflated A* Elsevier 2023 Article PeerReviewed text en http://eprints.uthm.edu.my/9624/1/J16153_c2bd76a73c1e817275f1aabce076fc0f.pdf Ee Soong Low, Ee Soong Low and Pauline Ong, Pauline Ong and Cheng Yee Low, Cheng Yee Low (2023) A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot. Computers & Industrial Engineering, 181. pp. 1-29. https://doi.org/10.1016/j.cie.2023.109338 |
| spellingShingle | T Technology (General) Ee Soong Low, Ee Soong Low Pauline Ong, Pauline Ong Cheng Yee Low, Cheng Yee Low A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot |
| title | A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot |
| title_full | A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot |
| title_fullStr | A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot |
| title_full_unstemmed | A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot |
| title_short | A modified Q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot |
| title_sort | modified q-learning path planning approach using distortion concept and optimization in dynamic environment for autonomous mobile robot |
| topic | T Technology (General) |
| url | http://eprints.uthm.edu.my/9624/ http://eprints.uthm.edu.my/9624/ http://eprints.uthm.edu.my/9624/1/J16153_c2bd76a73c1e817275f1aabce076fc0f.pdf |