MapReduce scheduling algorithms: a review
Recent trends in big data have shown that the amount of data continues to increase at an exponential rate. This trend has inspired many researchers over the past few years to explore new research direction of studies related to multiple areas of big data. The widespread popularity of big data proces...
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer
2018
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/86645/ http://psasir.upm.edu.my/id/eprint/86645/1/MapReduce%20scheduling%20algorithms.pdf |
| _version_ | 1848860253300457472 |
|---|---|
| author | Hashem, Ibrahim Abaker Targio Anuar, Nor Badrul Marjani, Mohsen Ahmed, Ejaz Chiroma, Haruna Firdaus, Ahmad Abdullah, Muhamad Taufik Alotaibi, Faiz Mahmoud Ali, Waleed Kamaleldin Yaqoob, Ibrar Gani, Abdullah |
| author_facet | Hashem, Ibrahim Abaker Targio Anuar, Nor Badrul Marjani, Mohsen Ahmed, Ejaz Chiroma, Haruna Firdaus, Ahmad Abdullah, Muhamad Taufik Alotaibi, Faiz Mahmoud Ali, Waleed Kamaleldin Yaqoob, Ibrar Gani, Abdullah |
| author_sort | Hashem, Ibrahim Abaker Targio |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | Recent trends in big data have shown that the amount of data continues to increase at an exponential rate. This trend has inspired many researchers over the past few years to explore new research direction of studies related to multiple areas of big data. The widespread popularity of big data processing platforms using MapReduce framework is the growing demand to further optimize their performance for various purposes. In particular, enhancing resources and jobs scheduling are becoming critical since they fundamentally determine whether the applications can achieve the performance goals in different use cases. Scheduling plays an important role in big data, mainly in reducing the execution time and cost of processing. This paper aims to survey the research undertaken in the field of scheduling in big data platforms. Moreover, this paper analyzed scheduling in MapReduce on two aspects: taxonomy and performance evaluation. The research progress in MapReduce scheduling algorithms is also discussed. The limitations of existing MapReduce scheduling algorithms and exploit future research opportunities are pointed out in the paper for easy identification by researchers. Our study can serve as the benchmark to expert researchers for proposing a novel MapReduce scheduling algorithm. However, for novice researchers, the study can be used as a starting point. |
| first_indexed | 2025-11-15T12:42:18Z |
| format | Article |
| id | upm-86645 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T12:42:18Z |
| publishDate | 2018 |
| publisher | Springer |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-866452021-10-17T21:29:03Z http://psasir.upm.edu.my/id/eprint/86645/ MapReduce scheduling algorithms: a review Hashem, Ibrahim Abaker Targio Anuar, Nor Badrul Marjani, Mohsen Ahmed, Ejaz Chiroma, Haruna Firdaus, Ahmad Abdullah, Muhamad Taufik Alotaibi, Faiz Mahmoud Ali, Waleed Kamaleldin Yaqoob, Ibrar Gani, Abdullah Recent trends in big data have shown that the amount of data continues to increase at an exponential rate. This trend has inspired many researchers over the past few years to explore new research direction of studies related to multiple areas of big data. The widespread popularity of big data processing platforms using MapReduce framework is the growing demand to further optimize their performance for various purposes. In particular, enhancing resources and jobs scheduling are becoming critical since they fundamentally determine whether the applications can achieve the performance goals in different use cases. Scheduling plays an important role in big data, mainly in reducing the execution time and cost of processing. This paper aims to survey the research undertaken in the field of scheduling in big data platforms. Moreover, this paper analyzed scheduling in MapReduce on two aspects: taxonomy and performance evaluation. The research progress in MapReduce scheduling algorithms is also discussed. The limitations of existing MapReduce scheduling algorithms and exploit future research opportunities are pointed out in the paper for easy identification by researchers. Our study can serve as the benchmark to expert researchers for proposing a novel MapReduce scheduling algorithm. However, for novice researchers, the study can be used as a starting point. Springer 2018-12 Article PeerReviewed text en http://psasir.upm.edu.my/id/eprint/86645/1/MapReduce%20scheduling%20algorithms.pdf Hashem, Ibrahim Abaker Targio and Anuar, Nor Badrul and Marjani, Mohsen and Ahmed, Ejaz and Chiroma, Haruna and Firdaus, Ahmad and Abdullah, Muhamad Taufik and Alotaibi, Faiz and Mahmoud Ali, Waleed Kamaleldin and Yaqoob, Ibrar and Gani, Abdullah (2018) MapReduce scheduling algorithms: a review. The Journal of Supercomputing, 76. pp. 4915-4945. ISSN 0920-8542; ESSN: 1573-0484 https://link.springer.com/article/10.1007/s11227-018-2719-5 10.1007/s11227-018-2719-5 |
| spellingShingle | Hashem, Ibrahim Abaker Targio Anuar, Nor Badrul Marjani, Mohsen Ahmed, Ejaz Chiroma, Haruna Firdaus, Ahmad Abdullah, Muhamad Taufik Alotaibi, Faiz Mahmoud Ali, Waleed Kamaleldin Yaqoob, Ibrar Gani, Abdullah MapReduce scheduling algorithms: a review |
| title | MapReduce scheduling algorithms: a review |
| title_full | MapReduce scheduling algorithms: a review |
| title_fullStr | MapReduce scheduling algorithms: a review |
| title_full_unstemmed | MapReduce scheduling algorithms: a review |
| title_short | MapReduce scheduling algorithms: a review |
| title_sort | mapreduce scheduling algorithms: a review |
| url | http://psasir.upm.edu.my/id/eprint/86645/ http://psasir.upm.edu.my/id/eprint/86645/ http://psasir.upm.edu.my/id/eprint/86645/ http://psasir.upm.edu.my/id/eprint/86645/1/MapReduce%20scheduling%20algorithms.pdf |