Weather data analysis using hadoop : Applications and challenges
Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department d...
| Main Authors: | , , , |
|---|---|
| Format: | Conference or Workshop Item |
| Language: | English |
| Published: |
IOP Publishing
2019
|
| Subjects: | |
| Online Access: | http://umpir.ump.edu.my/id/eprint/26182/ http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf |
| _version_ | 1848822468861493248 |
|---|---|
| author | Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid |
| author_facet | Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid |
| author_sort | Mohammed Adam Ibrahim, Fakharaldien |
| building | UMP Institutional Repository |
| collection | Online Access |
| description | Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department deployed sensors for each weather parameter at different geographical locations to collect data. This data is stored mostly in the unstructured format. Thus, a big amount of data has been collected and archived. Therefore, storage and processing of this big data for accurate weather prediction is a huge challenge. Hadoop an apache product it used to support big data sets in a distributed environment. Hadoop has greatest advantages over scalable and fault-tolerant distributed processing technologies. This paper explains a system that uses the historical weather data of a region and apply the MapReduce and Hadoop techniques to analysis these historical data. |
| first_indexed | 2025-11-15T02:41:44Z |
| format | Conference or Workshop Item |
| id | ump-26182 |
| institution | Universiti Malaysia Pahang |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T02:41:44Z |
| publishDate | 2019 |
| publisher | IOP Publishing |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | ump-261822019-12-20T07:48:54Z http://umpir.ump.edu.my/id/eprint/26182/ Weather data analysis using hadoop : Applications and challenges Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid QA76 Computer software QC Physics TA Engineering (General). Civil engineering (General) Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department deployed sensors for each weather parameter at different geographical locations to collect data. This data is stored mostly in the unstructured format. Thus, a big amount of data has been collected and archived. Therefore, storage and processing of this big data for accurate weather prediction is a huge challenge. Hadoop an apache product it used to support big data sets in a distributed environment. Hadoop has greatest advantages over scalable and fault-tolerant distributed processing technologies. This paper explains a system that uses the historical weather data of a region and apply the MapReduce and Hadoop techniques to analysis these historical data. IOP Publishing 2019-08-14 Conference or Workshop Item PeerReviewed pdf en cc_by http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf Mohammed Adam Ibrahim, Fakharaldien and Khalid, Adam and Noor Akma, Abu Bakar and Mazlina, Abdul Majid (2019) Weather data analysis using hadoop : Applications and challenges. In: IOP Conference Series: Materials Science and Engineering, Joint Conference on Green Engineering Technology & Applied Computing 2019 , 4-5 February 2019 , Bangkok, Thailand. pp. 1-6., 551 (012044). ISSN 1757-8981 (Print), 1757-899X (Online) (Published) https://doi.org/10.1088/1757-899X/551/1/012044 |
| spellingShingle | QA76 Computer software QC Physics TA Engineering (General). Civil engineering (General) Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid Weather data analysis using hadoop : Applications and challenges |
| title | Weather data analysis using hadoop : Applications and challenges |
| title_full | Weather data analysis using hadoop : Applications and challenges |
| title_fullStr | Weather data analysis using hadoop : Applications and challenges |
| title_full_unstemmed | Weather data analysis using hadoop : Applications and challenges |
| title_short | Weather data analysis using hadoop : Applications and challenges |
| title_sort | weather data analysis using hadoop : applications and challenges |
| topic | QA76 Computer software QC Physics TA Engineering (General). Civil engineering (General) |
| url | http://umpir.ump.edu.my/id/eprint/26182/ http://umpir.ump.edu.my/id/eprint/26182/ http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf |