Data discovery algorithm for scientific data grid environment
In modern scientific computing communities, scientists are involved in managing massive amounts of very large data collections in a geographically distributed environment. Research in the area of grid computing has given us various ideas and solutions to address these requirements. Data grid mostly...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
Elsevier
2005
|
| Subjects: | |
| Online Access: | http://psasir.upm.edu.my/id/eprint/18365/ http://psasir.upm.edu.my/id/eprint/18365/1/Data%20discovery%20algorithm%20for%20scientific%20data%20grid%20environment.pdf |
| _version_ | 1848843491623305216 |
|---|---|
| author | Abdullah, Azizol Othman, Mohamed Sulaiman, Md. Nasir Ibrahim, Hamidah Othman, Abu Talib |
| author_facet | Abdullah, Azizol Othman, Mohamed Sulaiman, Md. Nasir Ibrahim, Hamidah Othman, Abu Talib |
| author_sort | Abdullah, Azizol |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | In modern scientific computing communities, scientists are involved in managing massive amounts of very large data collections in a geographically distributed environment. Research in the area of grid computing has given us various ideas and solutions to address these requirements. Data grid mostly deals with large computational problems and provides geographically distributed resources for large-scale data-intensive applications that generate large data sets. Peer-to-peer (P2P) networks have also become a major research topic over the last few years. In a distributed P2P system, a discovery algorithm is required to locate specific information, applications, or users within the system. In this research work, we present our scientific data grid as a large P2P-based distributed system model. By using this model, we study various discovery algorithms for locating data sets in a data grid system. The algorithms we studied are based on the P2P architecture. We investigate these algorithms using our Grid Simulator developed using PARSEC. In this paper, we illustrate our scientific data grid model and our Grid Simulator. We then analyze the performance of the discovery algorithms relative to their average number of hop, success rates and bandwidth consumption. © 2005 Elsevier Inc. All rights reserved. |
| first_indexed | 2025-11-15T08:15:52Z |
| format | Article |
| id | upm-18365 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English English |
| last_indexed | 2025-11-15T08:15:52Z |
| publishDate | 2005 |
| publisher | Elsevier |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-183652015-12-09T03:24:40Z http://psasir.upm.edu.my/id/eprint/18365/ Data discovery algorithm for scientific data grid environment Abdullah, Azizol Othman, Mohamed Sulaiman, Md. Nasir Ibrahim, Hamidah Othman, Abu Talib In modern scientific computing communities, scientists are involved in managing massive amounts of very large data collections in a geographically distributed environment. Research in the area of grid computing has given us various ideas and solutions to address these requirements. Data grid mostly deals with large computational problems and provides geographically distributed resources for large-scale data-intensive applications that generate large data sets. Peer-to-peer (P2P) networks have also become a major research topic over the last few years. In a distributed P2P system, a discovery algorithm is required to locate specific information, applications, or users within the system. In this research work, we present our scientific data grid as a large P2P-based distributed system model. By using this model, we study various discovery algorithms for locating data sets in a data grid system. The algorithms we studied are based on the P2P architecture. We investigate these algorithms using our Grid Simulator developed using PARSEC. In this paper, we illustrate our scientific data grid model and our Grid Simulator. We then analyze the performance of the discovery algorithms relative to their average number of hop, success rates and bandwidth consumption. © 2005 Elsevier Inc. All rights reserved. Elsevier 2005-11 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/18365/1/Data%20discovery%20algorithm%20for%20scientific%20data%20grid%20environment.pdf Abdullah, Azizol and Othman, Mohamed and Sulaiman, Md. Nasir and Ibrahim, Hamidah and Othman, Abu Talib (2005) Data discovery algorithm for scientific data grid environment. Journal of Parallel and Distributed Computing, 65 (11). pp. 1429-1434. ISSN 0743-7315 http://dx.doi.org/10.1016/j.jpdc.2005.05.006 Computer networks Computer algorithms Computational grids (Computer systems) doi:10.1016/j.jpdc.2005.05.006 English |
| spellingShingle | Computer networks Computer algorithms Computational grids (Computer systems) Abdullah, Azizol Othman, Mohamed Sulaiman, Md. Nasir Ibrahim, Hamidah Othman, Abu Talib Data discovery algorithm for scientific data grid environment |
| title | Data discovery algorithm for scientific data grid environment |
| title_full | Data discovery algorithm for scientific data grid environment |
| title_fullStr | Data discovery algorithm for scientific data grid environment |
| title_full_unstemmed | Data discovery algorithm for scientific data grid environment |
| title_short | Data discovery algorithm for scientific data grid environment |
| title_sort | data discovery algorithm for scientific data grid environment |
| topic | Computer networks Computer algorithms Computational grids (Computer systems) |
| url | http://psasir.upm.edu.my/id/eprint/18365/ http://psasir.upm.edu.my/id/eprint/18365/ http://psasir.upm.edu.my/id/eprint/18365/ http://psasir.upm.edu.my/id/eprint/18365/1/Data%20discovery%20algorithm%20for%20scientific%20data%20grid%20environment.pdf |