Distributed Gridded Data Delivery for Marine Research

A combination of off-the-shelf open-source software and custom-built middleware is used to unite remotely sensed marine data archives operated across Australia by five different agencies and make them accessible via a common interface to a user located anywhere on the internet. The utilisation of e...

Full description

Bibliographic Details
Main Authors: King, E, Mak, P, Turner, P, Smith, G, Suber, K, Paget, M, Jackett, C, Fearns, Peter, Rohl, Andrew, Goessmann, Florian, Majewski, L, Reddy, S., Steinberg, C
Other Authors: NA
Format: Conference Paper
Published: University of Queensland 2008
Subjects:
Online Access:http://espace.library.uq.edu.au/collection/UQ:152010.
http://hdl.handle.net/20.500.11937/4760
_version_ 1848744606388191232
author King, E
Mak, P
Turner, P
Smith, G
Suber, K
Paget, M
Jackett, C
Fearns, Peter
Rohl, Andrew
Goessmann, Florian
Majewski, L
Reddy, S.
Steinberg, C
author2 NA
author_facet NA
King, E
Mak, P
Turner, P
Smith, G
Suber, K
Paget, M
Jackett, C
Fearns, Peter
Rohl, Andrew
Goessmann, Florian
Majewski, L
Reddy, S.
Steinberg, C
author_sort King, E
building Curtin Institutional Repository
collection Online Access
description A combination of off-the-shelf open-source software and custom-built middleware is used to unite remotely sensed marine data archives operated across Australia by five different agencies and make them accessible via a common interface to a user located anywhere on the internet. The utilisation of existing storage and some state of the art fileservers with a distributed data model, makes the system low-cost, scalable and robust. The creation of a virtual national data set with automatic cataloguing enables the development of advanced data services including aggregation and spatio-temporal time series and sub-setting. Data sets are served through OPeNDAP and automatically harvested for meta-data including temporal and spatial bounds. Spatio-temporal queries made on the catalogues provide information to allow retrieval of subset data, or if many data sets are returned, the aggregation of data matching the query. The software developed to implement the system is built as a set of layers with well defined interfaces, allowing system modularisation and a range of levels of access.
first_indexed 2025-11-14T06:04:08Z
format Conference Paper
id curtin-20.500.11937-4760
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T06:04:08Z
publishDate 2008
publisher University of Queensland
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-47602017-03-08T13:31:50Z Distributed Gridded Data Delivery for Marine Research King, E Mak, P Turner, P Smith, G Suber, K Paget, M Jackett, C Fearns, Peter Rohl, Andrew Goessmann, Florian Majewski, L Reddy, S. Steinberg, C NA Marine data archives Software Middleware A combination of off-the-shelf open-source software and custom-built middleware is used to unite remotely sensed marine data archives operated across Australia by five different agencies and make them accessible via a common interface to a user located anywhere on the internet. The utilisation of existing storage and some state of the art fileservers with a distributed data model, makes the system low-cost, scalable and robust. The creation of a virtual national data set with automatic cataloguing enables the development of advanced data services including aggregation and spatio-temporal time series and sub-setting. Data sets are served through OPeNDAP and automatically harvested for meta-data including temporal and spatial bounds. Spatio-temporal queries made on the catalogues provide information to allow retrieval of subset data, or if many data sets are returned, the aggregation of data matching the query. The software developed to implement the system is built as a set of layers with well defined interfaces, allowing system modularisation and a range of levels of access. 2008 Conference Paper http://hdl.handle.net/20.500.11937/4760 http://espace.library.uq.edu.au/collection/UQ:152010. University of Queensland fulltext
spellingShingle Marine data archives
Software
Middleware
King, E
Mak, P
Turner, P
Smith, G
Suber, K
Paget, M
Jackett, C
Fearns, Peter
Rohl, Andrew
Goessmann, Florian
Majewski, L
Reddy, S.
Steinberg, C
Distributed Gridded Data Delivery for Marine Research
title Distributed Gridded Data Delivery for Marine Research
title_full Distributed Gridded Data Delivery for Marine Research
title_fullStr Distributed Gridded Data Delivery for Marine Research
title_full_unstemmed Distributed Gridded Data Delivery for Marine Research
title_short Distributed Gridded Data Delivery for Marine Research
title_sort distributed gridded data delivery for marine research
topic Marine data archives
Software
Middleware
url http://espace.library.uq.edu.au/collection/UQ:152010.
http://hdl.handle.net/20.500.11937/4760