Pipeline Collector: Gathering performance data for distributed astronomical pipelines

Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes it difficult to monitor the performance of each pipeline ste...

Full description

Bibliographic Details
Main Authors: Mechev, A., Plaat, A., Oonk, J., Intema, Hubertus, Röttgering, H.
Format: Journal Article
Published: 2018
Online Access:http://hdl.handle.net/20.500.11937/74864