The Megopolis Resampler: Memory Coalesced Resampling on GPUs

The resampling process employed in widely used methods such as Importance Sampling (IS), with its adaptive extension (AIS), are used to solve challenging problems requiring approximate inference; for example, non-linear, non-Gaussian state estimation problems. However, the re-sampling process can...

Full description

Bibliographic Details
Main Authors: Chesser, Joshua A, Nguyen, Hoa Van, Ranasinghe, Damith C
Format: Journal Article
Published: 2021
Subjects:
Online Access:http://purl.org/au-research/grants/arc/LP160101177
http://hdl.handle.net/20.500.11937/96502
_version_ 1848766159899328512
author Chesser, Joshua A
Nguyen, Hoa Van
Ranasinghe, Damith C
author_facet Chesser, Joshua A
Nguyen, Hoa Van
Ranasinghe, Damith C
author_sort Chesser, Joshua A
building Curtin Institutional Repository
collection Online Access
description The resampling process employed in widely used methods such as Importance Sampling (IS), with its adaptive extension (AIS), are used to solve challenging problems requiring approximate inference; for example, non-linear, non-Gaussian state estimation problems. However, the re-sampling process can be computationally prohibitive for practical problems with real-time requirements. We consider the problem of developing highly parallelisable resampling algorithms for massively parallel hardware architectures of modern graphics processing units (GPUs) to accomplish real-time performance. We develop a new variant of the Metropolis algorithm -- Megopolis -- that improves performance without requiring a tuning parameter or reducing resampling quality. The Megopolis algorithm is built upon exploiting the memory access patterns of modern GPU units to reduce the number of memory transactions without the need for tuning parameters. Extensive numerical experiments on GPU hardware demonstrate that the proposed Megopolis algorithm is numerically stable and outperforms the original Metropolis algorithm and its variants -- Metropolis-C1 and Metropolis-C2 -- in speed and quality metrics. Further, given the absence of open tools in this domain and facilitating fair comparisons in the future and supporting the signal processing community, we also open source the complete project, including a repository of source code with Megopolis and all other comparison methods.
first_indexed 2025-11-14T11:46:43Z
format Journal Article
id curtin-20.500.11937-96502
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T11:46:43Z
publishDate 2021
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-965022025-01-10T07:51:59Z The Megopolis Resampler: Memory Coalesced Resampling on GPUs Chesser, Joshua A Nguyen, Hoa Van Ranasinghe, Damith C cs.DC cs.DC The resampling process employed in widely used methods such as Importance Sampling (IS), with its adaptive extension (AIS), are used to solve challenging problems requiring approximate inference; for example, non-linear, non-Gaussian state estimation problems. However, the re-sampling process can be computationally prohibitive for practical problems with real-time requirements. We consider the problem of developing highly parallelisable resampling algorithms for massively parallel hardware architectures of modern graphics processing units (GPUs) to accomplish real-time performance. We develop a new variant of the Metropolis algorithm -- Megopolis -- that improves performance without requiring a tuning parameter or reducing resampling quality. The Megopolis algorithm is built upon exploiting the memory access patterns of modern GPU units to reduce the number of memory transactions without the need for tuning parameters. Extensive numerical experiments on GPU hardware demonstrate that the proposed Megopolis algorithm is numerically stable and outperforms the original Metropolis algorithm and its variants -- Metropolis-C1 and Metropolis-C2 -- in speed and quality metrics. Further, given the absence of open tools in this domain and facilitating fair comparisons in the future and supporting the signal processing community, we also open source the complete project, including a repository of source code with Megopolis and all other comparison methods. 2021 Journal Article http://hdl.handle.net/20.500.11937/96502 10.1016/j.dsp.2021.103261 http://purl.org/au-research/grants/arc/LP160101177 http://creativecommons.org/licenses/by-nc-nd/4.0/ fulltext
spellingShingle cs.DC
cs.DC
Chesser, Joshua A
Nguyen, Hoa Van
Ranasinghe, Damith C
The Megopolis Resampler: Memory Coalesced Resampling on GPUs
title The Megopolis Resampler: Memory Coalesced Resampling on GPUs
title_full The Megopolis Resampler: Memory Coalesced Resampling on GPUs
title_fullStr The Megopolis Resampler: Memory Coalesced Resampling on GPUs
title_full_unstemmed The Megopolis Resampler: Memory Coalesced Resampling on GPUs
title_short The Megopolis Resampler: Memory Coalesced Resampling on GPUs
title_sort megopolis resampler: memory coalesced resampling on gpus
topic cs.DC
cs.DC
url http://purl.org/au-research/grants/arc/LP160101177
http://hdl.handle.net/20.500.11937/96502