Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms

This PhD thesis conducts survey in numerical algorithms for inverse problems. The inverse problems are usually ill-posed in practice. They require additional regularization. The standard setting of inverse problems are variational approach and Bayesian approach. This thesis rewrites the standard set...

Full description

Bibliographic Details
Main Author: Yang, Yuchen
Format: Thesis (University of Nottingham only)
Language:English
Published: 2020
Subjects:
Online Access:https://eprints.nottingham.ac.uk/59873/
_version_ 1848801188423663616
author Yang, Yuchen
author_facet Yang, Yuchen
author_sort Yang, Yuchen
building Nottingham Research Data Repository
collection Online Access
description This PhD thesis conducts survey in numerical algorithms for inverse problems. The inverse problems are usually ill-posed in practice. They require additional regularization. The standard setting of inverse problems are variational approach and Bayesian approach. This thesis rewrites the standard setting into the tempering setting with an auxiliary parameter called the tempering parameter. The tempering setting has the similar mathematical structure as canonical ensemble in statistical mechanics. This mathematical skill has been widely applied in annealed importance sampling, simulated annealing, sequential Monte Carlo simulation, et al. In this thesis, we consider infinite-dimensional inverse problems, and uses continuous tempering parameter. Inverse problems with the tempering setting can be approximately simplified as continuous extend Kalman filter with a PDE formula, or continuous mean-field limit ensemble Kalman filter as a SDE formula. We propose the adaptive strategy called data-misfit controller to discretize the PDE and SDE, and the resulting algorithms keep both efficiency and accuracy. Additionally, we prove monotone properties of the tempering setting. Based on these properties, we propose the early stop criterion monitoring quality of estimates in filtering. This improves the robustness of the Kalman-like methods for highly nonlinear problems.
first_indexed 2025-11-14T21:03:29Z
format Thesis (University of Nottingham only)
id nottingham-59873
institution University of Nottingham Malaysia Campus
institution_category Local University
language English
last_indexed 2025-11-14T21:03:29Z
publishDate 2020
recordtype eprints
repository_type Digital Repository
spelling nottingham-598732025-08-11T09:51:48Z https://eprints.nottingham.ac.uk/59873/ Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms Yang, Yuchen This PhD thesis conducts survey in numerical algorithms for inverse problems. The inverse problems are usually ill-posed in practice. They require additional regularization. The standard setting of inverse problems are variational approach and Bayesian approach. This thesis rewrites the standard setting into the tempering setting with an auxiliary parameter called the tempering parameter. The tempering setting has the similar mathematical structure as canonical ensemble in statistical mechanics. This mathematical skill has been widely applied in annealed importance sampling, simulated annealing, sequential Monte Carlo simulation, et al. In this thesis, we consider infinite-dimensional inverse problems, and uses continuous tempering parameter. Inverse problems with the tempering setting can be approximately simplified as continuous extend Kalman filter with a PDE formula, or continuous mean-field limit ensemble Kalman filter as a SDE formula. We propose the adaptive strategy called data-misfit controller to discretize the PDE and SDE, and the resulting algorithms keep both efficiency and accuracy. Additionally, we prove monotone properties of the tempering setting. Based on these properties, we propose the early stop criterion monitoring quality of estimates in filtering. This improves the robustness of the Kalman-like methods for highly nonlinear problems. 2020-07-24 Thesis (University of Nottingham only) NonPeerReviewed application/pdf en arr https://eprints.nottingham.ac.uk/59873/1/Thesis.pdf Yang, Yuchen (2020) Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms. PhD thesis, University of Nottingham. Inverse problems Bayesian inference variational method Kalman filter tempering setting adaptive strategy information gain
spellingShingle Inverse problems
Bayesian inference
variational method
Kalman filter
tempering setting
adaptive strategy
information gain
Yang, Yuchen
Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms
title Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms
title_full Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms
title_fullStr Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms
title_full_unstemmed Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms
title_short Kalman-like Inversion with ODE/SDE Formulations and Adaptive Algorithms
title_sort kalman-like inversion with ode/sde formulations and adaptive algorithms
topic Inverse problems
Bayesian inference
variational method
Kalman filter
tempering setting
adaptive strategy
information gain
url https://eprints.nottingham.ac.uk/59873/