Bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification

This work addresses the issue of Bayesian robustness in the multivariate normal model when the prior covariance matrix is not completely specified, but rather is described in terms of positive semi-definite bounds. This occurs in situations where, for example, the only prior information available is...

Full description

Bibliographic Details
Main Authors: Pham, DucSon, Bui, Hung H., Venkatesh, Svetha
Format: Journal Article
Published: Institute of Electrical and Electronics Engineers 2010
Subjects:
Online Access:http://hdl.handle.net/20.500.11937/5185
_version_ 1848744724740964352
author Pham, DucSon
Bui, Hung H.
Venkatesh, Svetha
author_facet Pham, DucSon
Bui, Hung H.
Venkatesh, Svetha
author_sort Pham, DucSon
building Curtin Institutional Repository
collection Online Access
description This work addresses the issue of Bayesian robustness in the multivariate normal model when the prior covariance matrix is not completely specified, but rather is described in terms of positive semi-definite bounds. This occurs in situations where, for example, the only prior information available is the bound on the diagonal of the covariance matrix derived from some physical constraints, and that the covariance matrix is positive semi-definite, but otherwise arbitrary. Under the conditional Gamma-minimax principle, previous work by DasGupta and Studden shows that an analytically exact solution is readily available for a special case where the bound difference is a scaled identity. The goal in this work is to consider this problem for general positive definite matrices. The contribution in this paper is a theoretical study of the geometry of the minimax problem. Extension of previous results to a more general case is shown and a practical algorithm that relies on semi-definite programming and the convexity of the minimax formulation is derived. Although the algorithm is numerically exact for up to the bivariate case, its exactness for other cases remains open. Numerical studies demonstrate the accuracy of the proposed algorithm and the robustness of the minimax solution relative to standard and recently proposed methods.
first_indexed 2025-11-14T06:06:01Z
format Journal Article
id curtin-20.500.11937-5185
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T06:06:01Z
publishDate 2010
publisher Institute of Electrical and Electronics Engineers
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-51852017-09-13T16:02:57Z Bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification Pham, DucSon Bui, Hung H. Venkatesh, Svetha minimax estimator Bayesian point estimate shrinkage method robust Bayesian analysis prior uncertainty normal model gamma-minimax This work addresses the issue of Bayesian robustness in the multivariate normal model when the prior covariance matrix is not completely specified, but rather is described in terms of positive semi-definite bounds. This occurs in situations where, for example, the only prior information available is the bound on the diagonal of the covariance matrix derived from some physical constraints, and that the covariance matrix is positive semi-definite, but otherwise arbitrary. Under the conditional Gamma-minimax principle, previous work by DasGupta and Studden shows that an analytically exact solution is readily available for a special case where the bound difference is a scaled identity. The goal in this work is to consider this problem for general positive definite matrices. The contribution in this paper is a theoretical study of the geometry of the minimax problem. Extension of previous results to a more general case is shown and a practical algorithm that relies on semi-definite programming and the convexity of the minimax formulation is derived. Although the algorithm is numerically exact for up to the bivariate case, its exactness for other cases remains open. Numerical studies demonstrate the accuracy of the proposed algorithm and the robustness of the minimax solution relative to standard and recently proposed methods. 2010 Journal Article http://hdl.handle.net/20.500.11937/5185 10.1109/TIT.2010.2080612 Institute of Electrical and Electronics Engineers fulltext
spellingShingle minimax estimator
Bayesian point estimate
shrinkage method
robust Bayesian analysis
prior uncertainty
normal model
gamma-minimax
Pham, DucSon
Bui, Hung H.
Venkatesh, Svetha
Bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification
title Bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification
title_full Bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification
title_fullStr Bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification
title_full_unstemmed Bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification
title_short Bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification
title_sort bayesian minimax estimation of the normal model with incomplete prior covariance matrix specification
topic minimax estimator
Bayesian point estimate
shrinkage method
robust Bayesian analysis
prior uncertainty
normal model
gamma-minimax
url http://hdl.handle.net/20.500.11937/5185