The Optimal Observability of Partially Observable Markov Decision Processes: Discrete State Space

QR Code

The Optimal Observability of Partially Observable Markov Decision Processes: Discrete State Space

We consider autonomous partially observable Markov decision processes where the control action influences the observation process only. Considering entropy as the cost incurred by the Markov information state process, the optimal observability problem is posed as a Markov decision scheduling problem...

Full description

Bibliographic Details
Main Authors:	Rezaeian, M., Vo, Ba-Ngu, Evans, J.
Format:	Journal Article
Published:	IEEE 2010
Subjects:	observability Estimation entropy sensor scheduling partially observable Markov decision processes
Online Access:	http://hdl.handle.net/20.500.11937/24789

Similar Items

Observer-based H∞ control on nonhomogeneous discrete-time markov jump systems
by: Yin, Y., et al.
Published: (2013)

Allowing for Development in the EAP Post-observation Conference: Towards a flexible observation model
by: Robinson, Lisa
Published: (2013)

Increased error observability of an inertial pedestrian navigation system by rotating IMU
by: Abdulrahim, Khairi, et al.
Published: (2014)

Detectability subspaces and observer synthesis for two-dimensional systems
by: Ntogramatzidis, Lorenzo, et al.
Published: (2010)

Using teaching observations to reflect upon and improve teaching practice in higher education
by: Atkinson, Douglas, et al.
Published: (2010)

Design of a repetitive controller as a feed-forward disturbance observer
by: Tang, Mi, et al.
Published: (2016)

Navigation and control based on integral-uncertainty observer for unmanned jet aircraft
by: Wang, Xinhua, et al.
Published: (2017)

Laser and Radar Based Robotic Perception
by: Adams, M., et al.
Published: (2011)

Reconsidering the value of covert research: the role of ambiguous consent in participant observation
by: Roulet, Thomas, et al.
Published: (2017)

Observer-based pulsed signal injection for grid impedance estimation in three phase systems
by: Garcia, Pablo, et al.
Published: (2018)

The Day-Of-The-Week Effects as Observed at the Kuala Lumpur Stock Exchange and Their Implications on the Efficient Market Hypothesis
by: Khairon, Rosli
Published: (1999)

Concentration Inequalities for Fluctuations in Classical and Quantum Markov Processes
by: Bakewell-Smith, George
Published: (2025)

Error Bounds for Joint Detection and Estimation of a Single Object With Random Finite Set Observation
by: Rezaeian, M., et al.
Published: (2010)

Sunyaev-Zel'dovich observations with AMI of the hottest galaxy clusters detected in the XMM-Newton Cluster Survey
by: Shimwell, T., et al.
Published: (2013)

Individualisation of HbA1c targets and treatment strategies in people with diabetes: real-world observational studies
by: Crabtree, Thomas Simon James
Published: (2024)

Markov decision process algorithms for wealth allocation problems with defaultable bonds
by: Pérez López, Iker, et al.
Published: (2016)

Aircraft navigation based on differentiation–integration observer
by: Wang, Xinhua, et al.
Published: (2017)

Validation of BeiDou Observations
by: El-Mowafy, Ahmed, et al.
Published: (2014)

The application of sliding mode observers to fault detection and isolation for multilevel converters
by: Shao, Shuai
Published: (2015)

Sensor Control for Multi-Object State-Space Estimation Using Random Finite Sets
by: Ristic, B., et al.
Published: (2010)

Simultaneous estimation of states and inputs in a planar solid oxide fuel cell using nonlinear adaptive observer design
by: Vijay, Periasamy, et al.
Published: (2013)

Estimation of Multi-Constellation GNSS Observation Stochastic Properties Using a Single-Receiver Single-Satellite Data Validation Method
by: El-Mowafy, Ahmed
Published: (2015)

Results in stochastic control: optimal prediction problems and Markov decision processes
by: Pérez López, Iker
Published: (2015)

Dynamic programming with approximation function for nurse scheduling
by: Shi, Peng, et al.
Published: (2016)

Observing pulsars and fast transients with LOFAR
by: Stappers, B., et al.
Published: (2011)

Directly observed therapy to measure adherence to tuberculosis medication in observational research: Protocol for a prospective cohort study
by: Ragan, E.J., et al.
Published: (2021)

Exploring everyday relations with animal research: a sociological analysis of writing from the Mass Observation Project
by: McGlacken, Renelle
Published: (2021)

Adaptive observer based approach for the fault diagnosis in solid oxide fuel cells
by: Periasamy, Vijay, et al.
Published: (2019)

Fault detection for modular multilevel converters based on sliding mode observer
by: Shao, Shuai, et al.
Published: (2013)

Homotopy colimits and global observables in Abelian gauge theory
by: Benini, Marco, et al.
Published: (2015)

The paradox from within: research participants doing-being-observed
by: Hazel, Spencer
Published: (2015)

Parametrization effects in the analysis of AMI Sunyaev–Zel’dovich observations
by: Olamaie, M., et al.
Published: (2012)

Implementation and testing of the first prompt search for gravitational wave transients with electromagnetic counterparts
by: Abadie, J., et al.
Published: (2012)

Likelihood Inference In Parallel Systems Regression Models With Censored Data
by: S.M.Baklizi, Ayman
Published: (1997)

Bayesian inference of Weibull distribution for right and interval censored data
by: Guure, Chris Bambey
Published: (2013)

Hidden markov model for decision making among heterogeneous systems in intelligent building
by: Abba, Babakura
Published: (2014)

A new approach for optimising GNSS positioning performance in harsh observation environments
by: Pan, Shuguo, et al.
Published: (2014)

Transformer asset management based on Markov Prediction Model utilizing health index
by: Yahaya, Muhammad Sharil
Published: (2019)

Follow-up observations at 16 and 33 GHz of extragalactic sources from WMAP 3-yr data: I – Spectral properties
by: Davies, M., et al.
Published: (2009)

Follow-up observations at 16 and 33 GHz of extragalactic sources from WMAP 3-yr data: II – Flux density variability
by: Franzen, Thomas, et al.
Published: (2009)