Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem

An approximate dynamic programming that incorporates a combined policy, value function approximation and lookahead policy, is proposed. The algorithm is validated by applying it to solve a set of instances of the nurse rostering problem tackled as a multi-stage problem. In each stage of the problem,...

Full description

Bibliographic Details
Main Authors: Shi, Peng, Landa-Silva, Dario
Format: Conference or Workshop Item
Published: 2017
Online Access:https://eprints.nottingham.ac.uk/48603/
_version_ 1848797804426690560
author Shi, Peng
Landa-Silva, Dario
author_facet Shi, Peng
Landa-Silva, Dario
author_sort Shi, Peng
building Nottingham Research Data Repository
collection Online Access
description An approximate dynamic programming that incorporates a combined policy, value function approximation and lookahead policy, is proposed. The algorithm is validated by applying it to solve a set of instances of the nurse rostering problem tackled as a multi-stage problem. In each stage of the problem, a weekly roster is constructed taking into consideration historical information about the nurse rosters in the previous week and assuming the future demand for the following weeks as unknown. The proposed method consists of three phases. First, a pre-process phase generates a set of valid shift patterns. Next, a local phase solves the weekly optimization problem using value function approximation policy. Finally, the global phase uses lookahead policy to evaluate the weekly rosters within a lookahead period. Experiments are conducted using instances from the Second International Nurse Rostering Competition and results indicate that the method is able to solve large instances of the problem which was not possible with a previous version of approximate dynamic programming.
first_indexed 2025-11-14T20:09:42Z
format Conference or Workshop Item
id nottingham-48603
institution University of Nottingham Malaysia Campus
institution_category Local University
last_indexed 2025-11-14T20:09:42Z
publishDate 2017
recordtype eprints
repository_type Digital Repository
spelling nottingham-486032020-05-04T19:07:02Z https://eprints.nottingham.ac.uk/48603/ Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem Shi, Peng Landa-Silva, Dario An approximate dynamic programming that incorporates a combined policy, value function approximation and lookahead policy, is proposed. The algorithm is validated by applying it to solve a set of instances of the nurse rostering problem tackled as a multi-stage problem. In each stage of the problem, a weekly roster is constructed taking into consideration historical information about the nurse rosters in the previous week and assuming the future demand for the following weeks as unknown. The proposed method consists of three phases. First, a pre-process phase generates a set of valid shift patterns. Next, a local phase solves the weekly optimization problem using value function approximation policy. Finally, the global phase uses lookahead policy to evaluate the weekly rosters within a lookahead period. Experiments are conducted using instances from the Second International Nurse Rostering Competition and results indicate that the method is able to solve large instances of the problem which was not possible with a previous version of approximate dynamic programming. 2017-09-14 Conference or Workshop Item PeerReviewed Shi, Peng and Landa-Silva, Dario (2017) Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem. In: 3rd International Workshop on Machine Learning, Optimization and Big Data (MOD 2017), 14-17 September 2017, Volterra, Italy.
spellingShingle Shi, Peng
Landa-Silva, Dario
Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem
title Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem
title_full Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem
title_fullStr Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem
title_full_unstemmed Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem
title_short Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem
title_sort approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem
url https://eprints.nottingham.ac.uk/48603/