Adaptive dynamic programming algorithms for sequential appointment scheduling with patient preferences

•Both physician preference and time slot preference are considered.•A Markov decision process model is proposed to optimize scheduling appointment.•Adaptive dynamic programming algorithms are proposed to learn patient preferences. A well-developed appointment system can help increase the utilization...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Artificial intelligence in medicine Jg. 63; H. 1; S. 33 - 40
Hauptverfasser: Wang, Jin, Fung, Richard Y.K.
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Netherlands Elsevier B.V 01.01.2015
Schlagworte:
Adaptive algorithms
Adaptive dynamic programming
Algorithms
Appointment scheduling
Appointments and Schedules
Computer Simulation
Computer Systems
Convergence
Dynamical systems
Efficiency, Organizational
Humans
Internal Medicine
Markov Chains
Markov decision process
Mathematical analysis
Mathematical models
Operations Research
Other
Outpatient Clinics, Hospital - organization & administration
Outpatient department
Patient Preference
Patient preferences
Patient Satisfaction
Patients
Scheduling
Stochastic Processes
Time Factors
Workflow
Patient preferences
Appointment scheduling
Markov decision process
Outpatient department
Adaptive dynamic programming
ISSN:0933-3657, 1873-2860, 1873-2860
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:•Both physician preference and time slot preference are considered.•A Markov decision process model is proposed to optimize scheduling appointment.•Adaptive dynamic programming algorithms are proposed to learn patient preferences. A well-developed appointment system can help increase the utilization of medical facilities in an outpatient department. This paper outlines the development of an appointment system that can make an outpatient department work more efficiently and improve patient satisfaction level. A Markov decision process model is proposed to schedule sequential appointments with the consideration of patient preferences in order to maximize the patient satisfaction level. Adaptive dynamic programming algorithms are developed to avoid the curse of dimensionality. These algorithms can dynamically capture patient preferences, update the value of being a state, and thus improve the appointment decisions. Experiments were conducted to investigate the performance of the algorithms. The convergence behaviors under different settings, including the number of iterations needed for convergence and the accuracy of results, were examined. Bias-adjusted Kalman filter step-sizes were found to lead to the best convergence behavior, which stabilized within 5000 iterations. As for the effects of exploration and exploitation, it resulted in the best convergence behavior when the probability of taking a myopically optimal action equaled 0.9. The performance of value function approximation algorithm was greatly affected by the combination of basis functions. Under different combinations, errors varied from 2.7% to 8.3%. More preferences resulted in faster convergence, but required longer computation time. System parameters are adaptively updated as bookings are confirmed. The proposed appointment scheduling system could certainly contribute to better patient satisfaction level during the booking periods.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0933-3657
1873-2860
1873-2860
DOI:10.1016/j.artmed.2014.12.002