%0 Journal Article
%J Journal of Machine Learning Research
%D 2015
%T PAC Optimal MDP Planning with Application to Invasive Species Management
%A Taleghan, Majid Alkaee
%A Dietterich, Thomas G.
%A Crowley, Mark
%A Hall, Kim
%A Albers, H. Jo
%K computational sustainability
%K Good- Turing estimate
%K grant-wici16
%K invasive species management
%K machine learning
%K Markov decision processes
%K MDP planning
%K optimization
%K reinforcement learning
%X In a simulator-defined MDP, the Markovian dynamics and rewards are provided in the form of a simulator from which samples can be drawn. This paper studies MDP planning algorithms that attempt to minimize the number of simulator calls before terminating and outputting a policy that is approximately optimal with high probability. The paper introduces two heuristics for efficient exploration and an improved confidence interval that enables earlier termination with probabilis- tic guarantees. We prove that the heuristics and the confidence interval are sound and produce with high probability an approximately optimal policy in polynomial time. Experiments on two benchmark problems and two instances of an invasive species management problem show that the improved confidence intervals and the new search heuristics yield reductions of between 8% and 47% in the number of simulator calls required to reach near-optimal policies.
%B Journal of Machine Learning Research
%V 16
%P 3877–3903
%G eng
%U http://jmlr.org/papers/v16/taleghan15a.html