The Skyline algorithm for POMDP value function pruning

Christopher Raphael, Guy Shani

Research output: Contribution to journalArticlepeer-review

Abstract

We address the pruning or filtering problem, encountered in exact value iteration in POMDPs and elsewhere, in which a collection of linear functions is reduced to the minimal subset retaining the same maximal surface. We introduce the Skyline algorithm, which traces the graph corresponding to the maximal surface. The algorithm has both a complete and an iterative version, which we present, along with the classical Lark's algorithm, in terms of the basic dictionary-based simplex iteration from linear programming. We discuss computational complexity results, and present comparative experiments on both randomly-generated and well-known POMDP benchmarks.

Original languageAmerican English
Pages (from-to)61-77
Number of pages17
JournalAnnals of Mathematics and Artificial Intelligence
Volume65
Issue number1
DOIs
StatePublished - 1 May 2012

Keywords

  • Dynamic programming
  • Linear programming
  • POMDP

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'The Skyline algorithm for POMDP value function pruning'. Together they form a unique fingerprint.

Cite this