Author

Contributions

  • Hartley, R. - Contributor
  • Lavercombe, A. C. - Contributor
  • Naval Postgraduate School (U.S.) - Contributor

Publication

1982 - Naval Postgraduate School, Monterey, Calif, California

Language

English

Word Count

2,500 words, Guess

Page Count

10 pages

Identifiers

Alternate Titles

  • NPS-55-82-034.

Description

This note describes the results of a computational comparison of value iteration algorithms suggested for solving finite state discounted Markov decision processes. Such a process visits a set of states S = (1,2,...M). In Section two we describe the schemes examined and the various bounds that can be used for stopping them. Section three concentrates on one scheme that did well in the comparison - ordinary value iteration - and looks at various methods for eliminating non-optimal actions both permanently and temporarily.

Subjects

Reader Reviews

No reviews yet for this book.

Be the first to share your thoughts!