Thorsten Belker, Michael Beetz and Armin B. Cremers

Learning Action Models for the Improved Execution of Navigation Plans

Robotics and Autonomous Systems

---

Abstract

Most state-of-the-art navigation systems for autonomous service robots decompose navigation into global navigation planning and local reactive navigation. While the methods for navigation planning and local navigation themselves are well understood, the plan execution problem, the problem of how to generate and parameterize local navigation tasks from a given navigation plan, is largely unsolved.

This article describes how a robot can autonomously learn to execute navigation plans. We formalize the problem as a Markov Decision Process (MDP) and derive a decision theoretic action selection function from it. The action selection function employs models of the robot's navigation actions, which are autonomously acquired from experience using neural network or regression tree learning algorithms. We show, both in simulation and on a RWI B21 mobile robot, that the learned models together with the derived action selection function achieve competent navigation behavior.

---

Bibtex

@Article{Belker02RAS,
  author =       {T. Belker and M. Beetz and A.B. Cremers},
  title =        {Learning Action Models for the Improved Execution of Navigation Plans},
  journal =      {Robotics and Autonomous Systems},
  year =         {2002},
  OPTkey =       {},
  volume =       {38},
  number =       {3-4},
  pages =        {137-148},
  OPTmonth =     {},
  OPTnote =      {},
  OPTannote =    {}
}