Publications

| Sorted by Date | Classified by Publication Type | Classified by Research Category |

A Bayesian Game based Adaptive Fuzzy Controller for Multiagent POMDPs

Rajneesh Sharma and Matthijs T. J. Spaan. A Bayesian Game based Adaptive Fuzzy Controller for Multiagent POMDPs. In Proc. of IEEE Int. Conf. on Fuzzy Systems, 2010.

Download

pdf [966.1kB]  

Abstract

This paper develops a novel fuzzy reinforcement learning (RL) based controller for multiagent partially observable Markov decision processes (POMDPs) modeled as a sequence of Bayesian games. Multiagent POMDPs have emerged as a powerful framework for modeling and optimizing multiagent sequential decision making problems under uncertainty, but finding optimal policies is computationally very challenging. Our aim here is twin fold, (i) introduction of a learning paradigm in infinite horizon multiagent POMDPs and (ii) scaling up multiagent POMDP solution approaches by introduction of fuzzy inference systems (FIS) based generalization. We introduce what may be called fuzzy multiagent POMDPs to overcome space and time complexity issues involved in finding optimal policies for multiagent POMDPs. The proposed FIS based RL controller approximates optimal policies for multiagent POMDPs modeled as a sequence of Bayesian games. We empirically evaluate the proposed fuzzy multiagent POMDP controller on the standard benchmark multiagent tiger problem and compare its performance against other state-of-the-art multiagent POMDP solution approaches. Results showcase the effectiveness of the proposed approach and validate the feasibility of employing Bayesian game based RL (in conjunction with FIS approximation) for addressing the intractability of multiagent POMDPs.

BibTeX Entry

@InProceedings{Sharma10fuzz,
  author =       {Rajneesh Sharma and Matthijs T. J. Spaan},
  title =        {A {B}ayesian Game based Adaptive Fuzzy Controller
                  for Multiagent {POMDPs}},
  booktitle =    {Proc. of IEEE Int. Conf. on Fuzzy Systems},
  year =         2010
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Tue Sep 06, 2011 11:22:28 UTC