Decision Making in Multiagent Settings

Tutorial at AAMAS 2011, May 2 2011

The tutorial is a follow-up to one given at AAMAS2010.


Choosing optimally among different lines of actions is a key aspect of autonomy in agents. The process by which an agent arrives at this choice is complex, particularly in environments shared with other agents. Drawing motivation, in part, from search and rescue applications in disaster management, the tutorial will span the range of multiagent interactions of increasing generality, and study a set of optimal and approximate solution techniques to time-extended decision making in both noncooperative and cooperative multiagent contexts. This self-contained tutorial will begin with the relevant portions of game theory and culminate with several advanced decision-theoretic models of agent interactions.

The tutorial is aimed at graduate students and researchers who want to enter this emerging field or to better understand recent results in this area and their implications on the design of multi-agent systems. Participants should have a basic knowledge of probability theory, and preferably, utility theory.


  • Part I: Game theory, individual decision making and uncertainty utilization in multiagent settings. Speakers: Doshi and Rabinovich.
    • Search and Rescue Applications in Disaster Management
    • Requirements for the multiagent decision model and solution
    • Repeated strategic games of complete information
    • Repeated Bayesian games
    • Partially Observable Stochastic Games
    • Interactive POMDPs (I-POMDPs)
    • Uncertainty utilization
  • Part II: Team decision making. Speakers: Amato and Spaan.
    • Multiagent decision-theoretic planning: introduction, related work, examples.
    • Models: Dec-POMDP model, complexity, special cases.
    • Algorithms: optimal value functions, dynamic programming, JESP, GMAA*, MBDP, infinite-horizon algoritms, exploiting locality of interaction, communication.
    • Application problem domains and software tools.