
Decision Making in Multiagent Settings
Tutorial at AAMAS 2011, May 2 2011
The tutorial is a followup to one given
at AAMAS2010.

Description
Choosing optimally among different
lines of actions is a key aspect of
autonomy in agents. The process by
which an agent arrives at this choice
is complex, particularly in
environments shared with other agents.
Drawing motivation, in part, from
search and rescue applications in
disaster management, the tutorial will
span the range of multiagent
interactions of increasing generality,
and study a set of optimal and
approximate solution techniques to
timeextended decision making in both
noncooperative and cooperative
multiagent contexts. This
selfcontained tutorial will begin
with the relevant portions of game
theory and culminate with several
advanced decisiontheoretic models of
agent interactions.
The tutorial is aimed at graduate
students and researchers who want to
enter this emerging field or to better
understand recent results in this area
and their implications on the design
of multiagent systems. Participants
should have a basic knowledge of
probability theory, and preferably,
utility theory.

Outline
 Part I: Game theory, individual decision making and uncertainty
utilization in multiagent settings. Speakers: Doshi and Rabinovich.
 Search and Rescue Applications in Disaster Management
 Requirements for the multiagent decision model and solution
 Repeated strategic games of complete information
 Repeated Bayesian games
 Partially Observable Stochastic Games
 Interactive POMDPs (IPOMDPs)
 Uncertainty utilization
 Part II: Team decision
making. Speakers: Amato and Spaan.
 Multiagent decisiontheoretic
planning: introduction, related
work, examples.
 Models: DecPOMDP model,
complexity, special cases.
 Algorithms: optimal value
functions, dynamic programming,
JESP, GMAA*, MBDP,
infinitehorizon algoritms,
exploiting locality of
interaction, communication.
 Application problem domains and software tools.

Material




