A value equivalence approach for solving interactive dynamic influence diagrams
Conroy, Ross, Zeng, Yifeng, Cavazza, Marc ORCID: 0000-0001-6113-9696, Tang, Jing and Pan, Yinghui (2016) A value equivalence approach for solving interactive dynamic influence diagrams. In: Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems (AAMAS '16). ACM, Singapore, pp. 1162-1170. ISBN 978-1-4503-4239-1
|
PDF (Publisher's PDF)
19797 CAVAZZA_A_Value_Equivalence_Approach_2016.pdf - Published Version Available under License Creative Commons Attribution Share Alike. Download (431kB) | Preview |
Abstract
Interactive dynamic influence diagrams (I-DIDs) are recognized graphical models for sequential multiagent decision making under uncertainty. They represent the problem of how a subject agent acts in a common setting shared with other agents who may act in sophisticated ways. The difficulty in solving I-DIDs is mainly due to an exponentially growing space of candidate models ascribed to other agents over time. in order to minimize the model space, the previous I-DID techniques prune behaviorally equivalent models. In this paper, we challenge the minimal set of models and propose a value equivalence approach to further compress the model space. The new method reduces the space by additionally pruning behaviourally distinct models that result in the same expected value of the subject agent’s optimal policy. To achieve this, we propose to learn the value from available data particularly in practical applications of real-time strategy games. We demonstrate the performance of the new technique in two problem domains.
Item Type: | Conference Proceedings |
---|---|
Title of Proceedings: | Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems (AAMAS '16) |
Additional Information: | Conference held from 09-13 May, 2016. |
Uncontrolled Keywords: | Influence Diagrams, Decision Making, Multiple Agents |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Faculty / School / Research Centre / Research Group: | Faculty of Engineering & Science > School of Computing & Mathematical Sciences (CMS) Faculty of Engineering & Science |
Last Modified: | 04 Mar 2022 13:07 |
URI: | http://gala.gre.ac.uk/id/eprint/19797 |
Actions (login required)
View Item |
Downloads
Downloads per month over past year