Toward data-driven solutions to interactive dynamic influence diagrams

Pan, Yinghui, Tang, Jing, Ma, Biyang, Zeng, Yifeng and Ming, Zhong (2021) Toward data-driven solutions to interactive dynamic influence diagrams. Knowledge and Information Systems, 63 (9). pp. 2431-2453. ISSN 0219-1377

s10115-021-01600-5.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (1MB) | Preview
story.pdf - Accepted Version

Download (1MB) | Preview
Official URL:


With the availability of significant amount of data, data-driven decision making becomes an alternative way for solving complex multiagent decision problems. Instead of using domain knowledge to explicitly build decision models, the data-driven approach learns decisions (probably optimal ones) from available data. This removes the knowledge bottleneck in the traditional knowledge-driven decision making, which requires a strong support from domain experts. In this paper, we study data-driven decision making in the context of interactive dynamic influence diagrams (I-DIDs)—a general framework for multiagent sequential decision making under uncertainty. We propose a data-driven framework to solve the I-DIDs model and focus on learning the behavior of other agents in problem domains. The challenge is on learning a complete policy tree that will be embedded in the I-DIDs models due to limited data. We propose two new methods to develop complete policy trees for the other agents in the I-DIDs. The first method uses a simple clustering process, while the second one employs sophisticated statistical checks. We analyze the proposed algorithms in a theoretical way and experiment them over two problem domains.

Item Type: Article
Additional Information: Funding information: This work is supported in part by the National Natural Science Foundation of China (Grants Nos. 61772442 and 61836005). Both Biyang and Yifeng are partially supported by the EPSRC project (Grant No. EP/S011609/1).
Uncontrolled Keywords: Data-driven, I-DIDs, multiagent sequential decision
Subjects: G900 Others in Mathematical and Computing Sciences
N100 Business studies
Department: Faculties > Business and Law > Newcastle Business School
Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: John Coen
Date Deposited: 02 Jul 2021 10:09
Last Modified: 08 Aug 2022 03:31

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics