Group sparse optimization for learning predictive state representations

Zeng, Yifeng, Ma, Biyang, Chen, Bilian, Tang, Jing and He, Mengda (2017) Group sparse optimization for learning predictive state representations. Information Sciences, 412413. pp. 1-13. ISSN 0020-0255

R4_Information_Sciences_Group_Sparse_Optimization_for_Learning_Predictive_State_Representations.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0.

Download (877kB) | Preview
Official URL:


Predictive state representations (PSRs) are a commonly used approach for agents to summarize the information from history generated during their interaction with a dynamical environment and the agents may use PSRs to predict the future observation. Existing works have shown the benefits of PSRs for modelling partially observable dynamical systems. One of the key issues in PSRs is to discover a set of tests for representing states, which is called core tests. However, there is no very efficient technique to find the core tests for a large and complex problem in practice. In this paper, we formulate the discovering of the set of core tests as an optimization problem and exploit a group sparsity of the decision-making matrix to solve the problem. Then the PSR parameters can be obtained simultaneously. Hence, the model of the underlying system can be built immediately. The new learning approach doesn’t require the specification of the number of core tests. Furthermore, the embedded optimization method for solving the considered group Lasso problem, called alternating direction method of multipliers (ADMM), can achieve a global convergence. We conduct experiments on three problem domains including one extremely large problem domain and show promising performances of the new approach.

Item Type: Article
Uncontrolled Keywords: Predictive state representations, Group sparse, Alternating direction method of multipliers
Subjects: G400 Computer Science
G500 Information Systems
Department: Faculties > Business and Law > Newcastle Business School
Depositing User: Rachel Branson
Date Deposited: 26 Oct 2020 14:44
Last Modified: 13 Aug 2021 13:25

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics