Mutual information based input feature selection for classification problems

Cang, Shuang and Yu, Hongnian (2012) Mutual information based input feature selection for classification problems. Decision Support Systems, 54 (1). pp. 691-698. ISSN 0167-9236

Full text not available from this repository.

Abstract

The elimination process aims to reduce the size of the input feature set and at the same time to retain the class discriminatory information for classification problems. This paper investigates the approaches to solve classification problems of the feature selection and proposes a new feature selection algorithm using the mutual information (MI) concept in information theory for the classification problems. The proposed algorithm calculates the MI between the combinations of input features and the class instead of the MI between a single input feature and the class for both continuous-valued and discrete-valued features. Three experimental tests are conducted to evaluate the proposed algorithm. Comparison studies of the proposed algorithm with the previously published classification algorithms indicate that the proposed algorithm is robust, stable and efficient.

Item Type:	Article
Uncontrolled Keywords:	Feature ranking; Optimal feature set; Mutual information; Classification
Subjects:	G400 Computer Science G500 Information Systems
Department:	Faculties > Business and Law > Newcastle Business School
Depositing User:	Paul Burns
Date Deposited:	19 Dec 2018 16:49
Last Modified:	19 Nov 2019 09:51
URI:	http://nrl.northumbria.ac.uk/id/eprint/37374

Downloads