A Fuzzy Mutual Information-based Feature Selection Method for Classification

Research paper by N. Hoque, H.A. Ahmed; D.K. Bhattacharyya; J.K. Kalita

Indexed on: 10 Jan '17Published on: 21 Dec '16Published in: Fuzzy Information and Engineering


Publication date: September 2016 Source:Fuzzy Information and Engineering, Volume 8, Issue 3 Author(s): N. Hoque, H.A. Ahmed, D.K. Bhattacharyya, J.K. Kalita In this paper, we present a feature selection method called Fuzzy Mutual Information-based Feature Selection with Non-Dominated solution (FMIFS-ND) using a fuzzy mutual information measure which selects features based on feature-class fuzzy mutual information and feature-feature fuzzy mutual information. To evaluate classification accuracy of the proposed method, a modification of the k -nearest neighbor (KNN) classifier is also presented in this paper to classify instances based on the distance or similarity between individual features. The performance of both methods is evaluated on multiple UCI datasets by using four classifiers. We compare the accuracy of our feature selection method with existing feature selection methods and validate accuracy of the proposed classifier with decision trees, random forests, naive Bayes, KNN and support vector machines (SVM). Experimental results show that the feature selection method gives high classification accuracy in most high dimensional datasets as well as the accuracy of proposed classifiers outperforms the traditional KNN classifier.