Rényi entropy and cauchy-schwartz mutual information applied to mifs-u variable selection algorithm: a comparative study

This paper approaches the algorithm of selection of variables named MIFS-U and presents an alternative method for estimating entropy and mutual information, "measures" that constitute the base of this selection algorithm. This method has, for foundation, the Cauchy-Schwartz quadratic mutual information and the Rényi quadratic entropy, combined, in the case of continuous variables, with Parzen Window density estimation. Experiments were accomplished with public domain data, being such method compared with the original MIFS-U algorithm, broadly used, that adopts the Shannon entropy definition and makes use, in the case of continuous variables, of the histogram density estimator. The results show small variations between the two methods, what suggest a future investigation using a classifier, such as Neural Networks, to qualitatively evaluate these results, in the light of the final objective which is greater accuracy of classification.

Bibliographic Details

Main Authors:	Gonçalves,Leonardo Barroso, Macrini,José Leonardo Ribeiro
Format:	Digital revista
Language:	English
Published:	Sociedade Brasileira de Pesquisa Operacional 2011
Online Access:	http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-74382011000300006
Tags:	Add Tag No Tags, Be the first to tag this record!