Rényi entropy and cauchy-schwartz mutual information applied to mifs-u variable selection algorithm: a comparative study
This paper approaches the algorithm of selection of variables named MIFS-U and presents an alternative method for estimating entropy and mutual information, "measures" that constitute the base of this selection algorithm. This method has, for foundation, the Cauchy-Schwartz quadratic mutual information and the Rényi quadratic entropy, combined, in the case of continuous variables, with Parzen Window density estimation. Experiments were accomplished with public domain data, being such method compared with the original MIFS-U algorithm, broadly used, that adopts the Shannon entropy definition and makes use, in the case of continuous variables, of the histogram density estimator. The results show small variations between the two methods, what suggest a future investigation using a classifier, such as Neural Networks, to qualitatively evaluate these results, in the light of the final objective which is greater accuracy of classification.
Main Authors: | Gonçalves,Leonardo Barroso, Macrini,José Leonardo Ribeiro |
---|---|
Format: | Digital revista |
Language: | English |
Published: |
Sociedade Brasileira de Pesquisa Operacional
2011
|
Online Access: | http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-74382011000300006 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
-
Adaptive Algorithm Based on Renyi’s Entropy for Task Mapping in a Hierarchical Wireless Network-on-Chip Architecture
by: Sacanamboy,Maribell, et al.
Published: (2018) -
Genes that encodes NAGT, MIF1 and MIF2 are not virulence factors for kala-azar caused by Leishmania infantum
by: Aguiar,Bruno Guedes Alcoforado, et al.
Published: (2014) -
Study of the relationship between human MIF level, MIF-794CATT5-8 microsatellite polymorphism, and susceptibility of tuberculosis in southwest China
by: Li,Yanlin, et al.
Published: (2012) -
Renyi Diversity Profiles with vegan, BiodiversityR and ggplot2
by: Kindt, R.
Published: (2020-11-21) - Schwartz, Andy