Logistic ensembles for random spherical linear oracles

Leif E. Peterson, Matthew A Coleman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A random spherical linear oracle (RSLO) ensemble classifier for DNA microarray gene expression data is proposed. The oracle assigns different training(testing) samples to 2 sub-classifiers of the same type using hyperplane splits in order to increase the diversity of voting results since errors are not shared across sub-classifiers. Eleven classifiers were evaluated for performance as the base classifier including k nearest neighbor (kNN), naïve Bayes classifier (NBC), linear discriminant analysis (LDA), learning vector quantization (LVQ1), polytomous logistic regression (PLOG), artificial neural networks (ANN), constricted particle swarm optimization (CPSO), kernel regression (KREG), radial basis function networks (RBFN), gradient descent support vector machines (SVMGD), and least squares support vector machines (SVMLS). Logistic ensembles (PLOG) resulted in the best performance when used as a base classifier for RSLO. Random hyperplane splits used in RSLO resulted in degeneration of performance at the greatest levels of CV-fold and iteration number when compared with hyperplane splits in principal direction linear oracle (PDLO), which increased with increasing CV-fold and iteration number.

Original languageEnglish (US)
Title of host publicationProceedings - 6th International Conference on Machine Learning and Applications, ICMLA 2007
Pages618-623
Number of pages6
DOIs
Publication statusPublished - 2007
Externally publishedYes
Event6th International Conference on Machine Learning and Applications, ICMLA 2007 - Cincinnati, OH, United States
Duration: Dec 13 2007Dec 15 2007

Other

Other6th International Conference on Machine Learning and Applications, ICMLA 2007
CountryUnited States
CityCincinnati, OH
Period12/13/0712/15/07

    Fingerprint

ASJC Scopus subject areas

  • Computer Science Applications
  • Human-Computer Interaction
  • Control and Systems Engineering

Cite this

Peterson, L. E., & Coleman, M. A. (2007). Logistic ensembles for random spherical linear oracles. In Proceedings - 6th International Conference on Machine Learning and Applications, ICMLA 2007 (pp. 618-623). [4457298] https://doi.org/10.1109/ICMLA.2007.67