Elitist and ensemble strategies for cascade generalization

Huimin Zhao, Atish P. Sinha, Sudha Ram

Research output: Contribution to journalArticlepeer-review

1 Scopus citations


Several methods have been proposed for cascading other classification algorithms with decision tree learners to alleviate the representational bias of decision trees and, potentially, to improve classification accuracy. Such cascade generalization of decision trees increases the flexibility of the decision boundaries between classes and promotes better fitting of the training data. However, more flexible models may not necessarily lead to more predictive power. Because of potential overfitting problems, the true classification accuracy on test data may not increase. Recently, a generic method for cascade generalization has been proposed. The method uses a parameter - the maximum cascading depth - to constrain the degree that other classification algorithms are cascaded with decision tree learners. A method for efficiently learning a collection (i. e., a forest) of generalized decision trees, each with other classification algorithms cascaded to a particular depth, also has been developed In this article, we propose several new strategies, including elitist and ensemble (weighted or unweighted), for using the various decision trees in such a collection in the prediction phase. Our empirical evaluation using 32 data sets in the UCI machine learning repository shows that, on average, the elitist strategy outperforms the weighted full ensemble strategy, which, in turn, outperforms the unweighted full ensemble strategy. However, no strategy is universally superior across all applications. Since the same training process can be used to evaluate the various strategies, we recommend that several promising strategies be evaluated and compared before selecting the one to use for a given application.

Original languageEnglish (US)
Pages (from-to)92-107
Number of pages16
JournalJournal of Database Management
Issue number3
StatePublished - 2006


  • Cascade generalization
  • Data mining
  • Decision tree
  • Elitist strategy
  • Ensemble method
  • Voting method

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture


Dive into the research topics of 'Elitist and ensemble strategies for cascade generalization'. Together they form a unique fingerprint.

Cite this