Abstract
We focus on multi-dimensional classification (MDC) problems with conditional dependence, which we call multiple output dependence (MOD) problems. MDC is the task of predicting a vector of categorical outputs for each input. Conditional dependence in MDC means that the choice for one output value affects the choice for others, so it is not desirable to predict outputs independently. We show that conditional dependence in MDC implies that a single input can map to multiple correct output vectors. This means it is desirable to find multiple correct output vectors per input. Current solutions for MOD problems are not sufficient because they predict only one of the correct output vectors per input, ignoring all others.We modify four existing MDC solutions, including chain classifiers, to predict multiple output vectors. We further create a novel ensemble technique named weighted output vector ensemble (WOVE) which combines these multiple predictions from multiple chain classifiers in a way that preserves the integrity of output vectors and thus preserves conditional dependence among outputs. We verify the effectiveness of WOVE by comparing it against 7 other solutions on a variety of data sets and find that it shows significant gains over existing methods.
Degree
MS
College and Department
Physical and Mathematical Sciences; Computer Science
Rights
http://lib.byu.edu/about/copyright/
BYU ScholarsArchive Citation
Heydorn, Joseph Ethan, "An Improved Classifier Chain Ensemble for Multi-DimensionalClassification with Conditional Dependence" (2015). Theses and Dissertations. 5515.
https://scholarsarchive.byu.edu/etd/5515
Date Submitted
2015-07-01
Document Type
Thesis
Handle
http://hdl.lib.byu.edu/1877/etd8659
Keywords
multi-dimensional classification, multi-target, conditional dependence, ensemble, chain classifier
Language
english