Conference proceeding
Domain adaptation bounds for multiple expert systems under concept drift
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Conference Proceedings, 595
01 Jul 2014
Abstract
Conference Title: 2014 International Joint Conference on Neural Networks (IJCNN) Conference Start Date: 2014, July 6 Conference End Date: 2014, July 11 Conference Location: Beijing, China The ability to learn incrementally from streaming data -- either in an online or batch setting -- is of crucial importance for a prediction algorithm to learn from environments that generate vast amounts of data, where it is impractical or simply unfeasible to store all historical data. On the other hand, learning from streaming data becomes increasingly difficult when the probability distribution generating the data stream evolves over time, which renders the classification model generated from previously seen data suboptimal or potentially useless. Ensemble systems that employ multiple classifiers may be used to mitigate this effect, but even in such cases some classifiers (experts) become less knowledgeable for predicting on different domains than others as the distribution drifts. Further complication results when labeled data from a prediction (target) domain is not immediately available; hence, causing prediction on the target domain to yield sub-optimal results. In this work, we provide upper bounds on the loss, which hold with high probability, of a multiple expert system trained in such a nonstationary environment with verification latency. Furthermore, we show why a single model selection strategy can lead to undesirable results when learning in such nonstationary streaming settings. We present our analytical results with experiments on simulated as well as real-world data sets, comparing several different ensemble approaches to a single model. [PUBLICATION ABSTRACT]
Metrics
9 Record Views
Details
- Title
- Domain adaptation bounds for multiple expert systems under concept drift
- Creators
- Gregory DitzlerGail RosenRobi Polikar
- Publication Details
- The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Conference Proceedings, 595
- Publisher
- The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Electrical and Computer Engineering
- Identifiers
- 991019170571704721