Logo image
Extensions to Online Feature Selection Using Bagging and Boosting
Journal article   Open access

Extensions to Online Feature Selection Using Bagging and Boosting

Gregory Ditzler, Joseph LaBarck, James Ritchie, Gail Rosen and Robi Polikar
IEEE transaction on neural networks and learning systems, v 29(9), pp 4504-4509
Sep 2018
PMID: 29028210
url
https://doi.org/10.1109/tnnls.2017.2746107View
Accepted (AM)Open Access (Publisher-Specific) Open

Abstract

Bagging Data models Ensembles Feature extraction feature selection Learning systems Mathematical model online learning Prediction algorithms Predictive models
Feature subset selection can be used to sieve through large volumes of data and discover the most informative subset of variables for a particular learning problem. Yet, due to memory and other resource constraints (e.g., CPU availability), many of the state-of-the-art feature subset selection methods cannot be extended to high dimensional data, or data sets with an extremely large volume of instances. In this brief, we extend online feature selection (OFS), a recently introduced approach that uses partial feature information, by developing an ensemble of online linear models to make predictions. The OFS approach employs a linear model as the base classifier, which allows the l_{0} -norm of the parameter vector to be constrained to perform feature selection leading to sparse linear models. We demonstrate that the proposed ensemble model typically yields a smaller error rate than any single linear model, while maintaining the same level of sparsity and complexity at the time of testing.

Metrics

9 Record Views
28 citations in Scopus

Details

UN Sustainable Development Goals (SDGs)

This publication has contributed to the advancement of the following goals:

#3 Good Health and Well-Being

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Collaboration types
Domestic collaboration
Web of Science research areas
Computer Science, Artificial Intelligence
Computer Science, Hardware & Architecture
Computer Science, Theory & Methods
Engineering, Electrical & Electronic
Logo image