Publicação

Ensembles of jittered association rule classifiers

Ver documento

Detalhes bibliográficos
Resumo:The ensembling of classifiers tends to improve predictive accuracy. To obtain an ensemble with N classifiers, one typically needs to run N learning processes. In this paper we introduce and explore Model Jittering Ensembling, where one single model is perturbed in order to obtain variants that can be used as an ensemble. We use as base classifiers sets of classification association rules. The two methods of jittering ensembling we propose are Iterative Reordering Ensembling (IRE) and Post Bagging (PB). Both methods start by learning one rule set over a single run, and then produce multiple rule sets without relearning. Empirical results on 36 data sets are positive and show that both strategies tend to reduce error with respect to the single model association rule classifier. A bias–variance analysis reveals that while both IRE and PB are able to reduce the variance component of the error, IRE is particularly effective in reducing the bias component. We show that Model Jittering Ensembling can represent a very good speed-up w.r.t. multiple model learning ensembling. We also compare Model Jittering with various state of the art classifiers in terms of predictive accuracy and computational efficiency.
Autores principais:Azevedo, Paulo J.
Outros Autores:Jorge, Alípio M.
Assunto:Ensembles Associative classification Model jittering
Ano:2010
País:Portugal
Tipo de documento:artigo
Tipo de acesso:acesso aberto
Instituição associada:Universidade do Minho
Idioma:inglês
Origem:RepositóriUM - Universidade do Minho
_version_ 1877775822878670848
author Azevedo, Paulo J.
author2 Jorge, Alípio M.
author2_role author
author_facet Azevedo, Paulo J.
Jorge, Alípio M.
author_role author
contributor_name_str_mv RepositóriUM - Universidade do Minho
country_str PT
creators_json_txt [{\"Person.name\":\"Azevedo, Paulo J.\"},{\"Person.name\":\"Jorge, Alípio M.\"}]
datacite.contributors.contributor.contributorName.fl_str_mv RepositóriUM - Universidade do Minho
datacite.creators.creator.creatorName.fl_str_mv Azevedo, Paulo J.
Jorge, Alípio M.
datacite.date.Accepted.fl_str_mv 2010-01-01T00:00:00Z
datacite.rights.fl_str_mv http://purl.org/coar/access_right/c_abf2
datacite.subjects.subject.fl_str_mv Ensembles
Associative classification
Model jittering
datacite.titles.title.fl_str_mv Ensembles of jittered association rule classifiers
dc.contributor.none.fl_str_mv RepositóriUM - Universidade do Minho
dc.creator.none.fl_str_mv Azevedo, Paulo J.
Jorge, Alípio M.
dc.date.Accepted.fl_str_mv 2010-01-01T00:00:00Z
dc.format.none.fl_str_mv application/pdf
dc.identifier.none.fl_str_mv https://hdl.handle.net/1822/33800
dc.language.none.fl_str_mv eng
dc.publisher.none.fl_str_mv Springer
dc.rights.none.fl_str_mv http://purl.org/coar/access_right/c_abf2
dc.subject.none.fl_str_mv Ensembles
Associative classification
Model jittering
dc.title.fl_str_mv Ensembles of jittered association rule classifiers
dc.type.none.fl_str_mv http://purl.org/coar/resource_type/c_6501
description The ensembling of classifiers tends to improve predictive accuracy. To obtain an ensemble with N classifiers, one typically needs to run N learning processes. In this paper we introduce and explore Model Jittering Ensembling, where one single model is perturbed in order to obtain variants that can be used as an ensemble. We use as base classifiers sets of classification association rules. The two methods of jittering ensembling we propose are Iterative Reordering Ensembling (IRE) and Post Bagging (PB). Both methods start by learning one rule set over a single run, and then produce multiple rule sets without relearning. Empirical results on 36 data sets are positive and show that both strategies tend to reduce error with respect to the single model association rule classifier. A bias–variance analysis reveals that while both IRE and PB are able to reduce the variance component of the error, IRE is particularly effective in reducing the bias component. We show that Model Jittering Ensembling can represent a very good speed-up w.r.t. multiple model learning ensembling. We also compare Model Jittering with various state of the art classifiers in terms of predictive accuracy and computational efficiency.
dirty 0
eu_rights_str_mv openAccess
format article
id rum_5b874bbbc4fdd5f88db59c507a34dd32
identifier.url.fl_str_mv https://hdl.handle.net/1822/33800
inst_facet_str urn:organizationAcronym:repositorium{{{_:::_}}}Universidade do Minho
instacron_str repositorium
institution Universidade do Minho
instname_str Universidade do Minho
language eng
network_acronym_str rum
network_name_str RepositóriUM - Universidade do Minho
oai_identifier_str oai:repositorium.uminho.pt:1822/33800
organization_str_mv urn:organizationAcronym:repositorium
person_str_mv Azevedo, Paulo J.
Jorge, Alípio M.
publishDate 2010
publisher.none.fl_str_mv Springer
repo_facet_str urn:repositoryAcronym:rum{{{_:::_}}}RepositóriUM - Universidade do Minho
reponame_str RepositóriUM - Universidade do Minho
repository_id_str urn:repositoryAcronym:rum
service_str_mv urn:repositoryAcronym:rum
spelling engSpringerporThe ensembling of classifiers tends to improve predictive accuracy. To obtain an ensemble with N classifiers, one typically needs to run N learning processes. In this paper we introduce and explore Model Jittering Ensembling, where one single model is perturbed in order to obtain variants that can be used as an ensemble. We use as base classifiers sets of classification association rules. The two methods of jittering ensembling we propose are Iterative Reordering Ensembling (IRE) and Post Bagging (PB). Both methods start by learning one rule set over a single run, and then produce multiple rule sets without relearning. Empirical results on 36 data sets are positive and show that both strategies tend to reduce error with respect to the single model association rule classifier. A bias–variance analysis reveals that while both IRE and PB are able to reduce the variance component of the error, IRE is particularly effective in reducing the bias component. We show that Model Jittering Ensembling can represent a very good speed-up w.r.t. multiple model learning ensembling. We also compare Model Jittering with various state of the art classifiers in terms of predictive accuracy and computational efficiency.application/pdfporEnsembles of jittered association rule classifiersAzevedo, Paulo J.Jorge, Alípio M.HostingInstitutionOrganizationalRepositóriUM - Universidade do Minhoe-mailmailto:repositorium@usdb.uminho.ptrepositorium@usdb.uminho.ptISSNIsPartOf1384-5810DOIIsPartOf10.1007/s10618-010-0173-y20102010-01-01T00:00:00ZHandlehttps://hdl.handle.net/1822/33800http://purl.org/coar/access_right/c_abf2open accessEnsemblesAssociative classificationModel jittering382953 bytesliteraturehttp://purl.org/coar/resource_type/c_6501journal articlehttp://purl.org/coar/access_right/c_abf2application/pdfhttps://repositorium.uminho.pt/bitstreams/91e5927d-2e57-407d-88a7-07ab0a6aa89f/download
spellingShingle Ensembles of jittered association rule classifiers
Azevedo, Paulo J.
Ensembles
Associative classification
Model jittering
status SINGLETON
subject.fl_str_mv Ensembles
Associative classification
Model jittering
title Ensembles of jittered association rule classifiers
title_full Ensembles of jittered association rule classifiers
title_fullStr Ensembles of jittered association rule classifiers
title_full_unstemmed Ensembles of jittered association rule classifiers
title_short Ensembles of jittered association rule classifiers
title_sort Ensembles of jittered association rule classifiers
topic Ensembles
Associative classification
Model jittering
topic_facet Ensembles
Associative classification
Model jittering
url https://hdl.handle.net/1822/33800
visible 1

Atividades financiadas

Não foram encontrados projetos financiados.