hrvatski jezikClear Cookie - decide language by browser settings

Ensemble-based noise detection: noise ranking and visual performance evaluation

Sluban, Borut; Gamberger, Dragan; Lavrač, Nada (2014) Ensemble-based noise detection: noise ranking and visual performance evaluation. Data mining and knowledge discovery, 28 (2). pp. 265-303. ISSN 1384-5810

| Request a personal copy from author

Abstract

Noise filtering is most frequently used in data preprocessing to improve the accuracy of induced classifiers. The focus of this work is different: we aim at detecting noisy instances for improved data understanding, data cleaning and outlier identification. The paper is composed of three parts. The first part presents an ensemble-based noise ranking methodology for explicit noise and outlier identification, named Noise- Rank, which was successfully applied to a real- life medical problem as proven in domain expert evaluation. The second part is concerned with quantitative performance evaluation of noise detection algorithms on data with randomly injected noise. A methodology for visual performance evaluation of noise detection algorithms in the precision-recall space, named Viper, is presented and compared to standard evaluation practice. The third part presents the implementation of the NoiseRank and Viper methodologies in a web-based platform for composition and execution of data mining workflows. This implementation allows public accessibility of the developed approaches, repeatability and sharing of the presented experiments as well as the inclusion of web services enabling to incorporate new noise detection algorithms into the proposed noise detection and performance evaluation workflows.

Item Type: Article
Uncontrolled Keywords: noise detection; ensembles; noise ranking; precision-recall evaluation
Subjects: TECHNICAL SCIENCES > Computing
TECHNICAL SCIENCES > Computing > Artificial Intelligence
Divisions: Division of Electronics
Projects:
Project titleProject leaderProject codeProject type
Machine learning algorithms and their application (Algoritmi strojnog učenja i njihova primjena)-Dragan Gamberger098-0982560-2563MZOS
Depositing User: Dragan Gamberger
Date Deposited: 01 Feb 2016 16:44
Last Modified: 01 Feb 2016 16:44
URI: http://fulir.irb.hr/id/eprint/2444
DOI: 10.1007/s10618-012-0299-1

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year