Bollegala, Danushka ORCID: 0000-0003-4476-7003
(2017)
Dynamic feature scaling for online learning of binary classifiers.
KNOWLEDGE-BASED SYSTEMS, 129.
pp. 97-105.
This is the latest version of this item.
Text
1407.7584v1.pdf - Author Accepted Manuscript Download (306kB) |
|
Text
1407.7584v1.pdf - Submitted version Download (306kB) |
Abstract
Scaling feature values is an important step in numerous machine learning tasks. Different features can have different value ranges and some form of a feature scaling is often required in order to learn an accurate classifier. However, feature scaling is conducted as a preprocessing task prior to learning. This is problematic in an online setting because of two reasons. First, it might not be possible to accurately determine the value range of a feature at the initial stages of learning when we have observed only a few number of training instances. Second, the distribution of data can change over the time, which render obsolete any feature scaling that we perform in a pre-processing step. We propose a simple but an effective method to dynamically scale features at train time, thereby quickly adapting to any changes in the data stream. We compare the proposed dynamic feature scaling method against more complex methods for estimating scaling parameters using several benchmark datasets for binary classification. Our proposed feature scaling method consistently outperforms more complex methods on all of the benchmark datasets and improves classification accuracy of a state-of-the-art online binary classifier algorithm.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Feature scaling, Online learning, Classification |
Depositing User: | Symplectic Admin |
Date Deposited: | 17 Apr 2018 06:30 |
Last Modified: | 19 Jan 2023 06:35 |
DOI: | 10.1016/j.knosys.2017.05.010 |
Related URLs: | |
URI: | https://livrepository.liverpool.ac.uk/id/eprint/3020234 |
Available Versions of this Item
-
Dynamic feature scaling for online learning of binary classifiers. (deposited 14 Jul 2017 10:10)
- Dynamic feature scaling for online learning of binary classifiers. (deposited 17 Apr 2018 06:30) [Currently Displayed]