Online feature extraction based on accelerated kernel principal component analysis for data stream
Kernel principal component analysis (KPCA) is known as a nonlinear feature extraction method. Takeuchi et al. have proposed an incremental type of KPCA (IKPCA) that can update an eigen-space incrementally for a sequence of data. However, in IKPCA, the eigenvalue decomposition should be carried out f...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer Berlin Heidelberg
2016
|
| Subjects: | |
| Online Access: | http://ir.unimas.my/id/eprint/11466/ http://ir.unimas.my/id/eprint/11466/1/Online%20feature%20extraction%20based%20on%20accelerated%20kernel%20principal%20%28abstract%29.pdf |
| _version_ | 1848837016161091584 |
|---|---|
| author | Annie, Joseph Takaomi, Tokumoto Seiichi, Ozawa |
| author_facet | Annie, Joseph Takaomi, Tokumoto Seiichi, Ozawa |
| author_sort | Annie, Joseph |
| building | UNIMAS Institutional Repository |
| collection | Online Access |
| description | Kernel principal component analysis (KPCA) is known as a nonlinear feature extraction method. Takeuchi et al. have proposed an incremental type of KPCA (IKPCA) that can update an eigen-space incrementally for a sequence of data. However, in IKPCA, the eigenvalue decomposition should be carried out for every single data, even though a chunk of data is given at one time. To reduce the computational costs in learning chunk data, this paper proposes an extended IKPCA called Chunk IKPCA (CIKPCA) where a chunk of multiple data is learned with single eigenvalue decomposition. For a large data chunk, to reduce further computation time and memory usage, it is first divided into several smaller chunks, and only useful data are selected based on the accumulation ratio. In the proposed CIKPCA, a small set of independent data are first selected from a reduced set of data so that eigenvectors in a high-dimensional feature space can be represented as a linear combination of such independent data. Then, the eigenvectors are incrementally updated by keeping only an eigenspace model that consists of the sextuplet such as independent data, coefficients, eigenvalues, and mean information. The proposed CIKPCA can augment an eigen-feature space based on the accumulation ratio that can also be updated without keeping all the past data, and the eigen-feature space is rotated by solving an eigenvalue problem once for each data chunk. The experiment results show that the learning time of the proposed CIKPCA is greatly reduced as compared with KPCA and IKPCA without sacrificing recognition accuracy. |
| first_indexed | 2025-11-15T06:32:57Z |
| format | Article |
| id | unimas-11466 |
| institution | Universiti Malaysia Sarawak |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T06:32:57Z |
| publishDate | 2016 |
| publisher | Springer Berlin Heidelberg |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | unimas-114662023-06-16T07:31:18Z http://ir.unimas.my/id/eprint/11466/ Online feature extraction based on accelerated kernel principal component analysis for data stream Annie, Joseph Takaomi, Tokumoto Seiichi, Ozawa L Education (General) T Technology (General) Kernel principal component analysis (KPCA) is known as a nonlinear feature extraction method. Takeuchi et al. have proposed an incremental type of KPCA (IKPCA) that can update an eigen-space incrementally for a sequence of data. However, in IKPCA, the eigenvalue decomposition should be carried out for every single data, even though a chunk of data is given at one time. To reduce the computational costs in learning chunk data, this paper proposes an extended IKPCA called Chunk IKPCA (CIKPCA) where a chunk of multiple data is learned with single eigenvalue decomposition. For a large data chunk, to reduce further computation time and memory usage, it is first divided into several smaller chunks, and only useful data are selected based on the accumulation ratio. In the proposed CIKPCA, a small set of independent data are first selected from a reduced set of data so that eigenvectors in a high-dimensional feature space can be represented as a linear combination of such independent data. Then, the eigenvectors are incrementally updated by keeping only an eigenspace model that consists of the sextuplet such as independent data, coefficients, eigenvalues, and mean information. The proposed CIKPCA can augment an eigen-feature space based on the accumulation ratio that can also be updated without keeping all the past data, and the eigen-feature space is rotated by solving an eigenvalue problem once for each data chunk. The experiment results show that the learning time of the proposed CIKPCA is greatly reduced as compared with KPCA and IKPCA without sacrificing recognition accuracy. Springer Berlin Heidelberg 2016 Article PeerReviewed text en http://ir.unimas.my/id/eprint/11466/1/Online%20feature%20extraction%20based%20on%20accelerated%20kernel%20principal%20%28abstract%29.pdf Annie, Joseph and Takaomi, Tokumoto and Seiichi, Ozawa (2016) Online feature extraction based on accelerated kernel principal component analysis for data stream. Evolving Systems, 7. pp. 15-27. ISSN 1868-6486 http://link.springer.com/article/10.1007%2Fs12530-015-9131-7 DOI 10.1007/s12530-015-9131-7 |
| spellingShingle | L Education (General) T Technology (General) Annie, Joseph Takaomi, Tokumoto Seiichi, Ozawa Online feature extraction based on accelerated kernel principal component analysis for data stream |
| title | Online feature extraction based on accelerated kernel principal component analysis for data stream |
| title_full | Online feature extraction based on accelerated kernel principal component analysis for data stream |
| title_fullStr | Online feature extraction based on accelerated kernel principal component analysis for data stream |
| title_full_unstemmed | Online feature extraction based on accelerated kernel principal component analysis for data stream |
| title_short | Online feature extraction based on accelerated kernel principal component analysis for data stream |
| title_sort | online feature extraction based on accelerated kernel principal component analysis for data stream |
| topic | L Education (General) T Technology (General) |
| url | http://ir.unimas.my/id/eprint/11466/ http://ir.unimas.my/id/eprint/11466/ http://ir.unimas.my/id/eprint/11466/ http://ir.unimas.my/id/eprint/11466/1/Online%20feature%20extraction%20based%20on%20accelerated%20kernel%20principal%20%28abstract%29.pdf |