• Complex
  • Title
  • Author
  • Keyword
  • Abstract
  • Scholars
Search

Author:

Chen Liangjun (Chen Liangjun.) | Honeine, Paul (Honeine, Paul.) | Hua, Qu (Hua, Qu.) | Zhao Jihong (Zhao Jihong.) | Xia, Sun (Xia, Sun.)

Indexed by:

SCIE EI Scopus

Abstract:

In extreme learning machines (ELM), the hidden node parameters are randomly generated and the output weights can be analytically computed. To overcome the bad feature extraction ability of the shallow architecture of ELM, the hierarchical ELM has been extensively studied as a deep architecture with multilayer neural network. However, the commonly used mean square error (MSE) criterion is very sensitive to outliers and impulsive noises, generally existing in real world data. In this paper, we investigate the correntropy to improve the robustness of the multilayer ELM and provide sparser representation. The correntropy, as a nonlinear measure of similarity, is robust to outliers and can approximate different norms (from l(0) to l(2)). A new full correntropy based multilayer extreme learning machine (FC-MELM) algorithm is proposed to handle the classification of datasets which are corrupted by impulsive noises or outliers. The contributions of this paper are three-folds: (1) The MSE based reconstruction loss is replaced by the correntropy based loss function; In this way, the robustness of the ELM based multilayer algorithms is enhanced. (2) The traditional l(1)-based sparsity penalty term is also replaced by a correntropy-based sparsity penalty term, which can further improve the performance of the proposed algorithm with a sparser representation of the data. The combination of (1) and (2) provides the correntropy-based ELM autoencoder. (3) The FC-MELM is proposed by using the correntropy-based ELM autoencoder as a building block. It is notable that the FC-MELM is trained in a forward manner, which means fine-tuning procedure is not required. Thus, the FC-MELM has great advantage in learning efficiently when compared with traditional deep learning algorithms. The good property of the proposed algorithm is confirmed by the experiments on well-known benchmark datasets, including the MNIST datasets, the NYU Object Recognition Benchmark dataset, and the Moore network traffic dataset. Finally, the proposed FC-MELM algorithm is applied to address Computer Aided Cancer Diagnosis. Experiments conducted on the well-known Wisconsin Breast Cancer Data (Diagnostic) dataset are presented and show that the proposed FC-MELM outperforms state-of-the-art methods in solving computer aided cancer diagnosis problems. (C) 2018 Elsevier Ltd. All rights reserved.

Keyword:

Computer aided cancer diagnosis Correntropy Deep learning Extreme learning machine Unsupervised feature learning

Author Community:

  • [ 1 ] [Chen Liangjun; Hua, Qu; Zhao Jihong] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
  • [ 2 ] [Honeine, Paul] Univ Rouen Normandie, LITIS Lab, F-76800 St Etienne Du Rouvray, France
  • [ 3 ] [Zhao Jihong] Xian Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Xian 710061, Shaanxi, Peoples R China
  • [ 4 ] [Xia, Sun] Northwest Univ, Sch Informat Sci & Technol, Xian 710069, Shaanxi, Peoples R China
  • [ 5 ] [Chen Liangjun]Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
  • [ 6 ] [Hua, Qu]Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
  • [ 7 ] [Zhao Jihong]Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
  • [ 8 ] [Honeine, Paul]Univ Rouen Normandie, LITIS Lab, F-76800 St Etienne Du Rouvray, France
  • [ 9 ] [Zhao Jihong]Xian Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Xian 710061, Shaanxi, Peoples R China
  • [ 10 ] [Xia, Sun]Northwest Univ, Sch Informat Sci & Technol, Xian 710069, Shaanxi, Peoples R China

Reprint Author's Address:

  • Northwest Univ, Sch Informat Sci & Technol, Xian 710069, Shaanxi, Peoples R China.

Show more details

Related Keywords:

Source :

PATTERN RECOGNITION

ISSN: 0031-3203

Year: 2018

Volume: 84

Page: 357-370

5 . 8 9 8

JCR@2018

7 . 7 4 0

JCR@2020

ESI Discipline: ENGINEERING;

ESI HC Threshold:108

JCR Journal Grade:2

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count: 19

SCOPUS Cited Count: 38

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 8

FAQ| About| Online/Total:653/168643930
Address:XI'AN JIAOTONG UNIVERSITY LIBRARY(No.28, Xianning West Road, Xi'an, Shaanxi Post Code:710049) Contact Us:029-82667865
Copyright:XI'AN JIAOTONG UNIVERSITY LIBRARY Technical Support:Beijing Aegean Software Co., Ltd.