Group sparse autoencoder

Unsupervised feature extraction is gaining a lot of research attention following its success to represent any kind of noisy data. Owing to the presence of a lot of training parameters, these feature learning models are prone to overfitting. Different regularization methods have been explored in the...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Image and vision computing Ročník 60; s. 64 - 74
Hlavní autori: Sankaran, Anush, Vatsa, Mayank, Singh, Richa, Majumdar, Angshul
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Elsevier B.V 01.04.2017
Predmet:
ISSN:0262-8856, 1872-8138
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Unsupervised feature extraction is gaining a lot of research attention following its success to represent any kind of noisy data. Owing to the presence of a lot of training parameters, these feature learning models are prone to overfitting. Different regularization methods have been explored in the literature to avoid overfitting in deep learning models. In this research, we consider autoencoder as the feature learning architecture and propose ℓ2,1-norm based regularization to improve its learning capacity, called as Group Sparse AutoEncoder (GSAE). ℓ2,1-norm is based on the postulate that the features from the same class will have a common sparsity pattern in the feature space. We present the learning algorithm for group sparse encoding using majorization–minimization approach. The performance of the proposed algorithm is also studied on three baseline image datasets: MNIST, CIFAR-10, and SVHN. Further, using GSAE, we propose a novel deep learning based image representation for minutia detection from latent fingerprints. Latent fingerprints contain only a partial finger region, very noisy ridge patterns, and depending on the surface it is deposited, contain significant background noise. We formulate the problem of minutia extraction as a two-class classification problem and learn the descriptor using the novel formulation of GSAE. Experimental results on two publicly available latent fingerprint datasets show that the proposed algorithm yields state-of-the-art results for automated minutia extraction. •Group Sparse AutoEncoder (GSAE) learns better discriminative features compared to an unsupervised autoencoder.•Class label based ℓ2,1-regularization is incorporated to squared error reconstruction loss function using a majorization-minimization approach.•The proposed GSAE is used to learn minutia representation from noisy latent fingerprint images.•Results on standard image datasets, MNIST, CIFAR-10, and SVHN and latent fingerprint image datasets, NIST SD-27 and MOLF, show effectiveness of the proposed GSAE feature extraction approach.
ISSN:0262-8856
1872-8138
DOI:10.1016/j.imavis.2017.01.005