Group sparse autoencoder

Unsupervised feature extraction is gaining a lot of research attention following its success to represent any kind of noisy data. Owing to the presence of a lot of training parameters, these feature learning models are prone to overfitting. Different regularization methods have been explored in the...

Full description

Saved in:
Bibliographic Details
Published in:Image and vision computing Vol. 60; pp. 64 - 74
Main Authors: Sankaran, Anush, Vatsa, Mayank, Singh, Richa, Majumdar, Angshul
Format: Journal Article
Language:English
Published: Elsevier B.V 01.04.2017
Subjects:
ISSN:0262-8856, 1872-8138
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Unsupervised feature extraction is gaining a lot of research attention following its success to represent any kind of noisy data. Owing to the presence of a lot of training parameters, these feature learning models are prone to overfitting. Different regularization methods have been explored in the literature to avoid overfitting in deep learning models. In this research, we consider autoencoder as the feature learning architecture and propose ℓ2,1-norm based regularization to improve its learning capacity, called as Group Sparse AutoEncoder (GSAE). ℓ2,1-norm is based on the postulate that the features from the same class will have a common sparsity pattern in the feature space. We present the learning algorithm for group sparse encoding using majorization–minimization approach. The performance of the proposed algorithm is also studied on three baseline image datasets: MNIST, CIFAR-10, and SVHN. Further, using GSAE, we propose a novel deep learning based image representation for minutia detection from latent fingerprints. Latent fingerprints contain only a partial finger region, very noisy ridge patterns, and depending on the surface it is deposited, contain significant background noise. We formulate the problem of minutia extraction as a two-class classification problem and learn the descriptor using the novel formulation of GSAE. Experimental results on two publicly available latent fingerprint datasets show that the proposed algorithm yields state-of-the-art results for automated minutia extraction. •Group Sparse AutoEncoder (GSAE) learns better discriminative features compared to an unsupervised autoencoder.•Class label based ℓ2,1-regularization is incorporated to squared error reconstruction loss function using a majorization-minimization approach.•The proposed GSAE is used to learn minutia representation from noisy latent fingerprint images.•Results on standard image datasets, MNIST, CIFAR-10, and SVHN and latent fingerprint image datasets, NIST SD-27 and MOLF, show effectiveness of the proposed GSAE feature extraction approach.
ISSN:0262-8856
1872-8138
DOI:10.1016/j.imavis.2017.01.005