Robust Lasso Regression Using Tukey's Biweight Criterion

The adaptive lasso is a method for performing simultaneous parameter estimation and variable selection. The adaptive weights used in its penalty term mean that the adaptive lasso achieves the oracle property. In this work, we propose an extension of the adaptive lasso named the Tukey-lasso. By using...

Full description

Saved in:
Bibliographic Details
Published in:Technometrics Vol. 60; no. 1; pp. 36 - 47
Main Authors: Chang, Le, Roberts, Steven, Welsh, Alan
Format: Journal Article
Language:English
Published: Alexandria Taylor & Francis 02.01.2018
American Society for Quality and the American Statistical Association
American Society for Quality
Subjects:
Accelerated proximal gradient algorithm
Adaptive lasso
Algorithms
Computer simulation
Criteria
Estimating techniques
Oracle property
Outliers (statistics)
Parameter estimation
Regression analysis
Robust estimation
Robustness (mathematics)
ISSN:0040-1706, 1537-2723
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The adaptive lasso is a method for performing simultaneous parameter estimation and variable selection. The adaptive weights used in its penalty term mean that the adaptive lasso achieves the oracle property. In this work, we propose an extension of the adaptive lasso named the Tukey-lasso. By using Tukey's biweight criterion, instead of squared loss, the Tukey-lasso is resistant to outliers in both the response and covariates. Importantly, we demonstrate that the Tukey-lasso also enjoys the oracle property. A fast accelerated proximal gradient (APG) algorithm is proposed and implemented for computing the Tukey-lasso. Our extensive simulations show that the Tukey-lasso, implemented with the APG algorithm, achieves very reliable results, including for high-dimensional data where p > n. In the presence of outliers, the Tukey-lasso is shown to offer substantial improvements in performance compared to the adaptive lasso and other robust implementations of the lasso. Real-data examples further demonstrate the utility of the Tukey-lasso. Supplementary materials for this article are available online.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0040-1706
1537-2723
DOI:10.1080/00401706.2017.1305299