Optimal Subsampling for Large Sample Logistic Regression

For massive data, the family of subsampling algorithms is popular to downsize the data volume and reduce computational burden. Existing studies focus on approximating the ordinary least-square estimate in linear regression, where statistical leverage scores are often used to define subsampling proba...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of the American Statistical Association Ročník 113; číslo 522; s. 829 - 844
Hlavní autoři: Wang, HaiYing, Zhu, Rong, Ma, Ping
Médium: Journal Article
Jazyk:angličtina
Vydáno: United States Taylor & Francis 03.04.2018
Taylor & Francis Group,LLC
Taylor & Francis Ltd
Témata:
A-optimality
Algorithms
Asymptotic properties
Computational efficiency
Computing costs
Computing time
Consistency
Data
data collection
equations
Logistic regression
Massive data
Maximum likelihood estimates
Minimization
Normality
Optimal subsampling
Optimization
Probability
Rare event
Regression
Regression analysis
Statistical analysis
Statistical methods
Statistics
Theory and Methods
Rare Event
Logistic Regression
Optimal Subsampling
A-optimality
Massive Data
ISSN:0162-1459, 1537-274X, 1537-274X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:For massive data, the family of subsampling algorithms is popular to downsize the data volume and reduce computational burden. Existing studies focus on approximating the ordinary least-square estimate in linear regression, where statistical leverage scores are often used to define subsampling probabilities. In this article, we propose fast subsampling algorithms to efficiently approximate the maximum likelihood estimate in logistic regression. We first establish consistency and asymptotic normality of the estimator from a general subsampling algorithm, and then derive optimal subsampling probabilities that minimize the asymptotic mean squared error of the resultant estimator. An alternative minimization criterion is also proposed to further reduce the computational cost. The optimal subsampling probabilities depend on the full data estimate, so we develop a two-step algorithm to approximate the optimal subsampling procedure. This algorithm is computationally efficient and has a significant reduction in computing time compared to the full data approach. Consistency and asymptotic normality of the estimator from a two-step algorithm are also established. Synthetic and real datasets are used to evaluate the practical performance of the proposed method. Supplementary materials for this article are available online.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
HaiYing Wang and Rong Zhu contribute equally.
ISSN:0162-1459
1537-274X
1537-274X
DOI:10.1080/01621459.2017.1292914