Online estimation of the asymptotic variance for averaged stochastic gradient algorithms
Stochastic gradient algorithms are more and more studied since they can deal efficiently and online with large samples in high dimensional spaces. In this paper, we first establish a Central Limit Theorem for these estimates as well as for their averaged version in general Hilbert spaces. Moreover,...
Gespeichert in:
| Veröffentlicht in: | Journal of statistical planning and inference Jg. 203; S. 1 - 19 |
|---|---|
| 1. Verfasser: | |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
Elsevier B.V
01.12.2019
Elsevier |
| Schlagworte: | |
| ISSN: | 0378-3758, 1873-1171 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | Stochastic gradient algorithms are more and more studied since they can deal efficiently and online with large samples in high dimensional spaces. In this paper, we first establish a Central Limit Theorem for these estimates as well as for their averaged version in general Hilbert spaces. Moreover, since having the asymptotic normality of estimates is often unusable without an estimation of the asymptotic variance, we introduce a new recursive algorithm for estimating this last one, and we establish its almost sure rate of convergence as well as its rate of convergence in quadratic mean. Finally, two examples consisting in estimating the parameters of the logistic regression and estimating geometric quantiles are given.
•The asymptotic normality of averaged stochastic gradient estimates is established.•A recursive estimate of the asymptotic variance is introduced.•Rates of convergence of the recursive estimate of the variance are established. |
|---|---|
| AbstractList | Stochastic gradient algorithms are more and more studied since they can deal efficiently and online with large samples in high dimensional spaces. In this paper, we first establish a Central Limit Theorem for these estimates as well as for their averaged version in general Hilbert spaces. Moreover, since having the asymptotic normality of estimates is often unusable without an estimation of the asymptotic variance, we introduce a new recursive algorithm for estimating this last one, and we establish its almost sure rate of convergence as well as its rate of convergence in quadratic mean. Finally, two examples consisting in estimating the parameters of the logistic regression and estimating geometric quantiles are given. Stochastic gradient algorithms are more and more studied since they can deal efficiently and online with large samples in high dimensional spaces. In this paper, we first establish a Central Limit Theorem for these estimates as well as for their averaged version in general Hilbert spaces. Moreover, since having the asymptotic normality of estimates is often unusable without an estimation of the asymptotic variance, we introduce a new recursive algorithm for estimating this last one, and we establish its almost sure rate of convergence as well as its rate of convergence in quadratic mean. Finally, two examples consisting in estimating the parameters of the logistic regression and estimating geometric quantiles are given. •The asymptotic normality of averaged stochastic gradient estimates is established.•A recursive estimate of the asymptotic variance is introduced.•Rates of convergence of the recursive estimate of the variance are established. |
| Author | Godichon-Baggioni, Antoine |
| Author_xml | – sequence: 1 givenname: Antoine orcidid: 0000-0002-2399-3792 surname: Godichon fullname: Godichon, Antoine organization: Laboratoire de Mathématiques de l'INSA de Rouen Normandie |
| BackLink | https://hal.science/hal-01678855$$DView record in HAL |
| BookMark | eNp9kE1LAzEQhoNUsK3-AU-5etg12d1sdsFLKWqFQi8K3kI-ZtuU7aYkodB_b9bqxYNzCQzvM5N5ZmgyuAEQuqckp4TWj_t8H442Lwhtc0JzQugVmtKGlxmlnE7QlJS8yUrOmhs0C2FPUtWETdHnZujtABhCtAcZrRuw63DcAZbhfDhGF63GJ-mtHDTgznksT-DlFgwO0emdDGNg66WxMEQs-63zNu4O4RZdd7IPcPfzztHHy_P7cpWtN69vy8U60-lHMWOgaspaDXXdaqIYr1RXsrKqCsZUoSpFG1NU0hiueNFqbmptmGp1RRQt25aVc_RwmbuTvTj6dIQ_CyetWC3WYuwlPbxpGDvRlG0uWe1dCB46oW38Pjp6aXtBiRhtir0YbYrRZsJFspnQ4g_6u-tf6OkCQRJwsuBF0EmTBmM96CiMs__hX4LDkYc |
| CitedBy_id | crossref_primary_10_1007_s10589_022_00442_3 crossref_primary_10_1137_19M1261717 crossref_primary_10_1007_s11222_024_10538_x crossref_primary_10_1016_j_jmva_2024_105313 crossref_primary_10_1016_j_csda_2024_107992 crossref_primary_10_3150_23_BEJ1637 |
| Cites_doi | 10.1214/17-EJS1276 10.1007/s10959-006-0007-4 10.1007/BF02614063 10.1111/j.2517-6161.1985.tb01366.x 10.1016/j.jmva.2015.09.013 10.1093/biomet/ass037 10.1214/aoms/1177729586 10.1090/dimacs/072/01 10.1214/16-AOS1460 10.1137/0803045 10.1137/0330046 10.3150/11-BEJ390 10.1214/14-AOS1226 10.1287/10-SSY010 10.1137/S0363012995283789 10.1093/biomet/asn031 10.1093/biomet/35.3-4.414 10.1007/s11749-016-0519-x 10.1137/070704277 10.1137/S0363012998308169 10.1214/aoms/1177698258 10.1016/S0304-4149(98)00029-5 10.1073/pnas.97.4.1423 10.1080/01621459.1996.10476954 |
| ContentType | Journal Article |
| Copyright | 2019 Elsevier B.V. Attribution - NonCommercial |
| Copyright_xml | – notice: 2019 Elsevier B.V. – notice: Attribution - NonCommercial |
| DBID | AAYXX CITATION 1XC VOOES |
| DOI | 10.1016/j.jspi.2019.01.001 |
| DatabaseName | CrossRef Hyper Article en Ligne (HAL) Hyper Article en Ligne (HAL) (Open Access) |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Statistics Mathematics |
| EISSN | 1873-1171 |
| EndPage | 19 |
| ExternalDocumentID | oai:HAL:hal-01678855v1 10_1016_j_jspi_2019_01_001 S0378375819300011 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1OL 1RT 1~. 1~5 29L 4.4 457 4G. 5GY 5VS 6P2 7-5 71M 8P~ 9JN 9JO AAAKF AAAKG AACTN AAEDT AAEDW AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AARIN AAXUO ABAOU ABEHJ ABFNM ABFRF ABJNI ABMAC ABUCO ABXDB ABYKQ ACAZW ACDAQ ACGFO ACGFS ACRLP ADBBV ADEZE ADGUI ADMUD AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AI. AIEXJ AIGVJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ APLSM ARUGR ASPBG AVWKF AXJTR AZFZN BKOJK BLXMC CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 F5P FDB FEDTE FGOYB FIRID FNPLU FYGXN G-2 G-Q GBLVA HAMUX HMJ HVGLF HZ~ H~9 IHE J1W KOM LY1 M26 M41 MHUIS MO0 N9A NHB O-L O9- OAUVE OZT P-8 P-9 P2P PC. Q38 R2- RIG ROL RPZ SDF SDG SDP SDS SES SEW SME SPC SPCBC SSB SSD SSW SSZ T5K TN5 UNMZH VH1 WUQ XFK ~G- 9DU AATTM AAXKI AAYWO AAYXX ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD 1XC VOOES |
| ID | FETCH-LOGICAL-c378t-5eb6159ce669c0b574bf35344255b2b4b18d24add7b729c7d6cd5b9c40b139953 |
| ISICitedReferencesCount | 11 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000470949000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0378-3758 |
| IngestDate | Tue Oct 14 20:30:42 EDT 2025 Sat Nov 29 07:18:00 EST 2025 Tue Nov 18 22:34:38 EST 2025 Fri Feb 23 02:26:32 EST 2024 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Averaging Stochastic gradient algorithm Central Limit Theorem Asymptotic variance |
| Language | English |
| License | Attribution - NonCommercial: http://creativecommons.org/licenses/by-nc |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c378t-5eb6159ce669c0b574bf35344255b2b4b18d24add7b729c7d6cd5b9c40b139953 |
| ORCID | 0000-0002-2399-3792 |
| OpenAccessLink | https://hal.science/hal-01678855 |
| PageCount | 19 |
| ParticipantIDs | hal_primary_oai_HAL_hal_01678855v1 crossref_citationtrail_10_1016_j_jspi_2019_01_001 crossref_primary_10_1016_j_jspi_2019_01_001 elsevier_sciencedirect_doi_10_1016_j_jspi_2019_01_001 |
| PublicationCentury | 2000 |
| PublicationDate | December 2019 2019-12-00 2019-12 |
| PublicationDateYYYYMMDD | 2019-12-01 |
| PublicationDate_xml | – month: 12 year: 2019 text: December 2019 |
| PublicationDecade | 2010 |
| PublicationTitle | Journal of statistical planning and inference |
| PublicationYear | 2019 |
| Publisher | Elsevier B.V Elsevier |
| Publisher_xml | – name: Elsevier B.V – name: Elsevier |
| References | Cardot, Cénac, Zitt (b5) 2013; 19 Hallin, Paindaveine (b22) 2006; 34 Delyon, Juditsky (b9) 1992; 39 Chaudhuri (b8) 1996; 91 Minsker, S., Srivastava, S., Lin, L., Dunson, D., 2014. Scalable and robust bayesian inference via the median posterior. In Proceedings of the 31st International Conference on Machine Learning (ICML-14), pp. 1656–1664. Godichon-Baggioni, Portier (b20) 2017; 11 Cardot, Cénac, Godichon-Baggioni (b4) 2017; 45 Kushner, Yin (b29) 2003 Godichon-Baggioni (b18) 2016; 146 Chakraborty, Chaudhuri (b7) 2014; 42 Kemperman (b27) 1987 Gahbiche, Pelletier (b16) 2000; 331 Boyd, Vandenberghe (b3) 2004 Huber, Ronchetti (b24) 2009 Polyak, Juditsky (b38) 1992; 30 Kushner, Yin (b30) 2003; vol. 35 Maronna, Martin, Yohai (b32) 2006 Delyon, Juditsky (b10) 1993; 3 Godichon-Baggioni (b19) 2016 Walk (b44) 1992 Juditsky, Nesterov (b26) 2014; 4 Robbins, Monro (b39) 1951 Horn, Johnson (b23) 2012 Dippon, Walk (b12) 2006; 19 Jakubowski (b25) 1988; 9 Cardot, Godichon-Baggioni (b6) 2017; 26 Bach, Moulines (b2) 2013 Pelletier (b37) 2000; 39 Duflo (b14) 1997; vol. 34 Fabian (b15) 1968 Ljung, Pflug, Walk (b31) 2012 Oja, Niinimaa (b35) 1985 Schwabe, Walk (b41) 1996; 44 Pelletier (b36) 1998; 78 Ruppert (b40) 1988 Serfling (b42) 2006; 72 Nemirovski, Juditsky, Lan, Shapiro (b34) 2009; 19 Vardi, Zhang (b43) 2000; 97 Dippon, Renz (b11) 1997; 35 Bach (b1) 2014; 15 Kraus, Panaretos (b28) 2012; 99 Haldane (b21) 1948; 35 Duflo (b13) 1996 Gervini (b17) 2008; 95 Duflo (10.1016/j.jspi.2019.01.001_b13) 1996 Gahbiche (10.1016/j.jspi.2019.01.001_b16) 2000; 331 Pelletier (10.1016/j.jspi.2019.01.001_b36) 1998; 78 Nemirovski (10.1016/j.jspi.2019.01.001_b34) 2009; 19 Walk (10.1016/j.jspi.2019.01.001_b44) 1992 Hallin (10.1016/j.jspi.2019.01.001_b22) 2006; 34 Horn (10.1016/j.jspi.2019.01.001_b23) 2012 Huber (10.1016/j.jspi.2019.01.001_b24) 2009 Ljung (10.1016/j.jspi.2019.01.001_b31) 2012 Jakubowski (10.1016/j.jspi.2019.01.001_b25) 1988; 9 Oja (10.1016/j.jspi.2019.01.001_b35) 1985 Ruppert (10.1016/j.jspi.2019.01.001_b40) 1988 10.1016/j.jspi.2019.01.001_b33 Maronna (10.1016/j.jspi.2019.01.001_b32) 2006 Kemperman (10.1016/j.jspi.2019.01.001_b27) 1987 Chakraborty (10.1016/j.jspi.2019.01.001_b7) 2014; 42 Dippon (10.1016/j.jspi.2019.01.001_b12) 2006; 19 Godichon-Baggioni (10.1016/j.jspi.2019.01.001_b18) 2016; 146 Kraus (10.1016/j.jspi.2019.01.001_b28) 2012; 99 Duflo (10.1016/j.jspi.2019.01.001_b14) 1997; vol. 34 Pelletier (10.1016/j.jspi.2019.01.001_b37) 2000; 39 Cardot (10.1016/j.jspi.2019.01.001_b5) 2013; 19 Serfling (10.1016/j.jspi.2019.01.001_b42) 2006; 72 Godichon-Baggioni (10.1016/j.jspi.2019.01.001_b19) 2016 Kushner (10.1016/j.jspi.2019.01.001_b29) 2003 Kushner (10.1016/j.jspi.2019.01.001_b30) 2003; vol. 35 Chaudhuri (10.1016/j.jspi.2019.01.001_b8) 1996; 91 Dippon (10.1016/j.jspi.2019.01.001_b11) 1997; 35 Fabian (10.1016/j.jspi.2019.01.001_b15) 1968 Gervini (10.1016/j.jspi.2019.01.001_b17) 2008; 95 Godichon-Baggioni (10.1016/j.jspi.2019.01.001_b20) 2017; 11 Robbins (10.1016/j.jspi.2019.01.001_b39) 1951 Cardot (10.1016/j.jspi.2019.01.001_b6) 2017; 26 Delyon (10.1016/j.jspi.2019.01.001_b10) 1993; 3 Polyak (10.1016/j.jspi.2019.01.001_b38) 1992; 30 Bach (10.1016/j.jspi.2019.01.001_b2) 2013 Schwabe (10.1016/j.jspi.2019.01.001_b41) 1996; 44 Bach (10.1016/j.jspi.2019.01.001_b1) 2014; 15 Boyd (10.1016/j.jspi.2019.01.001_b3) 2004 Haldane (10.1016/j.jspi.2019.01.001_b21) 1948; 35 Juditsky (10.1016/j.jspi.2019.01.001_b26) 2014; 4 Delyon (10.1016/j.jspi.2019.01.001_b9) 1992; 39 Vardi (10.1016/j.jspi.2019.01.001_b43) 2000; 97 Cardot (10.1016/j.jspi.2019.01.001_b4) 2017; 45 |
| References_xml | – volume: 3 start-page: 868 year: 1993 end-page: 881 ident: b10 article-title: Accelerated stochastic approximation publication-title: SIAM J. Optim. – volume: 78 start-page: 217 year: 1998 end-page: 244 ident: b36 article-title: On the almost sure asymptotic behaviour of stochastic algorithms publication-title: Stochastic Process. Appl. – volume: 42 start-page: 1203 year: 2014 end-page: 1231 ident: b7 article-title: The spatial distribution in infinite dimensional spaces and related quantiles and depths publication-title: Ann. Statist. – volume: 9 start-page: 95 year: 1988 end-page: 114 ident: b25 article-title: Tightness criteria for random measures with application to the principle of conditioning in Hilbert spaces publication-title: Probab. Math. Statist. – volume: 146 start-page: 209 year: 2016 end-page: 222 ident: b18 article-title: Estimating the geometric median in hilbert spaces with stochastic gradient algorithms: Lp and almost sure rates of convergence publication-title: J. Multivariate Anal. – volume: 30 start-page: 838 year: 1992 end-page: 855 ident: b38 article-title: Acceleration of stochastic approximation publication-title: SIAM J. Control Optim. – start-page: 773 year: 2013 end-page: 781 ident: b2 article-title: Non-strongly-convex smooth stochastic approximation with convergence rate O (1/n) publication-title: Advances in Neural Information Processing Systems – start-page: 400 year: 1951 end-page: 407 ident: b39 article-title: A stochastic approximation method publication-title: Ann. Math. Stat. – year: 2016 ident: b19 article-title: Lp and almost sure rates of convergence of averaged stochastic gradient algorithms with applications to online robust estimation – start-page: 1 year: 1992 end-page: 51 ident: b44 article-title: Foundations of stochastic approximation publication-title: Stochastic Approximation and Optimization of Random Systems – volume: 44 start-page: 165 year: 1996 end-page: 180 ident: b41 article-title: On a stochastic approximation procedure based on averaging publication-title: Metrika – year: 1996 ident: b13 article-title: Algorithmes Stochastiques – reference: Minsker, S., Srivastava, S., Lin, L., Dunson, D., 2014. Scalable and robust bayesian inference via the median posterior. In Proceedings of the 31st International Conference on Machine Learning (ICML-14), pp. 1656–1664. – start-page: 372 year: 1985 end-page: 377 ident: b35 article-title: Asymptotic properties of the generalized median in the case of multivariate normality publication-title: J. R. Stat. Soc. Ser. B Stat. Methodol. – volume: 39 start-page: 49 year: 2000 end-page: 72 ident: b37 article-title: Asymptotic almost sure efficiency of averaged stochastic algorithms publication-title: SIAM J. Control Optim. – volume: 72 year: 2006 ident: b42 article-title: Depth functions in nonparametric multivariate inference publication-title: DIMACS Ser. Discrete Math. Theoret. Comput. Sci. – volume: 39 start-page: 107 year: 1992 end-page: 118 ident: b9 article-title: Stochastic optimization with averaging of trajectories publication-title: Stochastics – volume: 45 start-page: 591 year: 2017 end-page: 614 ident: b4 article-title: Online estimation of the geometric median in hilbert spaces: Nonasymptotic confidence balls publication-title: Ann. Statist. – year: 2009 ident: b24 article-title: Robust Statistics – start-page: 217 year: 1987 end-page: 230 ident: b27 article-title: The median of a finite measure on a Banach space publication-title: Statistical Data Analysis Based on the – volume: 26 start-page: 461 year: 2017 end-page: 480 ident: b6 article-title: Fast estimation of the median covariation matrix with application to online robust principal components analysis publication-title: Test – volume: 15 start-page: 595 year: 2014 end-page: 627 ident: b1 article-title: Adaptivity of averaged stochastic gradient descent to local strong convexity for logistic regression publication-title: J. Mach. Learn. Res. – volume: 19 start-page: 1574 year: 2009 end-page: 1609 ident: b34 article-title: Robust stochastic approximation approach to stochastic programming publication-title: SIAM J. Optim. – year: 2004 ident: b3 article-title: Convex Optimization – start-page: 1327 year: 1968 end-page: 1332 ident: b15 article-title: On asymptotic normality in stochastic approximation publication-title: Ann. Math. Stat. – volume: 19 start-page: 166 year: 2006 end-page: 189 ident: b12 article-title: The averaged robbins–monro method for linear problems in a banach space publication-title: J. Theoret. Probab. – year: 2012 ident: b23 article-title: Matrix Analysis – volume: 4 start-page: 44 year: 2014 end-page: 80 ident: b26 article-title: Deterministic and stochastic primal–dual subgradient algorithms for uniformly convex minimization publication-title: Stochastic Systems – volume: 331 start-page: 255 year: 2000 end-page: 260 ident: b16 article-title: On the estimation of the asymptotic covariance matrix for the averaged robbins–monro algorithm publication-title: C. R. Acad. Sci. Ser. I Math. – volume: 95 start-page: 587 year: 2008 end-page: 600 ident: b17 article-title: Robust functional estimation using the median and spherical principal components publication-title: Biometrika – year: 2003 ident: b29 publication-title: Stochastic Approximation and Recursive Algorithms and Applications – year: 2012 ident: b31 article-title: Stochastic Approximation and Optimization of Random Systems, vol. 17 – volume: 91 start-page: 862 year: 1996 end-page: 872 ident: b8 article-title: On a geometric notion of quantiles for multivariate data publication-title: J. Amer. Statist. Assoc. – volume: 19 start-page: 18 year: 2013 end-page: 43 ident: b5 article-title: Efficient and fast estimation of the geometric median in Hilbert spaces with an averaged stochastic gradient algorithm publication-title: Bernoulli – volume: 11 start-page: 1890 year: 2017 end-page: 1927 ident: b20 article-title: An averaged projected robbins-monro algorithm for estimating the parameters of a truncated spherical distribution publication-title: Electron. J. Stat. – volume: 35 start-page: 414 year: 1948 end-page: 417 ident: b21 article-title: Note on the median of a multivariate distribution publication-title: Biometrika – volume: 34 start-page: 2707 year: 2006 end-page: 2756 ident: b22 article-title: Semiparametrically efficient rank-based inference for shape. i. optimal rank-based tests for sphericity publication-title: Ann. Statist. – year: 1988 ident: b40 article-title: Efficient Estimations from a Slowly Convergent Robbins-Monro Process – volume: vol. 35 year: 2003 ident: b30 article-title: Stochastic approximation and recursive algorithms and applications publication-title: Applications of Mathematics (New York) – volume: 99 start-page: 813 year: 2012 end-page: 832 ident: b28 article-title: Dispersion operators and resistant second-order functional data analysis publication-title: Biometrika – volume: 35 start-page: 1811 year: 1997 end-page: 1827 ident: b11 article-title: Weighted means in stochastic approximation of minima publication-title: SIAM J. Control Optim. – volume: vol. 34 year: 1997 ident: b14 publication-title: Random Iterative Models – volume: 97 start-page: 1423 year: 2000 end-page: 1426 ident: b43 article-title: The multivariate publication-title: Proc. Natl. Acad. Sci. USA – year: 2006 ident: b32 publication-title: Robust Statistics – volume: 11 start-page: 1890 issue: 1 year: 2017 ident: 10.1016/j.jspi.2019.01.001_b20 article-title: An averaged projected robbins-monro algorithm for estimating the parameters of a truncated spherical distribution publication-title: Electron. J. Stat. doi: 10.1214/17-EJS1276 – volume: 19 start-page: 166 issue: 1 year: 2006 ident: 10.1016/j.jspi.2019.01.001_b12 article-title: The averaged robbins–monro method for linear problems in a banach space publication-title: J. Theoret. Probab. doi: 10.1007/s10959-006-0007-4 – volume: 44 start-page: 165 issue: 1 year: 1996 ident: 10.1016/j.jspi.2019.01.001_b41 article-title: On a stochastic approximation procedure based on averaging publication-title: Metrika doi: 10.1007/BF02614063 – volume: 39 start-page: 107 issue: 2–3 year: 1992 ident: 10.1016/j.jspi.2019.01.001_b9 article-title: Stochastic optimization with averaging of trajectories publication-title: Stochastics – start-page: 372 year: 1985 ident: 10.1016/j.jspi.2019.01.001_b35 article-title: Asymptotic properties of the generalized median in the case of multivariate normality publication-title: J. R. Stat. Soc. Ser. B Stat. Methodol. doi: 10.1111/j.2517-6161.1985.tb01366.x – year: 2006 ident: 10.1016/j.jspi.2019.01.001_b32 – volume: 15 start-page: 595 issue: 1 year: 2014 ident: 10.1016/j.jspi.2019.01.001_b1 article-title: Adaptivity of averaged stochastic gradient descent to local strong convexity for logistic regression publication-title: J. Mach. Learn. Res. – year: 2009 ident: 10.1016/j.jspi.2019.01.001_b24 – volume: 146 start-page: 209 year: 2016 ident: 10.1016/j.jspi.2019.01.001_b18 article-title: Estimating the geometric median in hilbert spaces with stochastic gradient algorithms: Lp and almost sure rates of convergence publication-title: J. Multivariate Anal. doi: 10.1016/j.jmva.2015.09.013 – volume: 99 start-page: 813 year: 2012 ident: 10.1016/j.jspi.2019.01.001_b28 article-title: Dispersion operators and resistant second-order functional data analysis publication-title: Biometrika doi: 10.1093/biomet/ass037 – start-page: 400 year: 1951 ident: 10.1016/j.jspi.2019.01.001_b39 article-title: A stochastic approximation method publication-title: Ann. Math. Stat. doi: 10.1214/aoms/1177729586 – volume: 72 issue: 1 year: 2006 ident: 10.1016/j.jspi.2019.01.001_b42 article-title: Depth functions in nonparametric multivariate inference publication-title: DIMACS Ser. Discrete Math. Theoret. Comput. Sci. doi: 10.1090/dimacs/072/01 – start-page: 773 year: 2013 ident: 10.1016/j.jspi.2019.01.001_b2 article-title: Non-strongly-convex smooth stochastic approximation with convergence rate O (1/n) – volume: 9 start-page: 95 issue: 1 year: 1988 ident: 10.1016/j.jspi.2019.01.001_b25 article-title: Tightness criteria for random measures with application to the principle of conditioning in Hilbert spaces publication-title: Probab. Math. Statist. – volume: 45 start-page: 591 issue: 2 year: 2017 ident: 10.1016/j.jspi.2019.01.001_b4 article-title: Online estimation of the geometric median in hilbert spaces: Nonasymptotic confidence balls publication-title: Ann. Statist. doi: 10.1214/16-AOS1460 – year: 2016 ident: 10.1016/j.jspi.2019.01.001_b19 – volume: 3 start-page: 868 issue: 4 year: 1993 ident: 10.1016/j.jspi.2019.01.001_b10 article-title: Accelerated stochastic approximation publication-title: SIAM J. Optim. doi: 10.1137/0803045 – volume: 30 start-page: 838 year: 1992 ident: 10.1016/j.jspi.2019.01.001_b38 article-title: Acceleration of stochastic approximation publication-title: SIAM J. Control Optim. doi: 10.1137/0330046 – volume: 19 start-page: 18 issue: 1 year: 2013 ident: 10.1016/j.jspi.2019.01.001_b5 article-title: Efficient and fast estimation of the geometric median in Hilbert spaces with an averaged stochastic gradient algorithm publication-title: Bernoulli doi: 10.3150/11-BEJ390 – volume: 42 start-page: 1203 year: 2014 ident: 10.1016/j.jspi.2019.01.001_b7 article-title: The spatial distribution in infinite dimensional spaces and related quantiles and depths publication-title: Ann. Statist. doi: 10.1214/14-AOS1226 – volume: 4 start-page: 44 issue: 1 year: 2014 ident: 10.1016/j.jspi.2019.01.001_b26 article-title: Deterministic and stochastic primal–dual subgradient algorithms for uniformly convex minimization publication-title: Stochastic Systems doi: 10.1287/10-SSY010 – start-page: 1 year: 1992 ident: 10.1016/j.jspi.2019.01.001_b44 article-title: Foundations of stochastic approximation – ident: 10.1016/j.jspi.2019.01.001_b33 – year: 1996 ident: 10.1016/j.jspi.2019.01.001_b13 – year: 1988 ident: 10.1016/j.jspi.2019.01.001_b40 – volume: 35 start-page: 1811 issue: 5 year: 1997 ident: 10.1016/j.jspi.2019.01.001_b11 article-title: Weighted means in stochastic approximation of minima publication-title: SIAM J. Control Optim. doi: 10.1137/S0363012995283789 – volume: 95 start-page: 587 issue: 3 year: 2008 ident: 10.1016/j.jspi.2019.01.001_b17 article-title: Robust functional estimation using the median and spherical principal components publication-title: Biometrika doi: 10.1093/biomet/asn031 – year: 2012 ident: 10.1016/j.jspi.2019.01.001_b23 – volume: 35 start-page: 414 issue: 3–4 year: 1948 ident: 10.1016/j.jspi.2019.01.001_b21 article-title: Note on the median of a multivariate distribution publication-title: Biometrika doi: 10.1093/biomet/35.3-4.414 – year: 2012 ident: 10.1016/j.jspi.2019.01.001_b31 – volume: 26 start-page: 461 issue: 3 year: 2017 ident: 10.1016/j.jspi.2019.01.001_b6 article-title: Fast estimation of the median covariation matrix with application to online robust principal components analysis publication-title: Test doi: 10.1007/s11749-016-0519-x – volume: 331 start-page: 255 issue: 3 year: 2000 ident: 10.1016/j.jspi.2019.01.001_b16 article-title: On the estimation of the asymptotic covariance matrix for the averaged robbins–monro algorithm publication-title: C. R. Acad. Sci. Ser. I Math. – year: 2004 ident: 10.1016/j.jspi.2019.01.001_b3 – volume: vol. 34 year: 1997 ident: 10.1016/j.jspi.2019.01.001_b14 – volume: 34 start-page: 2707 issue: 6 year: 2006 ident: 10.1016/j.jspi.2019.01.001_b22 article-title: Semiparametrically efficient rank-based inference for shape. i. optimal rank-based tests for sphericity publication-title: Ann. Statist. – volume: 19 start-page: 1574 issue: 4 year: 2009 ident: 10.1016/j.jspi.2019.01.001_b34 article-title: Robust stochastic approximation approach to stochastic programming publication-title: SIAM J. Optim. doi: 10.1137/070704277 – volume: 39 start-page: 49 issue: 1 year: 2000 ident: 10.1016/j.jspi.2019.01.001_b37 article-title: Asymptotic almost sure efficiency of averaged stochastic algorithms publication-title: SIAM J. Control Optim. doi: 10.1137/S0363012998308169 – start-page: 1327 year: 1968 ident: 10.1016/j.jspi.2019.01.001_b15 article-title: On asymptotic normality in stochastic approximation publication-title: Ann. Math. Stat. doi: 10.1214/aoms/1177698258 – volume: 78 start-page: 217 issue: 2 year: 1998 ident: 10.1016/j.jspi.2019.01.001_b36 article-title: On the almost sure asymptotic behaviour of stochastic algorithms publication-title: Stochastic Process. Appl. doi: 10.1016/S0304-4149(98)00029-5 – volume: 97 start-page: 1423 issue: 4 year: 2000 ident: 10.1016/j.jspi.2019.01.001_b43 article-title: The multivariate L1-median and associated data depth publication-title: Proc. Natl. Acad. Sci. USA doi: 10.1073/pnas.97.4.1423 – year: 2003 ident: 10.1016/j.jspi.2019.01.001_b29 – start-page: 217 year: 1987 ident: 10.1016/j.jspi.2019.01.001_b27 article-title: The median of a finite measure on a Banach space – volume: vol. 35 year: 2003 ident: 10.1016/j.jspi.2019.01.001_b30 article-title: Stochastic approximation and recursive algorithms and applications – volume: 91 start-page: 862 issue: 434 year: 1996 ident: 10.1016/j.jspi.2019.01.001_b8 article-title: On a geometric notion of quantiles for multivariate data publication-title: J. Amer. Statist. Assoc. doi: 10.1080/01621459.1996.10476954 |
| SSID | ssj0000605 |
| Score | 2.345746 |
| Snippet | Stochastic gradient algorithms are more and more studied since they can deal efficiently and online with large samples in high dimensional spaces. In this... |
| SourceID | hal crossref elsevier |
| SourceType | Open Access Repository Enrichment Source Index Database Publisher |
| StartPage | 1 |
| SubjectTerms | Asymptotic variance Averaging Central Limit Theorem Statistics Statistics Theory Stochastic gradient algorithm |
| Title | Online estimation of the asymptotic variance for averaged stochastic gradient algorithms |
| URI | https://dx.doi.org/10.1016/j.jspi.2019.01.001 https://hal.science/hal-01678855 |
| Volume | 203 |
| WOSCitedRecordID | wos000470949000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-1171 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000605 issn: 0378-3758 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1db9MwFLXYxsN4QGOAGDBkId6qoDix4_ixoKENjQlpA_Utip2k7bQlVVuq8e-5N7aTbhUTIPEStWk-nNzT6xPn3GNC3mke5xpfsnJmZMArpgJg-SLQcQWdsynConXn_34qz87S0Uh9dYLMRTudgKzr9OZGzf5rqGEdBBtLZ_8i3N1BYQV8hqDDEsIOyz8KvDUPHaB7xnXHB5Fe5ouf17Nlgw6tK3hCbmsFWg0lXCJklWIAPNBMcjRuHoznrRQMx4PHzXy6nDhT800aixVJrdkzlnS5GZCcpZMrJewkPk0xhWRbBx_yMaqgp868oPGv9t3gA1N3hBybVTG2EgslF9Jasr8vbWJNZRwwZqdb8Zk3CuO13MnWOmGbRjfSux1puEQ3ySnK8lRrueoadNs2-xxbgY0AhtoS3y2yE0mhIPPtDE-ORp_X-msrdPWtdqVVVgV490y_oy9bEz8Q3xKTiz3y2IWCDi0SnpAHZb1PHn3p7HgX-2T33Adp8ZSMLEBoDxDaVBS2pj1AqAcIBYBQDxDaA4R6gNAeIM_It09HFx-PAze_RmDgWpeBKDXwWWXKJFEm1EJyXcUi5pDGhY401ywtIg4doNTwCGZkkZhCaGV4qBlWRMfPyXbd1OULQosoAWoqmam44FFYwa_wRWvBkzIRVX5AmL9tmXHm8zgHylXmVYaXGd7qDG91FjKUWh6QQbfPzFqv3Lu18NHIHHm0pDAD8Ny731sIXXcCdFs_Hp5muA4rdNJUiBV7-Y8Hf0V2-3_Na7K9nP8oD8lDs4KYz984IP4CtN-iSA |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Online+estimation+of+the+asymptotic+variance+for+averaged+stochastic+gradient+algorithms&rft.jtitle=Journal+of+statistical+planning+and+inference&rft.au=Godichon-Baggioni%2C+Antoine&rft.date=2019-12-01&rft.pub=Elsevier+B.V&rft.issn=0378-3758&rft.eissn=1873-1171&rft.volume=203&rft.spage=1&rft.epage=19&rft_id=info:doi/10.1016%2Fj.jspi.2019.01.001&rft.externalDocID=S0378375819300011 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0378-3758&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0378-3758&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0378-3758&client=summon |