In EDS ansehen

Variational Inference based on a Subclass of Closed Skew Normals.

Gespeichert in:
Bibliographische Detailangaben
Titel: Variational Inference based on a Subclass of Closed Skew Normals.
Autoren: Tan, Linda S. L.1 (AUTHOR) statsll@nus.edu.sg, Chen, Aoxiang1 (AUTHOR)
Quelle: Journal of Computational & Graphical Statistics. Apr-Jun2025, Vol. 34 Issue 2, p422-436. 15p.
Schlagwörter: *GAUSSIAN distribution, MAXIMUM likelihood statistics, AFFINE transformations, BAYESIAN field theory, PARAMETERIZATION
Abstract: Gaussian distributions are widely used in Bayesian variational inference to approximate intractable posterior densities, but the ability to accommodate skewness can improve approximation accuracy significantly, when data or prior information is scarce. We study the properties of a subclass of closed skew normals constructed using affine transformation of independent standardized univariate skew normals as the variational density, and illustrate how it provides increased flexibility and accuracy in approximating the joint posterior in various applications, by overcoming limitations in existing skew normal variational approximations. The evidence lower bound is optimized using stochastic gradient ascent, where analytic natural gradient updates are derived. We also demonstrate how problems in maximum likelihood estimation of skew normal parameters occur similarly in stochastic variational inference, and can be resolved using the centered parameterization. Supplementary materials for this article are available online. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Computational & Graphical Statistics is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Datenbank: Business Source Index
Beschreibung
Abstract:Gaussian distributions are widely used in Bayesian variational inference to approximate intractable posterior densities, but the ability to accommodate skewness can improve approximation accuracy significantly, when data or prior information is scarce. We study the properties of a subclass of closed skew normals constructed using affine transformation of independent standardized univariate skew normals as the variational density, and illustrate how it provides increased flexibility and accuracy in approximating the joint posterior in various applications, by overcoming limitations in existing skew normal variational approximations. The evidence lower bound is optimized using stochastic gradient ascent, where analytic natural gradient updates are derived. We also demonstrate how problems in maximum likelihood estimation of skew normal parameters occur similarly in stochastic variational inference, and can be resolved using the centered parameterization. Supplementary materials for this article are available online. [ABSTRACT FROM AUTHOR]
ISSN:10618600
DOI:10.1080/10618600.2024.2402278