Further advances on Bayesian Ying-Yang harmony learning

After a short tutorial on the fundamentals of Bayes approaches and Bayesian Ying-Yang (BYY) harmony learning, this paper introduces new progresses. A generic information harmonising dynamics of BYY harmony learning is proposed with the help of a Lagrange variety preservation principle, which provide...

Full description

Saved in:
Bibliographic Details
Published in:Applied informatics Vol. 2; no. 1; pp. 1 - 45
Main Author: Xu, Lei
Format: Journal Article
Language:English
Published: Berlin/Heidelberg Springer Berlin Heidelberg 13.06.2015
Springer Nature B.V
Subjects:
Algorithms
Artificial Intelligence
Bayesian analysis
Bioinformatics
Computer Applications
Computer Imaging
Computer Science
Factor analysis
Health Informatics
Health Sciences
Machine learning
Manifolds (mathematics)
Mathematical analysis
Matrix methods
Medicine
Pattern Recognition and Graphics
Problem solving
Regression analysis
Search algorithms
Statistics for Life Sciences
Vision
nonGaussian factors
Factor analysis
Binary factors
Lagrange
Multivariate regression
Ying-Yang alternation
Bilinear matrix system
Local factors
Linear mixed model
Automatic model selection
Temporal factors
De-noised Gaussian mixture
Variety preservation
ISSN:2196-0089, 2196-0089
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:After a short tutorial on the fundamentals of Bayes approaches and Bayesian Ying-Yang (BYY) harmony learning, this paper introduces new progresses. A generic information harmonising dynamics of BYY harmony learning is proposed with the help of a Lagrange variety preservation principle, which provides Lagrange-like implementations of Ying-Yang alternative nonlocal search for various learning tasks and unifies attention, detection, problem-solving, adaptation, learning and model selection from an information harmonising perspective. In this framework, new algorithms are developed to implement Ying-Yang alternative nonlocal search for learning Gaussian mixture and several typical exemplars of linear matrix system, including factor analysis (FA), mixture of local FA, binary FA, nonGaussian FA, de-noised Gaussian mixture, sparse multivariate regression, temporal FA and temporal binary FA, as well as a generalised bilinear matrix system that covers not only these linear models but also manifold learning, gene regulatory networks and the generalised linear mixed model. These algorithms are featured with a favourable nature of automatic model selection and a unified formulation in performing unsupervised learning and semi-supervised learning. Also, we propose a principle of preserving multiple convex combinations, which leads alternative search algorithms. Finally, we provide a chronological outline of the history of BYY learning studies.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2196-0089
2196-0089
DOI:10.1186/s40535-015-0008-4