Discrete Hyperparameter Optimization Model Based on Skewed Distribution

As for the machine learning algorithm, one of the main factors restricting its further large-scale application is the value of hyperparameter. Therefore, researchers have done a lot of original numerical optimization algorithms to ensure the validity of hyperparameter selection. Based on previous st...

Full description

Saved in:
Bibliographic Details
Published in:Mathematical problems in engineering Vol. 2022; pp. 1 - 10
Main Author: Li, Yuqi
Format: Journal Article
Language:English
Published: New York Hindawi 09.08.2022
John Wiley & Sons, Inc
Subjects:
Algorithms
Consumer behavior
Consumers
Datasets
Engineering
Experiments
Hypergeometric functions
Machine learning
Optimization models
Parameters
Probability distribution
Probability distribution functions
Skewed distributions
ISSN:1024-123X, 1563-5147
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:As for the machine learning algorithm, one of the main factors restricting its further large-scale application is the value of hyperparameter. Therefore, researchers have done a lot of original numerical optimization algorithms to ensure the validity of hyperparameter selection. Based on previous studies, this study innovatively puts forward a model generated using skewed distribution (gamma distribution) as hyperparameter fitting and combines the Bayesian estimation method and Gauss hypergeometric function to propose a mathematically optimal solution for discrete hyperparameter selection. The results show that under strict mathematical conditions, the value of discrete hyperparameters can be given a reasonable expected value. This heuristic parameter adjustment method based on prior conditions can improve the accuracy of some traditional models in experiments and then improve the application value of models. At the same time, through the empirical study of relevant datasets, the effectiveness of the parameter adjustment strategy proposed in this study is further proved.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1024-123X
1563-5147
DOI:10.1155/2022/2835596