Discrete Hyperparameter Optimization Model Based on Skewed Distribution

As for the machine learning algorithm, one of the main factors restricting its further large-scale application is the value of hyperparameter. Therefore, researchers have done a lot of original numerical optimization algorithms to ensure the validity of hyperparameter selection. Based on previous st...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Mathematical problems in engineering Jg. 2022; S. 1 - 10
1. Verfasser: Li, Yuqi
Format: Journal Article
Sprache:Englisch
Veröffentlicht: New York Hindawi 09.08.2022
John Wiley & Sons, Inc
Schlagworte:
Algorithms
Consumer behavior
Consumers
Datasets
Engineering
Experiments
Hypergeometric functions
Machine learning
Optimization models
Parameters
Probability distribution
Probability distribution functions
Skewed distributions
ISSN:1024-123X, 1563-5147
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract As for the machine learning algorithm, one of the main factors restricting its further large-scale application is the value of hyperparameter. Therefore, researchers have done a lot of original numerical optimization algorithms to ensure the validity of hyperparameter selection. Based on previous studies, this study innovatively puts forward a model generated using skewed distribution (gamma distribution) as hyperparameter fitting and combines the Bayesian estimation method and Gauss hypergeometric function to propose a mathematically optimal solution for discrete hyperparameter selection. The results show that under strict mathematical conditions, the value of discrete hyperparameters can be given a reasonable expected value. This heuristic parameter adjustment method based on prior conditions can improve the accuracy of some traditional models in experiments and then improve the application value of models. At the same time, through the empirical study of relevant datasets, the effectiveness of the parameter adjustment strategy proposed in this study is further proved.
AbstractList As for the machine learning algorithm, one of the main factors restricting its further large-scale application is the value of hyperparameter. Therefore, researchers have done a lot of original numerical optimization algorithms to ensure the validity of hyperparameter selection. Based on previous studies, this study innovatively puts forward a model generated using skewed distribution (gamma distribution) as hyperparameter fitting and combines the Bayesian estimation method and Gauss hypergeometric function to propose a mathematically optimal solution for discrete hyperparameter selection. The results show that under strict mathematical conditions, the value of discrete hyperparameters can be given a reasonable expected value. This heuristic parameter adjustment method based on prior conditions can improve the accuracy of some traditional models in experiments and then improve the application value of models. At the same time, through the empirical study of relevant datasets, the effectiveness of the parameter adjustment strategy proposed in this study is further proved.
Author Li, Yuqi
Author_xml – sequence: 1
  givenname: Yuqi
  orcidid: 0000-0002-8034-2742
  surname: Li
  fullname: Li, Yuqi
  organization: School of Economics and ManagementBeijing University of Posts and TelecommunicationsBeijing 100876Chinabupt.edu.cn
BookMark eNp9kEFPwzAMhSM0JLbBjR9QiSOUJW7TtEcYsCEN7QBI3KokdUXG1pYk0zR-PRnbCQlOtuXv-clvQHpN2yAh54xeM8b5CCjACPKE8yI7In3GsyTmLBW90FNIYwbJ2wkZOLegFBhneZ9M7ozTFj1G022HtpNWrsJko3nnzcp8SW_aJnpqK1xGt9JhFYXx-QM3oQtSb41a75BTclzLpcOzQx2S14f7l_E0ns0nj-ObWawhz0WsRKJAVFohLypArTOmaF7QQmKVFjVPmaoLIcMOGKBQgiuOmUItJa9yhGRILvZ3O9t-rtH5ctGubRMsSxA0FTzNijxQV3tK29Y5i3XZWbOSdlsyWu6iKndRlYeoAg6_cG38z-feSrP8S3S5F72bppIb87_FNwLGevQ
CitedBy_id crossref_primary_10_1007_s10489_023_04790_3
Cites_doi 10.1016/j.neucom.2020.05.106
10.1002/dir.10032
10.2196/resprot.5155
10.1177/1094670502005001008
10.1002/(sici)1520-6653(199824)12:1<17::aid-dir3>3.0.co;2-k
10.1002/(sici)1520-6653(199924)13:1<25::aid-dir3>3.0.co;2-l
10.1287/mnsc.33.1.1
10.4108/icst.intetain.2015.259631
10.1016/j.patcog.2021.108498
10.1509/jmkr.2005.42.4.415
10.1109/IJCNN.2015.7280767
10.1186/s13755-016-0015-4
ContentType Journal Article
Copyright Copyright © 2022 Yuqi Li.
Copyright © 2022 Yuqi Li. This is an open access article distributed under the Creative Commons Attribution License (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. https://creativecommons.org/licenses/by/4.0
Copyright_xml – notice: Copyright © 2022 Yuqi Li.
– notice: Copyright © 2022 Yuqi Li. This is an open access article distributed under the Creative Commons Attribution License (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. https://creativecommons.org/licenses/by/4.0
DBID RHU
RHW
RHX
AAYXX
CITATION
7TB
8FD
8FE
8FG
ABJCF
ABUWG
AFKRA
ARAPS
AZQEC
BENPR
BGLVJ
CCPQU
CWDGH
DWQXO
FR3
GNUQQ
HCIFZ
JQ2
K7-
KR7
L6V
M7S
P5Z
P62
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
DOI 10.1155/2022/2835596
DatabaseName Hindawi Publishing Complete
Hindawi Publishing Subscription Journals
Hindawi Publishing Open Access
CrossRef
Mechanical & Transportation Engineering Abstracts
Technology Research Database
ProQuest SciTech Collection
ProQuest Technology Collection
Materials Science & Engineering Collection
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
Advanced Technologies & Computer Science Collection
ProQuest Central Essentials
ProQuest Central
Technology Collection
ProQuest One
Middle East & Africa Database
ProQuest Central
Engineering Research Database
ProQuest Central Student
SciTech Premium Collection
ProQuest Computer Science Collection
Computer Science Database
Civil Engineering Abstracts
ProQuest Engineering Collection
Engineering Database
Advanced Technologies & Aerospace Database
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Premium
ProQuest One Academic (New)
ProQuest Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central China
Engineering Collection
DatabaseTitle CrossRef
Publicly Available Content Database
Computer Science Database
ProQuest Central Student
Technology Collection
Technology Research Database
ProQuest One Academic Middle East (New)
Mechanical & Transportation Engineering Abstracts
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest Computer Science Collection
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Engineering Collection
Middle East & Africa Database
ProQuest Central Korea
ProQuest Central (New)
Engineering Collection
Advanced Technologies & Aerospace Collection
Civil Engineering Abstracts
Engineering Database
ProQuest One Academic Eastern Edition
ProQuest Technology Collection
ProQuest SciTech Collection
Advanced Technologies & Aerospace Database
ProQuest One Academic UKI Edition
Materials Science & Engineering Collection
Engineering Research Database
ProQuest One Academic
ProQuest One Academic (New)
DatabaseTitleList CrossRef
Publicly Available Content Database
Database_xml – sequence: 1
  dbid: RHX
  name: Hindawi Publishing Open Access
  url: http://www.hindawi.com/journals/
  sourceTypes: Publisher
– sequence: 2
  dbid: PIMPY
  name: Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Applied Sciences
Engineering
EISSN 1563-5147
Editor Leung, Man Fai
Editor_xml – sequence: 1
  givenname: Man Fai
  surname: Leung
  fullname: Leung, Man Fai
EndPage 10
ExternalDocumentID 10_1155_2022_2835596
GroupedDBID 29M
2WC
3V.
4.4
5GY
5VS
8FE
8FG
8R4
8R5
AAFWJ
AAJEY
ABDBF
ABJCF
ABUWG
ACIPV
ACIWK
ADBBV
AENEX
AFKRA
AINHJ
ALMA_UNASSIGNED_HOLDINGS
ARAPS
BCNDV
BENPR
BGLVJ
BPHCQ
CCPQU
CS3
CWDGH
E3Z
EBS
ESX
GROUPED_DOAJ
HCIFZ
I-F
IAO
IEA
IOF
ISR
ITC
K6V
K7-
KQ8
L6V
M7S
MK~
M~E
OK1
P2P
P62
PIMPY
PQQKQ
PROAC
PTHSS
Q2X
REM
RHU
RHW
RHX
RNS
TR2
TUS
XSB
YQT
~8M
0R~
24P
AAMMB
AAYXX
ACCMX
AEFGJ
AFFHD
AGXDD
AIDQK
AIDYY
ALUQN
CITATION
H13
OVT
PHGZM
PHGZT
PQGLB
7TB
8FD
AZQEC
DWQXO
FR3
GNUQQ
JQ2
KR7
PKEHL
PQEST
PQUKI
PRINS
ID FETCH-LOGICAL-c2887-b73b27dcbe59d2ecc61b08909aed49f541bf97a9d2212e7b75b5e6becaa5d8e23
IEDL.DBID RHX
ISSN 1024-123X
IngestDate Fri Jul 25 10:06:37 EDT 2025
Sat Nov 29 06:37:35 EST 2025
Tue Nov 18 21:07:11 EST 2025
Sun Jun 02 18:51:20 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Language English
License This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
https://creativecommons.org/licenses/by/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c2887-b73b27dcbe59d2ecc61b08909aed49f541bf97a9d2212e7b75b5e6becaa5d8e23
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-8034-2742
OpenAccessLink https://dx.doi.org/10.1155/2022/2835596
PQID 2704754698
PQPubID 237775
PageCount 10
ParticipantIDs proquest_journals_2704754698
crossref_primary_10_1155_2022_2835596
crossref_citationtrail_10_1155_2022_2835596
hindawi_primary_10_1155_2022_2835596
PublicationCentury 2000
PublicationDate 2022-08-09
PublicationDateYYYYMMDD 2022-08-09
PublicationDate_xml – month: 08
  year: 2022
  text: 2022-08-09
  day: 09
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle Mathematical problems in engineering
PublicationYear 2022
Publisher Hindawi
John Wiley & Sons, Inc
Publisher_xml – name: Hindawi
– name: John Wiley & Sons, Inc
References 11
G. Casella (4) 2002
12
E. Mulholland (13)
14
15
16
M. Abramowitz (1) 1972
P. S. Fader (5) 2005
2
3
6
7
8
A. M. Mood (9) 1974
10
References_xml – volume-title: Statistical Inference
  year: 2002
  ident: 4
– ident: 15
  doi: 10.1016/j.neucom.2020.05.106
– ident: 7
  doi: 10.1002/dir.10032
– ident: 14
  doi: 10.2196/resprot.5155
– ident: 2
  doi: 10.1177/1094670502005001008
– volume-title: Handbook of Mathematical Functions
  year: 1972
  ident: 1
– ident: 3
  doi: 10.1002/(sici)1520-6653(199824)12:1<17::aid-dir3>3.0.co;2-k
– ident: 8
  doi: 10.1002/(sici)1520-6653(199924)13:1<25::aid-dir3>3.0.co;2-l
– year: 2005
  ident: 5
  article-title: A note on implementing the Pareto/NBD model in MATLAB
– ident: 10
  doi: 10.1287/mnsc.33.1.1
– ident: 13
  article-title: 360-MAM-Affect: sentiment analysis with the google prediction API and EmoSenticNet
  doi: 10.4108/icst.intetain.2015.259631
– volume-title: Introduction to the Theory of Statistics
  year: 1974
  ident: 9
– ident: 12
  doi: 10.1016/j.patcog.2021.108498
– ident: 6
  doi: 10.1509/jmkr.2005.42.4.415
– ident: 11
  doi: 10.1109/IJCNN.2015.7280767
– ident: 16
  doi: 10.1186/s13755-016-0015-4
SSID ssj0021518
Score 2.2867715
Snippet As for the machine learning algorithm, one of the main factors restricting its further large-scale application is the value of hyperparameter. Therefore,...
SourceID proquest
crossref
hindawi
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1
SubjectTerms Algorithms
Consumer behavior
Consumers
Datasets
Engineering
Experiments
Hypergeometric functions
Machine learning
Optimization models
Parameters
Probability distribution
Probability distribution functions
Skewed distributions
SummonAdditionalLinks – databaseName: Engineering Database
  dbid: M7S
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3PS8MwFA46FfTgdCpOp_QwT1Ls0mZpTqLOuYNMYQq7lbwmxeF-uU7375vXpXMg6kEKpW1CKP2S9_LSl-8jpFpnAIFOYpeG5hRIJV3BWOiGVEkTkACjkG0Uvuftdtjtike74JbatMrcJmaGWo1iXCO_oNwLOEO9w8vxm4uqUfh31UporJI1ZEmoZal7nUXAZZ7Mt8JR5Obzu3niO2MY89ML5BpjSNe_5JI2XjAWnvW-2ebM4TSL_33VHbJtp5rO1bxv7JIVPSyRop12OnZQpyWytcRJuEfuGj1jScxU2mmZEHWC1OADTJlxHoxxGdhdmw5KqPWda-MClWNuO696Zq4ayMJrBbT2yXPz9umm5Vq1BTemaGmA-0C5ikEzoahBtl4DLxSekFoFImFBDRLBpSkz3k5z4AZIXTddQEqmQk39A1IYjob6kDgJeAISX4IvIJBgDp_7SShi8GtQV6pMzvMPHsWWihwVMfpRFpIwFiE8kYWnTM4WtcdzCo4f6lUtdn9Uq-SoRXa8ptEXZEe_Fx-TTWwsSwEUFVKYTt71CVmPP6a9dHKadb9PXNLiFg
  priority: 102
  providerName: ProQuest
Title Discrete Hyperparameter Optimization Model Based on Skewed Distribution
URI https://dx.doi.org/10.1155/2022/2835596
https://www.proquest.com/docview/2704754698
Volume 2022
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVPQU
  databaseName: Advanced Technologies & Aerospace Database
  customDbUrl:
  eissn: 1563-5147
  dateEnd: 20250131
  omitProxy: false
  ssIdentifier: ssj0021518
  issn: 1024-123X
  databaseCode: P5Z
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/hightechjournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Computer Science Database
  customDbUrl:
  eissn: 1563-5147
  dateEnd: 20250131
  omitProxy: false
  ssIdentifier: ssj0021518
  issn: 1024-123X
  databaseCode: K7-
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/compscijour
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Engineering Database
  customDbUrl:
  eissn: 1563-5147
  dateEnd: 20250131
  omitProxy: false
  ssIdentifier: ssj0021518
  issn: 1024-123X
  databaseCode: M7S
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Middle East & Africa Database
  customDbUrl:
  eissn: 1563-5147
  dateEnd: 20250131
  omitProxy: false
  ssIdentifier: ssj0021518
  issn: 1024-123X
  databaseCode: CWDGH
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/middleeastafrica
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 1563-5147
  dateEnd: 20250131
  omitProxy: false
  ssIdentifier: ssj0021518
  issn: 1024-123X
  databaseCode: BENPR
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Publicly Available Content Database
  customDbUrl:
  eissn: 1563-5147
  dateEnd: 20250131
  omitProxy: false
  ssIdentifier: ssj0021518
  issn: 1024-123X
  databaseCode: PIMPY
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
– providerCode: PRVWIB
  databaseName: Wiley Online Library Open Access
  customDbUrl:
  eissn: 1563-5147
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0021518
  issn: 1024-123X
  databaseCode: 24P
  dateStart: 19950101
  isFulltext: true
  titleUrlDefault: https://authorservices.wiley.com/open-science/open-access/browse-journals.html
  providerName: Wiley-Blackwell
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3dS8MwED-cH-CL3-J0jj7okxS3tGmaR3XTiTqLHzB9KbkmxaGbsvnx73vpsoGKKIXQkGsf7nr55ejd7wB2Io4YmjzzWUxDqLTyJeexHzOtKCBBzrAoFD4X7Xbc6cjEkSQNf_7CJ7Sz4Tnbt7RgXEYlKMXcZm5dtTqTuIpAa1TxxiwFX9AZ57d_e_YL8sw92JD3o_tjCy5w5XgJFtyB0DsYWXAZpkx_BRbd4dBzrjdchZNGlzycjrhei0LHgaXs7tlUFu-SnL7nqik929rsyTskaNIeTa8fzQfdNSw7rmtstQa3x82bo5bvuiD4GbM7AIoAmdAZGi41I41HdazFsiaV0aHMeVjHXApFa4RCRqAgBZuITKMU17FhwTpM95_7ZgO8HGsS80BhIDFUSFcggjyWGQZ1jLQuw95YQ2nmKMJtp4qntAgVOE-tPlOnzzLsTqRfRtQYv8jtOGX_IVYZWyJ1fjRMmaiFgtsul5v_e8sWzNtpkaInKzD9Ongz2zCbvb92h4MqzBw228lVFUpnwq_aPM9rGhN-TyvJ6UVyVy2-rE9lz8K3
linkProvider Hindawi Publishing
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3fT9swED4h2AQ8jN8agzE_wNMU0TpxHT9MCNaxopYOaUzqW_DFjqiAwlq2av_U_sbdpQ5DQrAnHqZIUSJbURx__s7n-O4D2G4oxMQXeSRTOiXW2cgolUapdJYcElQSy0Dhju52017PnEzB7yoWhrdVVpxYErW7znmNfFfqWqIV6x3u3XyPWDWK_65WEhoTWLT9rzG5bKMPR03q3x0pDz-dfmxFQVUgyiWPKNQxSu1y9Mo4SS1o1LGWmpqx3iWmUEkdC6MtlRGre42aXtg3qKnWKpd6TnRAlD-TxKnmcdXW0Z2DR9ZzEnonORdg3Ks22ivFawxyl3ObKZYHuGcCX56z7z3uP7AFpYE7XPjfPs0ivApTabE_wf4STPnBMiyEabUIpDVahvl7ORdX4HOzT0xJroJokQs-5NTnV7wlSHwh8rwKUamCJeIuxQGZeCfo9uuFH9NVk7MMB4GwVfj2LI1bg-nB9cC_BlFgzWARW4wNJhbpiHVcpCbHuI4N59bhfdXBWR5SrbPix2VWulxKZQyHLMBhHXbuat9MUow8Um87YOUf1TYrlGSBj0bZX4i8ebr4Hcy2To87Weeo296AOX5wud3RbML07fCHfwsv8p-3_dFwq4S-gLPnBtQfyVFBSg
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1RT9swED4hYBM8wMaGgMHwAzxNUVsnruMHNG2UDgTqKm2Tqr1kvtgRFVCgBSr-Gr-Ou9QBpGnbEw9TpCiRrchOzt_5nPP3AWw1FWLiizySKZ0S62xklEqjVDpLAQkqieVG4SPd6aS9nulOwV21F4bTKitMLIHanee8Rl6Tup5oxXqHtSKkRXRb7Y8XlxErSPGf1kpOY2Iih_52TOHbaOegRd96W8r23vfd_SgoDES55NGFOkapXY5eGSepN80G1lNTN9a7xBQqaWBhtKUyQnivUVPjfZO6ba1yqWfSA4L_GU3N4nTCrvr5EOyRJ51sw5PMCxj3qqR7pXi9QdaY50yxVMATd_jimOPwcf83v1A6u_bi__yaXsFCmGKLT5Mx8Rqm_GAJFsN0WwQwGy3B_BMuxjfwpdUnBKUQQuxTaD5kSvQzThUSXwlUz8JuVcHScafiM7l-J-j224kf01WL2YeDcNhb-PEsnVuG6cH5wK-AKLBusIgtxgYTi3TEOi5Sk2PcwKZzq_Ch-thZHijYWQnkNCtDMaUyNo0smMYqbD_UvphQj_yh3lawm39UW68sJgs4NcoezWXt78Wb8JLsKDs66By-gzl-bpkFadZh-mp47TdgNr-56o-G78tRIODXc9vTPcD7Sm4
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Discrete+Hyperparameter+Optimization+Model+Based+on+Skewed+Distribution&rft.jtitle=Mathematical+problems+in+engineering&rft.au=Li%2C+Yuqi&rft.date=2022-08-09&rft.pub=Hindawi&rft.issn=1024-123X&rft.eissn=1563-5147&rft.volume=2022&rft_id=info:doi/10.1155%2F2022%2F2835596&rft.externalDocID=10_1155_2022_2835596
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1024-123X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1024-123X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1024-123X&client=summon