Application of Q-learning algorithm based on heterogeneous sensor networks in higher education teaching management

With the rapid advancement of information technology and online technologies, it has become imperative for all colleges and universities to address the challenge of leveraging modern management methods to enhance management efficiency, level, and practices. In the realm of educational institution ma...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Measurement. Sensors Jg. 33; S. 101188
1. Verfasser: Xie, Qian
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elsevier Ltd 01.06.2024
Elsevier
Schlagworte:
ISSN:2665-9174, 2665-9174
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract With the rapid advancement of information technology and online technologies, it has become imperative for all colleges and universities to address the challenge of leveraging modern management methods to enhance management efficiency, level, and practices. In the realm of educational institution management, the learning management system stands as the cornerstone of contemporary campus management and the entire campus computer network. In this article, the Q-learning algorithm, specifically applied to a heterogeneous cellular network, is employed to investigate the issues pertaining to teaching management in colleges and universities.The design and implementation of the university teaching management system mainly uses heterogeneous cellular networks to establish a physical model of the Q-learning algorithm, and then in the Rayleigh channel, the coverage factor and the system rate expression are derived in a closed form, and in a closed form Derive the energy efficiency expression, and then optimize the density of the basic micro-station algorithm to maximize performance. In the process of system design, this paper uses an algorithm to analyze the current research status of university teaching management, then proposes the research purpose and subject content, and analyzes the university's teaching management function and potential future functional requirements. When designing the university learning management system, it describes in detail the overall design concept, key technologies, system structure, and operating system structure and system topology. This research mainly focuses on the research of campus information management and Q learning algorithm. Based on the cellular network, a large number of campus management cases were analyzed and data fitting at the same time, and a set of Q-learning algorithm teaching management system based on heterogeneous cellular network was designed.
AbstractList With the rapid advancement of information technology and online technologies, it has become imperative for all colleges and universities to address the challenge of leveraging modern management methods to enhance management efficiency, level, and practices. In the realm of educational institution management, the learning management system stands as the cornerstone of contemporary campus management and the entire campus computer network. In this article, the Q-learning algorithm, specifically applied to a heterogeneous cellular network, is employed to investigate the issues pertaining to teaching management in colleges and universities.The design and implementation of the university teaching management system mainly uses heterogeneous cellular networks to establish a physical model of the Q-learning algorithm, and then in the Rayleigh channel, the coverage factor and the system rate expression are derived in a closed form, and in a closed form Derive the energy efficiency expression, and then optimize the density of the basic micro-station algorithm to maximize performance. In the process of system design, this paper uses an algorithm to analyze the current research status of university teaching management, then proposes the research purpose and subject content, and analyzes the university's teaching management function and potential future functional requirements. When designing the university learning management system, it describes in detail the overall design concept, key technologies, system structure, and operating system structure and system topology. This research mainly focuses on the research of campus information management and Q learning algorithm. Based on the cellular network, a large number of campus management cases were analyzed and data fitting at the same time, and a set of Q-learning algorithm teaching management system based on heterogeneous cellular network was designed.
ArticleNumber 101188
Author Xie, Qian
Author_xml – sequence: 1
  givenname: Qian
  surname: Xie
  fullname: Xie, Qian
  email: chengmanman_2014@163.com
  organization: School of Economics and Management, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China
BookMark eNqFkdFqHSEQhqUk0DTJG-TCF9hTVz2u9qIQQpsGAqXQXIur4x5Pd_WgpqVvH082lNKL5mqG4f-_YeZ_h05iioDQVU82PenF-_1mAVMgbiih_DjqpXyDzqgQ2071Az_5q3-LLkvZE0KobELKz1C-PhzmYE0NKeLk8bduBpNjiBM285RyqLsFj43vcBPsoEJOE0RIjwW3pSVlHKH-SvlHwaEJwrSDjME9viArGLs70hYTzQQLxHqBTr2ZC1y-1HP08PnT95sv3f3X27ub6_vOUsFkp6jzzDsCxg-0Z4wYI4Ezq5hUoxJKDJYR7p2lkpjeqZFtQUg-jpyPlMmBnaO7leuS2etDDovJv3UyQT8PUp60yTXYGfRgrWfcMbllwIVXSoAT1NutYIOifGwsvrJsTqVk8H94PdHHGPRerzHoYwx6jaHZPvxjs6E-P6ZmE-bXzB9XM7Qn_QyQdbEBogUXMtjargj_BzwBrMGpTw
CitedBy_id crossref_primary_10_18502_kss_v10i18_19486
crossref_primary_10_2478_amns_2024_2514
Cites_doi 10.5465/19416520.2015.1027086
10.1007/s11042-022-12882-4
10.1145/2746342
10.1109/ACCESS.2019.2941229
10.1177/2211068214561025
10.1109/JSAC.2015.2393496
10.1109/TCOMM.2016.2519402
10.1002/asi.24464
10.1017/dmp.2017.12
10.1016/j.ecoinf.2019.101015
10.1109/COMST.2015.2403395
10.1109/TIE.2021.3113021
10.1109/TWC.2011.062911.100481
10.1109/JSAC.2017.2687379
ContentType Journal Article
Copyright 2024 The Author
Copyright_xml – notice: 2024 The Author
DBID 6I.
AAFTH
AAYXX
CITATION
DOA
DOI 10.1016/j.measen.2024.101188
DatabaseName ScienceDirect Open Access Titles
Elsevier:ScienceDirect:Open Access
CrossRef
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
DatabaseTitleList

Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Open Access Full Text
  url: https://www.doaj.org/
  sourceTypes: Open Website
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2665-9174
ExternalDocumentID oai_doaj_org_article_7ccf34d3853e46f996ed62fc5637924b
10_1016_j_measen_2024_101188
S2665917424001648
GroupedDBID 0R~
53G
6I.
AAEDW
AAFTH
AALRI
AAXUO
AAYWO
ACVFH
ADCNI
ADVLN
AEUPX
AFJKZ
AFPUW
AIGII
AITUG
AKBMS
AKYEP
ALMA_UNASSIGNED_HOLDINGS
AMRAJ
APXCP
EBS
EJD
FDB
GROUPED_DOAJ
M41
M~E
OK1
ROL
AAYXX
CITATION
ID FETCH-LOGICAL-c2638-92df3fd0eaf721330aa8e43c9389b96967c304fdc280a1d9b35e684bb44b23873
IEDL.DBID DOA
ISSN 2665-9174
IngestDate Fri Oct 03 12:45:54 EDT 2025
Thu Nov 13 04:24:15 EST 2025
Tue Nov 18 22:43:08 EST 2025
Sat Aug 09 17:30:33 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords Heterogeneous cellular network
Software development
Management system
Q-learning algorithm
Language English
License This is an open access article under the CC BY-NC-ND license.
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c2638-92df3fd0eaf721330aa8e43c9389b96967c304fdc280a1d9b35e684bb44b23873
OpenAccessLink https://doaj.org/article/7ccf34d3853e46f996ed62fc5637924b
ParticipantIDs doaj_primary_oai_doaj_org_article_7ccf34d3853e46f996ed62fc5637924b
crossref_primary_10_1016_j_measen_2024_101188
crossref_citationtrail_10_1016_j_measen_2024_101188
elsevier_sciencedirect_doi_10_1016_j_measen_2024_101188
PublicationCentury 2000
PublicationDate June 2024
2024-06-00
2024-06-01
PublicationDateYYYYMMDD 2024-06-01
PublicationDate_xml – month: 06
  year: 2024
  text: June 2024
PublicationDecade 2020
PublicationTitle Measurement. Sensors
PublicationYear 2024
Publisher Elsevier Ltd
Elsevier
Publisher_xml – name: Elsevier Ltd
– name: Elsevier
References Xu, Zhang, Andrews (bib14) 2011; 10
Li, Meng, Gao, Zhang, Chen (bib5) 2021; 69
Zhong, Quek, Ge (bib16) 2017; 35
Dwivedi, Hughes, Coombs (bib1) 2020; 55
Stvilia, Lee, Han (bib3) 2021; 72
Omidvar, Karimloo, Sani, Darabi (bib2) 2017; 11
Du, Zhou, Deng, Luo (bib7) 2022; 81
Jang, Kim, Harerimana, Kim (bib4) 2019; 7
Chen, Wu, Cai, Zhang, Chen (bib10) 2015; 33
Lin, Miao, Zhang (bib13) 2016; 12
Minarti, Rohimiya, Wardi (bib8) 2022; 9
Mammadli (bib12) 2020; vol. 6
Srinivasan, Kolli, Esch, Abaci, Shuler, Hickman (bib9) 2015; 20
Wu, Zhang, Zukerman, Yung (bib17) 2015; 17
Komori, Eguchi, Saigusa, Kusumoto, Kubota (bib15) 2020; 55
Josefy, Kuban, Ireland, Hitt (bib6) 2015; 9
Wang, Zheng, Yuan, Towsley, Lee (bib11) 2016; 64
Du (10.1016/j.measen.2024.101188_bib7) 2022; 81
Wang (10.1016/j.measen.2024.101188_bib11) 2016; 64
Jang (10.1016/j.measen.2024.101188_bib4) 2019; 7
Komori (10.1016/j.measen.2024.101188_bib15) 2020; 55
Mammadli (10.1016/j.measen.2024.101188_bib12) 2020; vol. 6
Wu (10.1016/j.measen.2024.101188_bib17) 2015; 17
Omidvar (10.1016/j.measen.2024.101188_bib2) 2017; 11
Josefy (10.1016/j.measen.2024.101188_bib6) 2015; 9
Dwivedi (10.1016/j.measen.2024.101188_bib1) 2020; 55
Stvilia (10.1016/j.measen.2024.101188_bib3) 2021; 72
Minarti (10.1016/j.measen.2024.101188_bib8) 2022; 9
Srinivasan (10.1016/j.measen.2024.101188_bib9) 2015; 20
Xu (10.1016/j.measen.2024.101188_bib14) 2011; 10
Lin (10.1016/j.measen.2024.101188_bib13) 2016; 12
Zhong (10.1016/j.measen.2024.101188_bib16) 2017; 35
Li (10.1016/j.measen.2024.101188_bib5) 2021; 69
Chen (10.1016/j.measen.2024.101188_bib10) 2015; 33
References_xml – volume: 55
  year: 2020
  ident: bib1
  article-title: Impact of COVID-19 pandemic on information management research and practice: Transforming education, work and life
  publication-title: Int. J. Inf. Manag.
– volume: 9
  start-page: 156
  year: 2022
  end-page: 173
  ident: bib8
  article-title: The distinctive character in the modernization of Islamic education through curriculum and learning management
  publication-title: PEDAGOGIK: Jurnal Pendidikan
– volume: 11
  start-page: 681
  year: 2017
  end-page: 693
  ident: bib2
  article-title: Disaster management structure of universities: case study of the central campus of the University of Tehran
  publication-title: Disaster Med. Public Health Prep.
– volume: 72
  start-page: 963
  year: 2021
  end-page: 978
  ident: bib3
  article-title: “Striking out on your own”—a study of research information management problems on university campuses
  publication-title: Journal of the Association for Information Science and Technology
– volume: 20
  start-page: 107
  year: 2015
  end-page: 126
  ident: bib9
  article-title: TEER measurement techniques for in vitro barrier model systems
  publication-title: J. Lab. Autom.
– volume: 33
  start-page: 627
  year: 2015
  end-page: 640
  ident: bib10
  article-title: Energy-efficiency oriented traffic offloading in wireless networks: a brief survey and a learning approach for heterogeneous cellular networks
  publication-title: IEEE J. Sel. Area. Commun.
– volume: 55
  year: 2020
  ident: bib15
  article-title: Sampling bias correction in species distribution models by quasi-linear Poisson point process
  publication-title: Ecol. Inf.
– volume: 17
  start-page: 803
  year: 2015
  end-page: 826
  ident: bib17
  article-title: Energy-efficient base-stations sleep-mode techniques in green cellular networks: a survey
  publication-title: IEEE communications surveys & tutorials
– volume: 7
  start-page: 133653
  year: 2019
  end-page: 133667
  ident: bib4
  article-title: Q-learning algorithms: a comprehensive classification and applications
  publication-title: IEEE Access
– volume: 69
  start-page: 9099
  year: 2021
  end-page: 9110
  ident: bib5
  article-title: Approximate cost-optimal energy management of hydrogen electric multiple unit trains using double Q-learning algorithm
  publication-title: IEEE Trans. Ind. Electron.
– volume: 10
  start-page: 3098
  year: 2011
  end-page: 3109
  ident: bib14
  article-title: On the accuracy of the Wyner model in cellular networks
  publication-title: IEEE Trans. Wireless Commun.
– volume: 64
  start-page: 1204
  year: 2016
  end-page: 1219
  ident: bib11
  article-title: Physical layer security in heterogeneous cellular networks
  publication-title: IEEE Trans. Commun.
– volume: 35
  start-page: 1373
  year: 2017
  end-page: 1386
  ident: bib16
  article-title: Heterogeneous cellular networks with spatio-temporal traffic: Delay analysis and scheduling
  publication-title: IEEE J. Sel. Area. Commun.
– volume: 12
  start-page: 1
  year: 2016
  end-page: 31
  ident: bib13
  article-title: ATPC: Adaptive transmission power control for wireless sensor networks
  publication-title: ACM Trans. Sens. Netw.
– volume: 9
  start-page: 715
  year: 2015
  end-page: 802
  ident: bib6
  article-title: All things great and small: Organizational size, boundaries of the firm, and a changing environment
  publication-title: Acad. Manag. Ann.
– volume: vol. 6
  start-page: 20
  year: 2020
  ident: bib12
  publication-title: Liability Issue of the Sub-carrier in the Carriage of Goods by Sea
– volume: 81
  start-page: 27397
  year: 2022
  end-page: 27422
  ident: bib7
  article-title: Improved chimp optimization algorithm for three-dimensional path planning problem
  publication-title: Multimed. Tool. Appl.
– volume: 9
  start-page: 715
  issue: 1
  year: 2015
  ident: 10.1016/j.measen.2024.101188_bib6
  article-title: All things great and small: Organizational size, boundaries of the firm, and a changing environment
  publication-title: Acad. Manag. Ann.
  doi: 10.5465/19416520.2015.1027086
– volume: 9
  start-page: 156
  issue: 2
  year: 2022
  ident: 10.1016/j.measen.2024.101188_bib8
  article-title: The distinctive character in the modernization of Islamic education through curriculum and learning management
  publication-title: PEDAGOGIK: Jurnal Pendidikan
– volume: 81
  start-page: 27397
  issue: 19
  year: 2022
  ident: 10.1016/j.measen.2024.101188_bib7
  article-title: Improved chimp optimization algorithm for three-dimensional path planning problem
  publication-title: Multimed. Tool. Appl.
  doi: 10.1007/s11042-022-12882-4
– volume: vol. 6
  start-page: 20
  year: 2020
  ident: 10.1016/j.measen.2024.101188_bib12
– volume: 12
  start-page: 1
  issue: 1
  year: 2016
  ident: 10.1016/j.measen.2024.101188_bib13
  article-title: ATPC: Adaptive transmission power control for wireless sensor networks
  publication-title: ACM Trans. Sens. Netw.
  doi: 10.1145/2746342
– volume: 7
  start-page: 133653
  year: 2019
  ident: 10.1016/j.measen.2024.101188_bib4
  article-title: Q-learning algorithms: a comprehensive classification and applications
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2019.2941229
– volume: 55
  year: 2020
  ident: 10.1016/j.measen.2024.101188_bib1
  article-title: Impact of COVID-19 pandemic on information management research and practice: Transforming education, work and life
  publication-title: Int. J. Inf. Manag.
– volume: 20
  start-page: 107
  issue: 2
  year: 2015
  ident: 10.1016/j.measen.2024.101188_bib9
  article-title: TEER measurement techniques for in vitro barrier model systems
  publication-title: J. Lab. Autom.
  doi: 10.1177/2211068214561025
– volume: 33
  start-page: 627
  issue: 4
  year: 2015
  ident: 10.1016/j.measen.2024.101188_bib10
  article-title: Energy-efficiency oriented traffic offloading in wireless networks: a brief survey and a learning approach for heterogeneous cellular networks
  publication-title: IEEE J. Sel. Area. Commun.
  doi: 10.1109/JSAC.2015.2393496
– volume: 64
  start-page: 1204
  issue: 3
  year: 2016
  ident: 10.1016/j.measen.2024.101188_bib11
  article-title: Physical layer security in heterogeneous cellular networks
  publication-title: IEEE Trans. Commun.
  doi: 10.1109/TCOMM.2016.2519402
– volume: 72
  start-page: 963
  issue: 8
  year: 2021
  ident: 10.1016/j.measen.2024.101188_bib3
  article-title: “Striking out on your own”—a study of research information management problems on university campuses
  publication-title: Journal of the Association for Information Science and Technology
  doi: 10.1002/asi.24464
– volume: 11
  start-page: 681
  issue: 6
  year: 2017
  ident: 10.1016/j.measen.2024.101188_bib2
  article-title: Disaster management structure of universities: case study of the central campus of the University of Tehran
  publication-title: Disaster Med. Public Health Prep.
  doi: 10.1017/dmp.2017.12
– volume: 55
  year: 2020
  ident: 10.1016/j.measen.2024.101188_bib15
  article-title: Sampling bias correction in species distribution models by quasi-linear Poisson point process
  publication-title: Ecol. Inf.
  doi: 10.1016/j.ecoinf.2019.101015
– volume: 17
  start-page: 803
  issue: 2
  year: 2015
  ident: 10.1016/j.measen.2024.101188_bib17
  article-title: Energy-efficient base-stations sleep-mode techniques in green cellular networks: a survey
  publication-title: IEEE communications surveys & tutorials
  doi: 10.1109/COMST.2015.2403395
– volume: 69
  start-page: 9099
  issue: 9
  year: 2021
  ident: 10.1016/j.measen.2024.101188_bib5
  article-title: Approximate cost-optimal energy management of hydrogen electric multiple unit trains using double Q-learning algorithm
  publication-title: IEEE Trans. Ind. Electron.
  doi: 10.1109/TIE.2021.3113021
– volume: 10
  start-page: 3098
  issue: 9
  year: 2011
  ident: 10.1016/j.measen.2024.101188_bib14
  article-title: On the accuracy of the Wyner model in cellular networks
  publication-title: IEEE Trans. Wireless Commun.
  doi: 10.1109/TWC.2011.062911.100481
– volume: 35
  start-page: 1373
  issue: 6
  year: 2017
  ident: 10.1016/j.measen.2024.101188_bib16
  article-title: Heterogeneous cellular networks with spatio-temporal traffic: Delay analysis and scheduling
  publication-title: IEEE J. Sel. Area. Commun.
  doi: 10.1109/JSAC.2017.2687379
SSID ssj0002810124
Score 2.2575333
Snippet With the rapid advancement of information technology and online technologies, it has become imperative for all colleges and universities to address the...
SourceID doaj
crossref
elsevier
SourceType Open Website
Enrichment Source
Index Database
Publisher
StartPage 101188
SubjectTerms Heterogeneous cellular network
Management system
Q-learning algorithm
Software development
Title Application of Q-learning algorithm based on heterogeneous sensor networks in higher education teaching management
URI https://dx.doi.org/10.1016/j.measen.2024.101188
https://doaj.org/article/7ccf34d3853e46f996ed62fc5637924b
Volume 33
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Open Access Full Text
  customDbUrl:
  eissn: 2665-9174
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0002810124
  issn: 2665-9174
  databaseCode: DOA
  dateStart: 20190101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2665-9174
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0002810124
  issn: 2665-9174
  databaseCode: M~E
  dateStart: 20190101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV07T8MwELZQxQAD4inKSx5YI9LYjZOxoFYsVCCB1M1y_OhDbYLawshv5y5O2kx0YclgXWzrfPHd2V--I-SegRfVGYsCA8EwJChaBKkyKoBQI-VIINbRvtiEGA6T0Sh9bZT6QkyYpwf2insQWjvGDQO3YnnsIDy3Jo6c7sZMQO6Q4e4birSRTM3KIyPkreL1v3IloGuB9x1IeRpxbOqUxVa2vqik7G-4pIabGRyToyo-pD0_rxOyZ_NTcthgDTwjy9720pkWjr4FVemHMVXzcQHZ_mRB0TsZCgITxLsUYCYWcnwKU1sVS5p78PeKTkGgRHpQWyM96LoCWNLFBhpzTj4G_fen56AqnRDoKMYtLDKOORNa5SDFYyxUKrGc6RTikwwJcYRmIXdGR0moOibNWNfGCc8yzjNw4oJdkFZe5PaSUMtwD9ICWWx4FzTujMl0qCL4smEtkzZhtRKlrnjFsbzFXNYAspn0qpeoeulV3ybB5q1Pz6uxQ_4R12cji6zYZQPYiqxsRe6ylTYR9erKKsDwgQN0Nf1z-Kv_GP6aHGCXHmh2Q1rr5Ze9Jfv6ez1dLe9KA4bny0__FwY_9uA
linkProvider Directory of Open Access Journals
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Application+of+Q-learning+algorithm+based+on+heterogeneous+sensor+networks+in+higher+education+teaching+management&rft.jtitle=Measurement.+Sensors&rft.au=Qian+Xie&rft.date=2024-06-01&rft.pub=Elsevier&rft.eissn=2665-9174&rft.volume=33&rft.spage=101188&rft_id=info:doi/10.1016%2Fj.measen.2024.101188&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_7ccf34d3853e46f996ed62fc5637924b
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2665-9174&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2665-9174&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2665-9174&client=summon