Deep Q-Learning Technique for Offloading Offline/Online Computation in Blockchain-Enabled Green IoT-Edge Scenarios

The number of Internet of Things (IoT)-related innovations has recently increased exponentially, with numerous IoT objects being invented one after the other. Where and how many resources can be transferred to carry out tasks or applications is known as computation offloading. Transferring resource-...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Applied sciences Jg. 12; H. 16; S. 8232
Hauptverfasser: Heidari, Arash, Jabraeil Jamali, Mohammad Ali, Jafari Navimipour, Nima, Akbarpour, Shahin
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Basel MDPI AG 01.08.2022
Schlagworte:
ISSN:2076-3417, 2076-3417
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract The number of Internet of Things (IoT)-related innovations has recently increased exponentially, with numerous IoT objects being invented one after the other. Where and how many resources can be transferred to carry out tasks or applications is known as computation offloading. Transferring resource-intensive computational tasks to a different external device in the network, such as a cloud, fog, or edge platform, is the strategy used in the IoT environment. Besides, offloading is one of the key technological enablers of the IoT, as it helps overcome the resource limitations of individual objects. One of the major shortcomings of previous research is the lack of an integrated offloading framework that can operate in an offline/online environment while preserving security. This paper offers a new deep Q-learning approach to address the IoT-edge offloading enabled blockchain problem using the Markov Decision Process (MDP). There is a substantial gap in the secure online/offline offloading systems in terms of security, and no work has been published in this arena thus far. This system can be used online and offline while maintaining privacy and security. The proposed method employs the Post Decision State (PDS) mechanism in online mode. Additionally, we integrate edge/cloud platforms into IoT blockchain-enabled networks to encourage the computational potential of IoT devices. This system can enable safe and secure cloud/edge/IoT offloading by employing blockchain. In this system, the master controller, offloading decision, block size, and processing nodes may be dynamically chosen and changed to reduce device energy consumption and cost. TensorFlow and Cooja’s simulation results demonstrated that the method could dramatically boost system efficiency relative to existing schemes. The findings showed that the method beats four benchmarks in terms of cost by 6.6%, computational overhead by 7.1%, energy use by 7.9%, task failure rate by 6.2%, and latency by 5.5% on average.
AbstractList The number of Internet of Things (IoT)-related innovations has recently increased exponentially, with numerous IoT objects being invented one after the other. Where and how many resources can be transferred to carry out tasks or applications is known as computation offloading. Transferring resource-intensive computational tasks to a different external device in the network, such as a cloud, fog, or edge platform, is the strategy used in the IoT environment. Besides, offloading is one of the key technological enablers of the IoT, as it helps overcome the resource limitations of individual objects. One of the major shortcomings of previous research is the lack of an integrated offloading framework that can operate in an offline/online environment while preserving security. This paper offers a new deep Q-learning approach to address the IoT-edge offloading enabled blockchain problem using the Markov Decision Process (MDP). There is a substantial gap in the secure online/offline offloading systems in terms of security, and no work has been published in this arena thus far. This system can be used online and offline while maintaining privacy and security. The proposed method employs the Post Decision State (PDS) mechanism in online mode. Additionally, we integrate edge/cloud platforms into IoT blockchain-enabled networks to encourage the computational potential of IoT devices. This system can enable safe and secure cloud/edge/IoT offloading by employing blockchain. In this system, the master controller, offloading decision, block size, and processing nodes may be dynamically chosen and changed to reduce device energy consumption and cost. TensorFlow and Cooja’s simulation results demonstrated that the method could dramatically boost system efficiency relative to existing schemes. The findings showed that the method beats four benchmarks in terms of cost by 6.6%, computational overhead by 7.1%, energy use by 7.9%, task failure rate by 6.2%, and latency by 5.5% on average.
Author Jabraeil Jamali, Mohammad Ali
Akbarpour, Shahin
Jafari Navimipour, Nima
Heidari, Arash
Author_xml – sequence: 1
  givenname: Arash
  orcidid: 0000-0003-4279-8551
  surname: Heidari
  fullname: Heidari, Arash
– sequence: 2
  givenname: Mohammad Ali
  orcidid: 0000-0001-7687-5469
  surname: Jabraeil Jamali
  fullname: Jabraeil Jamali, Mohammad Ali
– sequence: 3
  givenname: Nima
  surname: Jafari Navimipour
  fullname: Jafari Navimipour, Nima
– sequence: 4
  givenname: Shahin
  surname: Akbarpour
  fullname: Akbarpour, Shahin
BookMark eNptkU1P8zAMxyMEEq8nvkAkjqiQly5rjzD2wKRJE2KcIydxRkZJStodnm9PxxBCCF9s2T__bdnHZD-miIScc3YlZc2uoW254KoSUuyRI8HGqpAlH-__iA_JWdet2WA1lxVnRyTfIbb0sZgj5Bjiii7RvsTwvkHqU6YL75sEblvYhiHi9SJuHZ2kt3bTQx9SpCHS2ybZV_sCIRbTCKZBR-8zYqSztCymboX0yWKEHFJ3Sg48NB2effkT8vxvupw8FPPF_WxyMy-sVGVfeFu7ihmmnDBSSMuFN95WVo3AQTk25QiqUV0JX6EVSjFVM-NVKYyHoaNGeUJmO12XYK3bHN4g_9cJgv5MpLzSkPtgG9QcEH1ZKgHGlQokjJwYs8oYiZ5JJweti51Wm9Nwm67X67TJcVhfD6DinCshBupyR9mcui6j_57Kmd7-SP_40UDzX7QNu4P2GULzZ88HDDyWpw
CitedBy_id crossref_primary_10_1038_s41598_025_99683_5
crossref_primary_10_3390_fire6040171
crossref_primary_10_3390_su15010209
crossref_primary_10_3390_app12178906
crossref_primary_10_1002_dac_5457
crossref_primary_10_1016_j_suscom_2025_101111
crossref_primary_10_3390_computation10120223
crossref_primary_10_3390_electronics11244137
crossref_primary_10_1016_j_tbench_2023_100085
crossref_primary_10_3390_electronics11233982
crossref_primary_10_1007_s10586_022_03738_5
crossref_primary_10_3390_app122211587
crossref_primary_10_1002_cpe_8050
crossref_primary_10_3390_app122211860
crossref_primary_10_1016_j_future_2024_05_041
crossref_primary_10_1016_j_suscom_2023_100920
crossref_primary_10_1145_3571728
crossref_primary_10_1007_s00607_024_01323_9
crossref_primary_10_1007_s11277_025_11769_5
crossref_primary_10_3390_su15075932
crossref_primary_10_1007_s11227_023_05210_6
crossref_primary_10_3390_app122110882
crossref_primary_10_1016_j_iot_2025_101626
crossref_primary_10_1007_s11277_025_11764_w
crossref_primary_10_1016_j_suscom_2025_101183
crossref_primary_10_1016_j_heliyon_2024_e32071
crossref_primary_10_1007_s13755_023_00212_3
crossref_primary_10_3390_su141911982
crossref_primary_10_1007_s11276_025_03932_4
crossref_primary_10_3390_electronics11213561
crossref_primary_10_1109_ACCESS_2023_3304332
crossref_primary_10_1007_s10586_024_04385_8
crossref_primary_10_1016_j_tsep_2025_103592
crossref_primary_10_1109_JIOT_2023_3237661
crossref_primary_10_1007_s11277_024_11694_z
crossref_primary_10_55343_CogSust_60
crossref_primary_10_1007_s00607_025_01493_0
crossref_primary_10_1007_s12083_024_01857_x
crossref_primary_10_1016_j_suscom_2023_100899
crossref_primary_10_1007_s10586_025_05562_z
crossref_primary_10_1016_j_suscom_2023_100859
crossref_primary_10_1007_s12083_024_01871_z
crossref_primary_10_3390_mi14071395
crossref_primary_10_2298_CSIS241123038L
crossref_primary_10_1109_JIOT_2023_3242613
crossref_primary_10_3390_app12189397
crossref_primary_10_1007_s10586_025_05467_x
crossref_primary_10_1109_TWC_2023_3335362
Cites_doi 10.1109/ACCESS.2020.2992639
10.1109/TGCN.2021.3083426
10.1109/JIOT.2021.3065583
10.1016/j.scs.2022.104089
10.1016/j.compbiomed.2022.105461
10.1049/cje.2021.00.295
10.1016/j.ipm.2021.102528
10.1109/JSAC.2021.3087232
10.1016/j.compbiomed.2021.105141
10.1109/TMTT.2022.3186326
10.1109/COMST.2020.2980570
10.1109/TVT.2021.3119429
10.1109/TIFS.2020.3014487
10.1109/ACCESS.2021.3052458
10.1109/JIOT.2021.3063188
10.1109/JIOT.2021.3081983
10.1080/02331934.2022.2057852
10.1007/s12083-018-0715-4
10.1109/TNSM.2020.3010967
10.1109/TNSE.2021.3057915
10.1109/TII.2019.2936869
10.1109/MNET.011.2000222
10.1016/j.inffus.2022.06.009
10.1109/JIOT.2020.3030646
10.1109/JIOT.2020.3033521
10.1109/WCNC.2018.8377343
10.1109/MCOM.2015.7081084
10.1016/j.ins.2021.05.009
10.1109/TSG.2016.2614988
10.1002/spe.2749
10.1016/j.ijepes.2021.107022
10.3390/app11031316
10.1109/JIOT.2020.3007518
10.1016/j.swevo.2021.100864
10.1016/j.enconman.2022.115466
10.1140/epjs/s11734-022-00558-x
10.1109/TCCN.2017.2725277
10.1007/s11265-022-01790-3
10.1109/TVT.2021.3058689
10.1109/JIOT.2018.2876279
10.1016/j.future.2018.07.049
10.1109/TEM.2020.2985379
10.1109/TMC.2020.2994955
10.1109/JIOT.2021.3095677
10.1109/TIP.2022.3192706
10.1109/TFUZZ.2020.3018191
10.1016/j.infsof.2021.106530
10.1109/TITS.2020.3040909
10.1109/TNNLS.2020.3042500
10.1109/TVT.2021.3130152
10.1109/JIOT.2021.3051060
10.1109/TWC.2021.3076201
10.1002/adts.202200047
10.1016/j.cie.2022.108228
10.1109/ACCESS.2021.3108178
10.1109/TCCN.2021.3066619
10.1109/JIOT.2021.3056656
10.1109/ACCESS.2021.3074937
10.1109/TMC.2019.2947468
10.1109/TCOMM.2021.3094581
10.1016/j.ymssp.2022.109148
10.1109/TITS.2021.3056461
10.1109/JIOT.2021.3057360
10.1109/JIOT.2019.2903191
ContentType Journal Article
Copyright 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml – notice: 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID AAYXX
CITATION
ABUWG
AFKRA
AZQEC
BENPR
CCPQU
COVID
DWQXO
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQQKQ
PQUKI
PRINS
DOA
DOI 10.3390/app12168232
DatabaseName CrossRef
ProQuest Central
ProQuest Central UK/Ireland
ProQuest Central Essentials
ProQuest Central
ProQuest One
Coronavirus Research Database
ProQuest Central
ProQuest Central Premium
ProQuest One Academic (New)
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central China
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
Coronavirus Research Database
ProQuest Central (Alumni Edition)
ProQuest One Community College
ProQuest Central China
ProQuest Central
ProQuest One Academic UKI Edition
ProQuest Central Korea
ProQuest Central (New)
ProQuest One Academic
ProQuest One Academic (New)
DatabaseTitleList CrossRef
Publicly Available Content Database

Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: PIMPY
  name: Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Sciences (General)
EISSN 2076-3417
ExternalDocumentID oai_doaj_org_article_1aeef4462abd46a3a5d2708bb3ef03d3
10_3390_app12168232
GroupedDBID .4S
2XV
5VS
7XC
8CJ
8FE
8FG
8FH
AADQD
AAFWJ
AAYXX
ADBBV
ADMLS
AFFHD
AFKRA
AFPKN
AFZYC
ALMA_UNASSIGNED_HOLDINGS
APEBS
ARCSS
BCNDV
BENPR
CCPQU
CITATION
CZ9
D1I
D1J
D1K
GROUPED_DOAJ
IAO
IGS
ITC
K6-
K6V
KC.
KQ8
L6V
LK5
LK8
M7R
MODMG
M~E
OK1
P62
PHGZM
PHGZT
PIMPY
PROAC
TUS
ABUWG
AZQEC
COVID
DWQXO
PKEHL
PQEST
PQQKQ
PQUKI
PRINS
ID FETCH-LOGICAL-c364t-fc9d80b06d2b323c12fbfc8c65ada47b45a85982f8ec2660690bf642bfad2b9e3
IEDL.DBID DOA
ISICitedReferencesCount 48
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000846970600001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2076-3417
IngestDate Fri Oct 03 12:46:38 EDT 2025
Mon Jun 30 07:30:23 EDT 2025
Sat Nov 29 07:12:48 EST 2025
Tue Nov 18 21:51:38 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 16
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c364t-fc9d80b06d2b323c12fbfc8c65ada47b45a85982f8ec2660690bf642bfad2b9e3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-4279-8551
0000-0001-7687-5469
OpenAccessLink https://doaj.org/article/1aeef4462abd46a3a5d2708bb3ef03d3
PQID 2706111622
PQPubID 2032433
ParticipantIDs doaj_primary_oai_doaj_org_article_1aeef4462abd46a3a5d2708bb3ef03d3
proquest_journals_2706111622
crossref_primary_10_3390_app12168232
crossref_citationtrail_10_3390_app12168232
PublicationCentury 2000
PublicationDate 2022-08-01
PublicationDateYYYYMMDD 2022-08-01
PublicationDate_xml – month: 08
  year: 2022
  text: 2022-08-01
  day: 01
PublicationDecade 2020
PublicationPlace Basel
PublicationPlace_xml – name: Basel
PublicationTitle Applied sciences
PublicationYear 2022
Publisher MDPI AG
Publisher_xml – name: MDPI AG
References Yuan (ref_33) 2020; 8
Wu (ref_37) 2021; 133
Chen (ref_41) 2018; 6
Hou (ref_7) 2021; 8
Aljanabi (ref_9) 2021; 9
Zhang (ref_17) 2021; 8
Kong (ref_4) 2020; 20
Qin (ref_14) 2022; 175
Heidari (ref_67) 2022; 145
Gao (ref_56) 2021; 5
Tefera (ref_13) 2021; 30
ref_53
Lakhan (ref_44) 2021; 22
Wang (ref_59) 2022; 31
Yu (ref_24) 2019; 20
ref_16
Li (ref_60) 2021; 71
Liu (ref_61) 2022; 169
Cao (ref_6) 2021; 63
Mutlag (ref_21) 2018; 90
Yan (ref_3) 2022; 86–87
Li (ref_62) 2017; 36
Xu (ref_47) 2019; 51
Luo (ref_48) 2021; 35
ref_69
Cao (ref_10) 2020; 22
Xu (ref_49) 2017; 3
ref_64
Pavithran (ref_25) 2021; 58
ref_63
Zhang (ref_18) 2020; 7
Ramanathan (ref_31) 2022; 69
Lv (ref_5) 2022; 18
Hu (ref_28) 2021; 8
Zhang (ref_32) 2019; 13
Zhou (ref_52) 2021; 39
Zhang (ref_55) 2019; 6
Li (ref_58) 2020; 22
Wang (ref_51) 2018; 9
Seid (ref_27) 2021; 8
Zuo (ref_35) 2021; 8
Dai (ref_36) 2022; 70
Zheng (ref_30) 2021; 9
Xia (ref_57) 2021; 20
Cao (ref_1) 2021; 9
Wu (ref_34) 2020; 8
ref_39
Yang (ref_19) 2021; 570
Li (ref_12) 2022; 258
Yan (ref_26) 2021; 9
Liu (ref_65) 2021; 69
Liu (ref_54) 2020; 29
Xu (ref_43) 2021; 131
Xu (ref_42) 2019; 16
Niu (ref_15) 2022; 31
Zhang (ref_11) 2021; 70
Zhao (ref_20) 2020; 16
Ale (ref_22) 2021; 7
Cao (ref_66) 2021; 8
Nguyen (ref_23) 2021; 8
Nguyen (ref_45) 2020; 17
ref_8
Heidari (ref_68) 2021; 141
Heidari (ref_2) 2022; 85
Sun (ref_29) 2022; 18
Manogaran (ref_46) 2021; 70
Bi (ref_50) 2015; 53
Yang (ref_40) 2020; 8
Sun (ref_38) 2020; 33
References_xml – volume: 8
  start-page: 92718
  year: 2020
  ident: ref_33
  article-title: Edge-Enabled WBANs for Efficient QoS Provisioning Healthcare Monitoring: A Two-Stage Potential Game-Based Computation Offloading Strategy
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2020.2992639
– volume: 5
  start-page: 1632
  year: 2021
  ident: ref_56
  article-title: An Integration of Online Learning and Online Control for Green Offloading in Fog-Assisted IoT Systems
  publication-title: IEEE Trans. Green Commun. Netw.
  doi: 10.1109/TGCN.2021.3083426
– volume: 9
  start-page: 5765
  year: 2021
  ident: ref_1
  article-title: Edge–Cloud Resource Scheduling in Space–Air–Ground-Integrated Networks for Internet of Vehicles
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2021.3065583
– volume: 85
  start-page: 104089
  year: 2022
  ident: ref_2
  article-title: Applications of ML/DL in the management of smart cities and societies based on new trends in information technologies: A systematic literature review
  publication-title: Sustain. Cities Soc.
  doi: 10.1016/j.scs.2022.104089
– volume: 145
  start-page: 105461
  year: 2022
  ident: ref_67
  article-title: A privacy-aware method for COVID-19 detection in chest CT images using lightweight deep conventional neural network and blockchain
  publication-title: Comput. Biol. Med.
  doi: 10.1016/j.compbiomed.2022.105461
– volume: 18
  start-page: 1
  year: 2022
  ident: ref_5
  article-title: Artificial Intelligence in Underwater Digital Twins Sensor Networks
  publication-title: ACM Trans. Sens. Netw.
– volume: 31
  start-page: 569
  year: 2022
  ident: ref_15
  article-title: 220 GHz Multi Circuit Integrated Front End Based on Solid-State Circuits for High Speed Communication System
  publication-title: Chin. J. Electron.
  doi: 10.1049/cje.2021.00.295
– volume: 58
  start-page: 102528
  year: 2021
  ident: ref_25
  article-title: Edge-Based Blockchain Architecture for Event-Driven IoT using Hierarchical Identity Based Encryption
  publication-title: Inf. Process. Manag.
  doi: 10.1016/j.ipm.2021.102528
– volume: 39
  start-page: 2445
  year: 2021
  ident: ref_52
  article-title: Incentive-Driven Deep Reinforcement Learning for Content Caching and D2D Offloading
  publication-title: IEEE J. Sel. Areas Commun.
  doi: 10.1109/JSAC.2021.3087232
– volume: 141
  start-page: 105141
  year: 2021
  ident: ref_68
  article-title: The COVID-19 epidemic analysis and diagnosis using deep learning: A systematic literature review and future directions
  publication-title: Comput. Biol. Med.
  doi: 10.1016/j.compbiomed.2021.105141
– volume: 70
  start-page: 3838
  year: 2022
  ident: ref_36
  article-title: A Novel Ultrawideband Branch Waveguide Coupler With Low Amplitude Imbalance
  publication-title: IEEE Trans. Microw. Theory Tech.
  doi: 10.1109/TMTT.2022.3186326
– volume: 22
  start-page: 796
  year: 2020
  ident: ref_58
  article-title: A Tutorial on Interference Exploitation via Symbol-Level Precoding: Overview, State-of-the-Art and Future Directions
  publication-title: IEEE Commun. Surv. Tutor.
  doi: 10.1109/COMST.2020.2980570
– volume: 70
  start-page: 13205
  year: 2021
  ident: ref_11
  article-title: Toward Concurrent Video Multicast Orchestration for Caching-Assisted Mobile Networks
  publication-title: IEEE Trans. Veh. Technol.
  doi: 10.1109/TVT.2021.3119429
– ident: ref_16
– volume: 16
  start-page: 521
  year: 2020
  ident: ref_20
  article-title: Smart and Practical Privacy-Preserving Data Aggregation for Fog-Based Smart Grids
  publication-title: IEEE Trans. Inf. Forensics Secur.
  doi: 10.1109/TIFS.2020.3014487
– volume: 9
  start-page: 13775
  year: 2021
  ident: ref_9
  article-title: Improving IoT Services Using a Hybrid Fog-Cloud Offloading
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2021.3052458
– volume: 8
  start-page: 12203
  year: 2021
  ident: ref_27
  article-title: Collaborative Computation Offloading and Resource Allocation in Multi-UAV-Assisted IoT Networks: A Deep Reinforcement Learning Approach
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2021.3063188
– volume: 8
  start-page: 17541
  year: 2021
  ident: ref_28
  article-title: Mobility-Aware Offloading and Resource Allocation in a MEC-Enabled IoT Network With Energy Harvesting
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2021.3081983
– ident: ref_64
  doi: 10.1080/02331934.2022.2057852
– volume: 30
  start-page: 100555
  year: 2021
  ident: ref_13
  article-title: Decentralized adaptive resource-aware computation offloading & caching for multi-access edge computing networks
  publication-title: Sustain. Comput. Inf. Syst.
– volume: 13
  start-page: 16
  year: 2019
  ident: ref_32
  article-title: Emergency-level-based healthcare information offloading over fog network
  publication-title: Peer-to-Peer Netw. Appl.
  doi: 10.1007/s12083-018-0715-4
– volume: 17
  start-page: 2536
  year: 2020
  ident: ref_45
  article-title: Privacy-Preserved Task Offloading in Mobile Blockchain With Deep Reinforcement Learning
  publication-title: IEEE Trans. Netw. Serv. Manag.
  doi: 10.1109/TNSM.2020.3010967
– volume: 8
  start-page: 2756
  year: 2021
  ident: ref_66
  article-title: Many-Objective Deployment Optimization for a Drone-Assisted Camera Network
  publication-title: IEEE Trans. Netw. Sci. Eng.
  doi: 10.1109/TNSE.2021.3057915
– volume: 16
  start-page: 4187
  year: 2019
  ident: ref_42
  article-title: BeCome: Blockchain-Enabled Computation Offloading for IoT in Mobile Edge Computing
  publication-title: IEEE Trans. Ind. Inf.
  doi: 10.1109/TII.2019.2936869
– volume: 35
  start-page: 124
  year: 2021
  ident: ref_48
  article-title: Blockchain-Based Task Offloading in Drone-Aided Mobile Edge Computing
  publication-title: IEEE Netw.
  doi: 10.1109/MNET.011.2000222
– volume: 86–87
  start-page: 104
  year: 2022
  ident: ref_3
  article-title: Radar sensor network resource allocation for fused target tracking: A brief review
  publication-title: Inf. Fusion
  doi: 10.1016/j.inffus.2022.06.009
– volume: 8
  start-page: 2318
  year: 2020
  ident: ref_40
  article-title: Energy-Efficient Resource Allocation for Blockchain-Enabled Industrial Internet of Things With Deep Reinforcement Learning
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2020.3030646
– volume: 8
  start-page: 2163
  year: 2020
  ident: ref_34
  article-title: EEDTO: An energy-efficient dynamic task offloading algorithm for blockchain-enabled IoT-edge-cloud orchestrated computing
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2020.3033521
– ident: ref_39
  doi: 10.1109/WCNC.2018.8377343
– volume: 53
  start-page: 117
  year: 2015
  ident: ref_50
  article-title: Wireless powered communication: Opportunities and challenges
  publication-title: IEEE Commun. Mag.
  doi: 10.1109/MCOM.2015.7081084
– volume: 570
  start-page: 526
  year: 2021
  ident: ref_19
  article-title: A privacy-preserving aggregation scheme based on negative survey for vehicle fuel consumption data
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2021.05.009
– volume: 9
  start-page: 2647
  year: 2018
  ident: ref_51
  article-title: Incentivizing Energy Trading for Interconnected Microgrids
  publication-title: IEEE Trans. Smart Grid
  doi: 10.1109/TSG.2016.2614988
– volume: 51
  start-page: 2015
  year: 2019
  ident: ref_47
  article-title: A blockchain-based computation offloading method for edge computing in 5G networks
  publication-title: Softw. Pract. Exp.
  doi: 10.1002/spe.2749
– volume: 131
  start-page: 107022
  year: 2021
  ident: ref_43
  article-title: Deep reinforcement learning assisted edge-terminal collaborative offloading algorithm of blockchain computing tasks for energy Internet
  publication-title: Int. J. Electr. Power Energy Syst.
  doi: 10.1016/j.ijepes.2021.107022
– ident: ref_53
  doi: 10.3390/app11031316
– volume: 7
  start-page: 10660
  year: 2020
  ident: ref_18
  article-title: PPO-CPQ: A Privacy-Preserving Optimization of Clinical Pathway Query for E-Healthcare Systems
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2020.3007518
– volume: 36
  start-page: 1
  year: 2017
  ident: ref_62
  article-title: Grass: Generative recursive autoencoders for shape structures
  publication-title: ACM Trans. Graph. (TOG)
– volume: 63
  start-page: 100864
  year: 2021
  ident: ref_6
  article-title: A memetic algorithm based on two_Arch2 for multi-depot heterogeneous-vehicle capacitated arc routing problem
  publication-title: Swarm Evol. Comput.
  doi: 10.1016/j.swevo.2021.100864
– volume: 258
  start-page: 115466
  year: 2022
  ident: ref_12
  article-title: Towards real-time self-powered sensing with ample redundant charges by a piezostack-based frequency-converted generator from human motions
  publication-title: Energy Convers. Manag.
  doi: 10.1016/j.enconman.2022.115466
– ident: ref_69
  doi: 10.1140/epjs/s11734-022-00558-x
– volume: 3
  start-page: 361
  year: 2017
  ident: ref_49
  article-title: Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing
  publication-title: IEEE Trans. Cogn. Commun. Netw.
  doi: 10.1109/TCCN.2017.2725277
– ident: ref_8
  doi: 10.1007/s11265-022-01790-3
– volume: 70
  start-page: 2404
  year: 2021
  ident: ref_46
  article-title: Artificial Intelligence and Blockchain-Assisted Offloading Approach for Data Availability Maximization in Edge Nodes
  publication-title: IEEE Trans. Veh. Technol.
  doi: 10.1109/TVT.2021.3058689
– volume: 6
  start-page: 4005
  year: 2018
  ident: ref_41
  article-title: Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement Learning
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2018.2876279
– volume: 90
  start-page: 62
  year: 2018
  ident: ref_21
  article-title: Enabling technologies for fog computing in healthcare IoT systems
  publication-title: Futur. Gener. Comput. Syst.
  doi: 10.1016/j.future.2018.07.049
– volume: 69
  start-page: 1417
  year: 2022
  ident: ref_31
  article-title: A New Perspective of E-Trust in the Era of Social Media: Insights From Customer Satisfaction Data
  publication-title: IEEE Trans. Eng. Manag.
  doi: 10.1109/TEM.2020.2985379
– volume: 20
  start-page: 3148
  year: 2020
  ident: ref_4
  article-title: Continuous Authentication Through Finger Gesture Interaction for Smart Homes Using WiFi
  publication-title: IEEE Trans. Mob. Comput.
  doi: 10.1109/TMC.2020.2994955
– volume: 8
  start-page: 16256
  year: 2021
  ident: ref_7
  article-title: Multiagent Deep Reinforcement Learning for Task Offloading and Resource Allocation in Cybertwin-Based Networks
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2021.3095677
– volume: 31
  start-page: 5257
  year: 2022
  ident: ref_59
  article-title: Extendable Multiple Nodes Recurrent Tracking Framework with RTU++
  publication-title: IEEE Trans. Image Process.
  doi: 10.1109/TIP.2022.3192706
– volume: 29
  start-page: 3308
  year: 2020
  ident: ref_54
  article-title: Multisource Heterogeneous Unsupervised Domain Adaptation via Fuzzy Relation Neural Networks
  publication-title: IEEE Trans. Fuzzy Syst.
  doi: 10.1109/TFUZZ.2020.3018191
– volume: 133
  start-page: 106530
  year: 2021
  ident: ref_37
  article-title: Improving high-impact bug report prediction with combination of interactive machine learning and active learning
  publication-title: Inf. Softw. Technol.
  doi: 10.1016/j.infsof.2021.106530
– volume: 18
  start-page: 1
  year: 2022
  ident: ref_29
  article-title: A Secure and Anonymous Communicate Scheme over the Internet of Things
  publication-title: ACM Trans. Sens. Netw.
– volume: 22
  start-page: 2133
  year: 2020
  ident: ref_10
  article-title: Diversified Personalized Recommendation Optimization Based on Mobile Data
  publication-title: IEEE Trans. Intell. Transp. Syst.
  doi: 10.1109/TITS.2020.3040909
– volume: 33
  start-page: 1467
  year: 2020
  ident: ref_38
  article-title: Representative Task Self-Selection for Flexible Clustered Lifelong Learning
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
  doi: 10.1109/TNNLS.2020.3042500
– volume: 71
  start-page: 269
  year: 2021
  ident: ref_60
  article-title: A Novel Learning Model of Driver Fatigue Features Representation for Steering Wheel Angle
  publication-title: IEEE Trans. Veh. Technol.
  doi: 10.1109/TVT.2021.3130152
– volume: 8
  start-page: 10830
  year: 2021
  ident: ref_17
  article-title: A Privacy-Preserving Optimization of Neighborhood-Based Recommendation for Medical-Aided Diagnosis and Treatment
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2021.3051060
– volume: 20
  start-page: 6743
  year: 2021
  ident: ref_57
  article-title: Online Distributed Offloading and Computing Resource Management With Energy Harvesting for Heterogeneous MEC-Enabled IoT
  publication-title: IEEE Trans. Wirel. Commun.
  doi: 10.1109/TWC.2021.3076201
– ident: ref_63
  doi: 10.1002/adts.202200047
– volume: 169
  start-page: 108228
  year: 2022
  ident: ref_61
  article-title: A novel hybrid multi-criteria group decision-making approach with intuitionistic fuzzy sets to design reverse supply chains for COVID-19 medical waste recycling channels
  publication-title: Comput. Ind. Eng.
  doi: 10.1016/j.cie.2022.108228
– volume: 9
  start-page: 123764
  year: 2021
  ident: ref_26
  article-title: Method of Reaching Consensus on Probability of Food Safety Based on the Integration of Finite Credible Data on Block Chain
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2021.3108178
– volume: 7
  start-page: 881
  year: 2021
  ident: ref_22
  article-title: Delay-Aware and Energy-Efficient Computation Offloading in Mobile-Edge Computing Using Deep Reinforcement Learning
  publication-title: IEEE Trans. Cogn. Commun. Netw.
  doi: 10.1109/TCCN.2021.3066619
– volume: 8
  start-page: 9084
  year: 2021
  ident: ref_35
  article-title: Blockchain Storage and Computation Offloading for Cooperative Mobile-Edge Computing
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2021.3056656
– volume: 9
  start-page: 91476
  year: 2021
  ident: ref_30
  article-title: Improving Visual Reasoning Through Semantic Representation
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2021.3074937
– volume: 20
  start-page: 337
  year: 2019
  ident: ref_24
  article-title: An Indirect Eavesdropping Attack of Keystrokes on Touch Screen through Acoustic Sensing
  publication-title: IEEE Trans. Mob. Comput.
  doi: 10.1109/TMC.2019.2947468
– volume: 69
  start-page: 6675
  year: 2021
  ident: ref_65
  article-title: DeepBAN: A Temporal Convolution-Based Communication Framework for Dynamic WBANs
  publication-title: IEEE Trans. Commun.
  doi: 10.1109/TCOMM.2021.3094581
– volume: 175
  start-page: 109148
  year: 2022
  ident: ref_14
  article-title: An adaptive hierarchical decomposition-based method for multi-step cutterhead torque forecast of shield machine
  publication-title: Mech. Syst. Signal Process.
  doi: 10.1016/j.ymssp.2022.109148
– volume: 22
  start-page: 4212
  year: 2021
  ident: ref_44
  article-title: Mobility Aware Blockchain Enabled Offloading and Scheduling in Vehicular Fog Cloud Computing
  publication-title: IEEE Trans. Intell. Transp. Syst.
  doi: 10.1109/TITS.2021.3056461
– volume: 8
  start-page: 9233
  year: 2021
  ident: ref_23
  article-title: Backscatter-Assisted Data Offloading in OFDMA-Based Wireless-Powered Mobile Edge Computing for IoT Networks
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2021.3057360
– volume: 6
  start-page: 7635
  year: 2019
  ident: ref_55
  article-title: Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics
  publication-title: IEEE Internet Things J.
  doi: 10.1109/JIOT.2019.2903191
SSID ssj0000913810
Score 2.4453726
Snippet The number of Internet of Things (IoT)-related innovations has recently increased exponentially, with numerous IoT objects being invented one after the other....
SourceID doaj
proquest
crossref
SourceType Open Website
Aggregation Database
Enrichment Source
Index Database
StartPage 8232
SubjectTerms Access to information
Algorithms
Blockchain
deep learning
Digital currencies
Efficiency
Employment
Energy consumption
Internet of Things
IoT
Offloading
Privacy
QoS
SummonAdditionalLinks – databaseName: Publicly Available Content Database
  dbid: PIMPY
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrZ3Pb9MwFMefRscBDvuNVhiTDz0AkrXYThPnNLHRaT1sFFGkcYr8s1SrktKU_f2zHbcMMe20W5Q4UqSv_Z6f897nAfS4SnLt_AYmmTY45WmKC80sFoxJkhORUNU2m8ivr_nNTTGK5dFNTKtc2cRgqFvas8_bdkb4RNfKn5if0Nz5IUIySk_nv7HvIeX_tcaGGi9g04O3kg5sjoZXo5_rMxfPwOQkacv0mIv2_V9iQknGKaP_OKbA7__PPAefc7H9vF-7A1tx74k-t5NlFzZMtQevHxAJ92A3rvUGfYhA6o_7sPhizBx9w5HFOkHjFfgVuS0v-mrtrA6p-OHSgzdagClqW0YE7dG0QmfOcd6qX2Ja4UEo2dIopP2gYT3GAz0x6LsylQve6-YAflwMxueXOPZqwIpl6RJbVWieyCTTVDLKFKFWWsVV1hdapLlM-4J7VqDlRrk9gecjS-tiH2mFe6Mw7A10qroyh4CEVson5EjDitQFsJIQbUzfUsq1LGTShU8roUoVQea-n8asdAGNV7V8oGoXeuvB85bf8fiwM6_4eoiHbocb9WJSxjVcEmGMdeEzFVKnmWCir52yXEpmbMI068LRajKU0RI05V_t3z79-B28or60IiQXHkFnufhj3sNLdbecNovjOJXvATI0BeE
  priority: 102
  providerName: ProQuest
Title Deep Q-Learning Technique for Offloading Offline/Online Computation in Blockchain-Enabled Green IoT-Edge Scenarios
URI https://www.proquest.com/docview/2706111622
https://doaj.org/article/1aeef4462abd46a3a5d2708bb3ef03d3
Volume 12
WOSCitedRecordID wos000846970600001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 2076-3417
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0000913810
  issn: 2076-3417
  databaseCode: DOA
  dateStart: 20110101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2076-3417
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0000913810
  issn: 2076-3417
  databaseCode: M~E
  dateStart: 20110101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 2076-3417
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0000913810
  issn: 2076-3417
  databaseCode: BENPR
  dateStart: 20110101
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Publicly Available Content Database
  customDbUrl:
  eissn: 2076-3417
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0000913810
  issn: 2076-3417
  databaseCode: PIMPY
  dateStart: 20110101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrZ3PS8MwFMcfoh70IDoV5y9y2EGFYJN0bXp0OnEH59QJeir5qUPpZJv-_SZpNyYKXry15ZWWvJe8funL5wE0uIpS7fIGJok2OOZxjDPNLBaMSZISEVFVNptIu13--Jj15lp9-ZqwEg9cDtwpEcZYp1mokDpOBBNNTdOIS8mMjZgOnM8ozebEVFiDM-LRVeWGPOZ0vf8fTChJOGX0WwoKpP4fC3HILpfrsFZ9FqKz8nU2YMEUNVidgwXWYKOahmN0VLGijzdhdGHMO7rFFSb1GfWnTFbkvkbRjbVvw1AlHw49E6Nki6Kym0NwCxoUqOVy2qt6EYMCt8NuKo1CRQ7qDPu4rZ8NulemcLp6ON6Ch8t2__wKV20UsGJJPMFWZZpHMko0lYwyRaiVVnGVNIUWcSrjpuAe42e5US5de3SxtE6WSCvcHZlh27BYDAuzA0hopXytjDQsi522lIRoY5qWUq5lJqM6nExHNlcVY9y3unjLndbwbsjn3FCHxsz4vURr_G7W8i6amXgedrjgoiSvoiT_K0rqsD91cF5N0nHuLBK31CeU7v7HM_Zghfq9EaE6cB8WJ6MPcwDL6nMyGI8OYanV7vbuDkOcurNe57r39AUnWO9c
linkProvider Directory of Open Access Journals
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3LbtNAFL0qKRJlAbSACBSYRZEAaYTnEXu8QIjSVI3ahiCC1K7MPNOIyg52APFTfCMzfoQiELsu2Fn22IuZ43vmce85ADtCR4nxvIFJbCzmgnOcGuawZEyRhMiI6sZsIhmPxclJOlmDH10tTEir7GJiHahNocMe-QuaeOYhJKb01eIzDq5R4XS1s9BoYHFov3_zS7bq5WjPj-8TSveH0zcHuHUVwJrFfImdTo2IVBQbqhhlmlCnnBY6HkgjeaL4QIqgaueE1Z69gpKvcn6Wrpz0b6SW-e9egXXuwR71YH0yOp6crnZ1gsqmIFFTCMhYGoVzaEJJLCijv1Ff7RDwBwHUrLZ_83_rj1two50_o9cN4DdhzeZbcP2CquIWbLbxqkJPW1HtZ7eh3LN2gd7hVk92hqadeC3y03b01rnzoi4nqC-DeEgjwooa24sav2ieo11P_p_0mZzneFiXnRlUpy6hUTHFQzOz6L22uSznRXUHPlxKT9yFXl7k9h4gabQOSUXKspT7RbgixFg7cJQKo1IV9eF5B4VMt2LswRPkPPOLsoCb7AJu-rCzarxoNEj-3mw3YGrVJAiH1zeKcpa1cSgj0lrHeUylMjyWTA6MR5JQilkXMcP6sN3BLWujWZX9wtr9fz9-DNcOpsdH2dFofPgANmgoFamTJbehtyy_2IdwVX9dzqvyUfvjIPh42dj8CTKvWVI
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3LjtMwFL0aOgjBApgBRGEALwYJkKyJH02cBUKUtqIaVAoUaXbBz1IxSkpSQPwaX4edRxkEYjcLdlHiZOEc34d97zkAh0JHifF-A5PYWMwF5zg1zGHJmCIJkRHVjdhEMpuJk5N0vgM_ul6YUFbZ2cTaUJtChz3yI5p4z0NITOmRa8si5qPJs_VnHBSkwklrJ6fRQOTYfv_m07fq6XTk__VDSifjxYuXuFUYwJrFfIOdTo2IVBQbqhhlmlCnnBY6HkgjeaL4QIrAcOeE1d6TBVZf5XzErpz0b6SW-e9egN2E-aSnB7vD8Wz-drvDExg3BYmapkDG0iicSRNKYkEZ_c0N1moBfziD2sNNrv3Pc3MdrrZxNXreLIQ92LH5Plw5w7a4D3utHavQo5Zs-_ENKEfWrtEb3PLMLtGiI7VFPpxHr507Leo2g_oykIo05KyokcOocY1WORr6oOCT_ihXOR7X7WgG1SVNaFos8NgsLXqnbS7LVVHdhPfnMhO3oJcXub0NSBqtQ7GRsizlPjlXhBhrB45SYVSqoj486WCR6ZakPWiFnGY-WQsYys5gqA-H28Hrhpvk78OGAV_bIYFQvL5RlMustU8ZkdY6zmMqleGxZHJgPKqEUsy6iBnWh4MOellr5arsF-7u_PvxA7jkAZm9ms6O78JlGjpI6hrKA-htyi_2HlzUXzerqrzfriEEH84bmj8BW-Zh7A
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Deep+Q-Learning+Technique+for+Offloading+Offline%2FOnline+Computation+in+Blockchain-Enabled+Green+IoT-Edge+Scenarios&rft.jtitle=Applied+sciences&rft.au=Arash+Heidari&rft.au=Mohammad+Ali+Jabraeil+Jamali&rft.au=Nima+Jafari+Navimipour&rft.au=Shahin+Akbarpour&rft.date=2022-08-01&rft.pub=MDPI+AG&rft.eissn=2076-3417&rft.volume=12&rft.issue=16&rft.spage=8232&rft_id=info:doi/10.3390%2Fapp12168232&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_1aeef4462abd46a3a5d2708bb3ef03d3
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2076-3417&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2076-3417&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2076-3417&client=summon