Transformer-Aided Wireless Image Transmission With Channel Feedback

This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called JSCCformer-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output feedback after each block. The proposed scheme employs a single...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IEEE transactions on wireless communications Ročník 23; číslo 9; s. 11904 - 11919
Hlavní autori: Wu, Haotian, Shao, Yulin, Ozfatura, Emre, Mikolajczyk, Krystian, Gunduz, Deniz
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: New York IEEE 01.09.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Predmet:
Broadcasting
Channel feedback
Coders
Codes
Decoding
Image acquisition
Image transmission
joint source-channel coding
Output feedback
Receivers
semantic communication
Semantics
Training
Transmitters
vision transformer
Wireless communication
ISSN:1536-1276, 1558-2248
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Abstract This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called JSCCformer-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output feedback after each block. The proposed scheme employs a single encoder to facilitate transmission over multiple blocks, refining the receiver's estimation at each block. Specifically, the unified encoder of JSCCformer-f can leverage the semantic information from the source image, and acquire channel state information and the decoder's current belief about the source image from the feedback signal to generate coded symbols at each block. Numerical experiments show that our JSCCformer-f scheme achieves state-of-the-art performance with robustness to noise in the feedback link. Additionally, JSCCformer-f can adapt to the channel condition directly through feedback without the need for separate channel estimation. We further extend the scope of the JSCCformer-f approach to include the broadcast channel, which enables the transmitter to generate broadcast codes in accordance with signal semantics and channel feedback from individual receivers.
AbstractList This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called JSCCformer-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output feedback after each block. The proposed scheme employs a single encoder to facilitate transmission over multiple blocks, refining the receiver's estimation at each block. Specifically, the unified encoder of JSCCformer-f can leverage the semantic information from the source image, and acquire channel state information and the decoder's current belief about the source image from the feedback signal to generate coded symbols at each block. Numerical experiments show that our JSCCformer-f scheme achieves state-of-the-art performance with robustness to noise in the feedback link. Additionally, JSCCformer-f can adapt to the channel condition directly through feedback without the need for separate channel estimation. We further extend the scope of the JSCCformer-f approach to include the broadcast channel, which enables the transmitter to generate broadcast codes in accordance with signal semantics and channel feedback from individual receivers.
Author Shao, Yulin
Gunduz, Deniz
Wu, Haotian
Mikolajczyk, Krystian
Ozfatura, Emre
Author_xml – sequence: 1
  givenname: Haotian
  orcidid: 0000-0003-2137-6907
  surname: Wu
  fullname: Wu, Haotian
  email: haotian.wu17@imperial.ac.uk
  organization: Department of Electrical and Electronic Engineering, Imperial College London, London, U.K
– sequence: 2
  givenname: Yulin
  orcidid: 0000-0002-6300-3175
  surname: Shao
  fullname: Shao, Yulin
  email: ylshao@um.edu.mo
  organization: Department of Electrical and Computer Engineering, State Key Laboratory of Internet of Things for Smart City, University of Macau, Macau, SAR, China
– sequence: 3
  givenname: Emre
  orcidid: 0000-0002-6974-5671
  surname: Ozfatura
  fullname: Ozfatura, Emre
  email: m.ozfatura@imperial.ac.uk
  organization: Department of Electrical and Electronic Engineering, Imperial College London, London, U.K
– sequence: 4
  givenname: Krystian
  surname: Mikolajczyk
  fullname: Mikolajczyk, Krystian
  email: k.mikolajczyk@imperial.ac.uk
  organization: Department of Electrical and Electronic Engineering, Imperial College London, London, U.K
– sequence: 5
  givenname: Deniz
  orcidid: 0000-0002-7725-395X
  surname: Gunduz
  fullname: Gunduz, Deniz
  email: d.gunduz@imperial.ac.uk
  organization: Department of Electrical and Electronic Engineering, Imperial College London, London, U.K
BookMark eNp9kDFPwzAQRi1UJFpgZ2CIxJxytmPHGauIQqVKLEUdLce-UJc0KXY68O9JaQfEwHQn3ffuTm9CRm3XIiF3FKaUQvG4WpdTBiybcq4kCHZBxlQIlTKWqdGx5zKlLJdXZBLjFoDmUogxKVfBtLHuwg5DOvMOXbL2ARuMMVnszDsmP4Gdj9F37TDrN0m5MW2LTTJHdJWxHzfksjZNxNtzvSZv86dV-ZIuX58X5WyZWlawPq0RKl4XEmomrMpoBjl1tCrQoQHpuLI5Y7KqbMalolYJB2gLpI67zLmq4Nfk4bR3H7rPA8Zeb7tDaIeTmlNgRZ5JJYaUPKVs6GIMWGvre9MP3_fB-EZT0EdhehCmj8L0WdgAwh9wH_zOhK__kPsT4hHxV1wAcBD8G04id8M
CODEN ITWCAX
CitedBy_id crossref_primary_10_1109_LCOMM_2025_3568427
crossref_primary_10_1109_LWC_2024_3515656
crossref_primary_10_1109_OJCOMS_2025_3594545
crossref_primary_10_1109_TMLCN_2025_3595841
crossref_primary_10_1109_JIOT_2025_3532484
crossref_primary_10_1109_JSAC_2025_3559149
crossref_primary_10_1109_LWC_2025_3526962
crossref_primary_10_1109_TWC_2024_3422794
Cites_doi 10.1109/TIT.1966.1053880
10.1109/TCSVT.2021.3082521
10.1109/JSAC.2022.3191326
10.1109/TCCN.2019.2919300
10.1109/LSP.2021.3113827
10.1109/LWC.2022.3204837
10.1109/JSAC.2022.3180802
10.1109/CVPR46437.2021.00681
10.1109/JSAIT.2022.3223901
10.1109/DCC.2002.999943
10.1109/MCOM.001.2001239
10.1109/JSAIT.2020.2986752
10.1109/ICASSP49357.2023.10094735
10.1109/JSAC.2021.3126087
10.1109/TIT.1967.1054047
10.1109/JSAC.2020.3036955
10.1109/ACCESS.2023.3291405
10.1109/TWC.2023.3265201
10.1109/ICASSP40776.2020.9053850
10.1109/PROC.1967.5747
10.1109/JSAC.2023.3288243
10.1109/18.720547
10.1109/JSAC.2022.3223408
10.1109/TCOMM.2023.3280563
10.1109/TIT.1956.1056798
10.1109/TCCN.2022.3151935
10.1109/DCC.1999.755663
10.1109/DCC.2000.838184
10.1109/ACSSC.1998.750824
10.1109/CVPR.2018.00068
10.1109/twc.2024.3386052
10.1002/0471200611
10.1109/TWC.2021.3090048
10.1109/TIT.1984.1056923
10.1109/LWC.2023.3256006
10.1109/MMSP.1998.739041
10.1109/JSAIT.2020.2987203
10.1109/LWC.2022.3232946
10.1109/TIP.2005.846028
10.1109/ICC45041.2023.10278812
10.1109/ICC45041.2023.10278839
10.1137/1103031
10.1002/j.1538-7305.1948.tb01338.x
10.1109/TIT.2017.2674667
10.1109/JSAC.2022.3191354
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/TWC.2024.3386052
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE/IET Electronic Library
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1558-2248
EndPage 11919
ExternalDocumentID 10_1109_TWC_2024_3386052
10500305
Genre orig-research
GrantInformation_xml – fundername: UKRI for the projects AI-R (ERC Consolidator Grant)
  grantid: EP/X030806/1
– fundername: SONATA
  grantid: EPSRC-EP/W035960/1
– fundername: SNS JU Project 6G-GOALS under the EU’s Horizon Program
  grantid: 101139232
GroupedDBID -~X
0R~
29I
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACGFS
ACIWK
AENEX
AETIX
AGQYO
AGSQL
AHBIQ
AIBXA
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
EJD
HZ~
H~9
IES
IFIPE
IPLJI
JAVBF
LAI
M43
O9-
OCL
P2P
RIA
RIE
RNS
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c292t-fe0b3f960f25c8414071d1b9edea06d38c7226bbc43681c85d0ec9e1d3d4ddb93
IEDL.DBID RIE
ISICitedReferencesCount 14
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001312963400127&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1536-1276
IngestDate Fri Jul 25 18:54:43 EDT 2025
Tue Nov 18 22:18:54 EST 2025
Sat Nov 29 06:24:00 EST 2025
Wed Aug 27 02:01:27 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 9
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c292t-fe0b3f960f25c8414071d1b9edea06d38c7226bbc43681c85d0ec9e1d3d4ddb93
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-2137-6907
0000-0002-6300-3175
0000-0002-6974-5671
0000-0002-7725-395X
PQID 3102974685
PQPubID 105736
PageCount 16
ParticipantIDs ieee_primary_10500305
crossref_citationtrail_10_1109_TWC_2024_3386052
proquest_journals_3102974685
crossref_primary_10_1109_TWC_2024_3386052
PublicationCentury 2000
PublicationDate 2024-09-01
PublicationDateYYYYMMDD 2024-09-01
PublicationDate_xml – month: 09
  year: 2024
  text: 2024-09-01
  day: 01
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on wireless communications
PublicationTitleAbbrev TWC
PublicationYear 2024
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref14
ref11
ref10
Chu (ref37); 34
ref17
ref16
ref19
ref18
Krizhevsky (ref44) 2009
ref50
ref46
ref45
ref48
ref47
ref42
ref41
ref43
ref49
ref8
ref7
ref9
ref4
ref3
ref6
ref5
ref40
Wu (ref15) 2023
Chande (ref25)
ref35
ref34
ref31
ref30
ref33
ref32
ref2
ref1
ref39
ref38
ref24
ref23
ref26
ref20
ref22
ref21
ref28
ref27
ref29
Dosovitskiy (ref36)
References_xml – ident: ref22
  doi: 10.1109/TIT.1966.1053880
– ident: ref33
  doi: 10.1109/TCSVT.2021.3082521
– ident: ref16
  doi: 10.1109/JSAC.2022.3191326
– ident: ref4
  doi: 10.1109/TCCN.2019.2919300
– ident: ref11
  doi: 10.1109/LSP.2021.3113827
– ident: ref34
  doi: 10.1109/LWC.2022.3204837
– ident: ref13
  doi: 10.1109/JSAC.2022.3180802
– ident: ref35
  doi: 10.1109/CVPR46437.2021.00681
– ident: ref38
  doi: 10.1109/JSAIT.2022.3223901
– ident: ref30
  doi: 10.1109/DCC.2002.999943
– ident: ref40
  doi: 10.1109/MCOM.001.2001239
– ident: ref45
  doi: 10.1109/JSAIT.2020.2986752
– ident: ref12
  doi: 10.1109/ICASSP49357.2023.10094735
– ident: ref17
  doi: 10.1109/JSAC.2021.3126087
– ident: ref23
  doi: 10.1109/TIT.1967.1054047
– ident: ref1
  doi: 10.1109/JSAC.2020.3036955
– ident: ref5
  doi: 10.1109/ACCESS.2023.3291405
– ident: ref8
  doi: 10.1109/TWC.2023.3265201
– ident: ref18
  doi: 10.1109/ICASSP40776.2020.9053850
– ident: ref46
  doi: 10.1109/PROC.1967.5747
– ident: ref47
  doi: 10.1109/JSAC.2023.3288243
– ident: ref49
  doi: 10.1109/18.720547
– volume-title: Proc. IEEE Inf. Theory Workshop
  ident: ref25
  article-title: Joint source-channel coding of images for channels with feedback
– year: 2009
  ident: ref44
  article-title: Learning multiple layers of features from tiny images
– ident: ref39
  doi: 10.1109/JSAC.2022.3223408
– volume: 34
  start-page: 9355
  volume-title: Proc. Adv. Neural Inf. Process. Syst.
  ident: ref37
  article-title: Twins: Revisiting the design of spatial attention in vision transformers
– ident: ref43
  doi: 10.1109/TCOMM.2023.3280563
– ident: ref20
  doi: 10.1109/TIT.1956.1056798
– ident: ref6
  doi: 10.1109/TCCN.2022.3151935
– ident: ref26
  doi: 10.1109/DCC.1999.755663
– ident: ref29
  doi: 10.1109/DCC.2000.838184
– ident: ref27
  doi: 10.1109/ACSSC.1998.750824
– year: 2023
  ident: ref15
  article-title: Features-over-the-air: Contrastive learning enabled cooperative edge inference
  publication-title: arXiv:2304.08221
– ident: ref41
  doi: 10.1109/CVPR.2018.00068
– ident: ref42
  doi: 10.1109/twc.2024.3386052
– ident: ref19
  doi: 10.1002/0471200611
– ident: ref10
  doi: 10.1109/TWC.2021.3090048
– ident: ref48
  doi: 10.1109/TIT.1984.1056923
– ident: ref2
  doi: 10.1109/LWC.2023.3256006
– ident: ref28
  doi: 10.1109/MMSP.1998.739041
– ident: ref7
  doi: 10.1109/JSAIT.2020.2987203
– ident: ref9
  doi: 10.1109/LWC.2022.3232946
– ident: ref31
  doi: 10.1109/TIP.2005.846028
– volume-title: Proc. ICLR
  ident: ref36
  article-title: An image is worth 16 × 16 words: Transformers for image recognition at scale
– ident: ref32
  doi: 10.1109/ICC45041.2023.10278812
– ident: ref50
  doi: 10.1109/ICC45041.2023.10278839
– ident: ref21
  doi: 10.1137/1103031
– ident: ref3
  doi: 10.1002/j.1538-7305.1948.tb01338.x
– ident: ref24
  doi: 10.1109/TIT.2017.2674667
– ident: ref14
  doi: 10.1109/JSAC.2022.3191354
SSID ssj0017655
Score 2.5866275
Snippet This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called JSCCformer-f. We consider a block feedback...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 11904
SubjectTerms Broadcasting
Channel feedback
Coders
Codes
Decoding
Image acquisition
Image transmission
joint source-channel coding
Output feedback
Receivers
semantic communication
Semantics
Training
Transmitters
vision transformer
Wireless communication
Title Transformer-Aided Wireless Image Transmission With Channel Feedback
URI https://ieeexplore.ieee.org/document/10500305
https://www.proquest.com/docview/3102974685
Volume 23
WOSCitedRecordID wos001312963400127&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE/IET Electronic Library
  customDbUrl:
  eissn: 1558-2248
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0017655
  issn: 1536-1276
  databaseCode: RIE
  dateStart: 20020101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fS8MwEA46fNAHf06cTumDLz50S9MmaR7HcCjI8GHq3sqSXHE4N9k6_34vaTcmouBbobkSvuvlvktyd4Rcp1wCeg0emkjwMOEKbY6CCOMkTbg1VjHfkuX5Qfb76XCoHqtkdZ8LAwD-8hm03KM_y7czs3RbZWjh3HPebbItpSiTtdZHBlL4Fqdowa6xjFyfSVLVHrx0MRJkSQvjMaTv7JsP8k1VfqzE3r30Dv45sUOyX_HIoFMq_ohswfSY7G1UFzwh3cGKlMI87Iwt2MDddZ3g2hbcv-M6EvgBqGi3Y4bvitfAJRtMYRL00KnpkXmrk6fe7aB7F1Y9E0LDFCvCHKiOcwxLcsZNmkQuXrORVmBhRIWNUyORcGltXOX5yKTcUjAKIhvbxFqt4lNSm86mcEaCyBiUFmKEJCyBONZaMKAypxCJlJuoQdorFDNTFRR3fS0mmQ8sqMoQ98zhnlW4N8jNWuKjLKbxx9i6w3ljXAlxgzRXmsoqc1tkyFEZBkY4rfNfxC7Irvt6eTusSWrFfAmXZMd8FuPF_Mr_SV8VacOB
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LT8MwDLZgIAEHnkOMZw9cOBTSNGmb4zQxbWJMHMbjVq2JJybGhvbg9-Ok3TSEQOJWqbEafa7jz0lsA1wmMkbyGtLXQSR9IRXZHMPID0UipNFGcdeS5akVt9vJy4t6KJLVXS4MIrrLZ3htH91Zvhnpmd0qIwuXjvOuwpoUgrM8XWtxaBBHrskp2bBtLRMvTiWZuuk81ygW5OKaIjIi8PybF3JtVX6sxc7B1Hf-ObVd2C6YpFfNVb8HKzjch62l-oIHUOvMaSmO_WrfoPHsbdcBrW5e851WEs8NIFXbPTN6N331bLrBEAdendxa1tVvZXis33ZqDb_omuBrrvjU7yHLwh4FJj0udSICG7GZIFNosMsiEyY6JsqVZdrWng90Ig1DrTAwoRHGZCo8hNJwNMQj8AKtSTqKukTDBIZhlkUcWdxjGESJ1EEFbuYoprooKW47WwxSF1owlRLuqcU9LXCvwNVC4iMvp_HH2LLFeWlcDnEFTueaSguDm6TEUjmFRjSt41_ELmCj0blvpa1m--4ENu2X8rtip1Cajmd4Buv6c9qfjM_dX_UFbR3GyA
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Transformer-Aided+Wireless+Image+Transmission+With+Channel+Feedback&rft.jtitle=IEEE+transactions+on+wireless+communications&rft.au=Wu%2C+Haotian&rft.au=Shao%2C+Yulin&rft.au=Ozfatura%2C+Emre&rft.au=Mikolajczyk%2C+Krystian&rft.date=2024-09-01&rft.issn=1536-1276&rft.eissn=1558-2248&rft.volume=23&rft.issue=9&rft.spage=11904&rft.epage=11919&rft_id=info:doi/10.1109%2FTWC.2024.3386052&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TWC_2024_3386052
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1536-1276&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1536-1276&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1536-1276&client=summon