Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Communication systems to date primarily aim at reliably communicating bit sequences. Such an approach provides efficient engineering designs that are agnostic to the meanings of the messages or to the goal that the message exchange aims to achieve. Next generation systems, however, can be potentiall...
Saved in:
| Published in: | IEEE journal on selected areas in communications Vol. 41; no. 1; p. 1 |
|---|---|
| Main Authors: | , , , , , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
New York
IEEE
01.01.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Subjects: | |
| ISSN: | 0733-8716, 1558-0008 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | Communication systems to date primarily aim at reliably communicating bit sequences. Such an approach provides efficient engineering designs that are agnostic to the meanings of the messages or to the goal that the message exchange aims to achieve. Next generation systems, however, can be potentially enriched by folding message semantics and goals of communication into their design. Further, these systems can be made cognizant of the context in which communication exchange takes place, thereby providing avenues for novel design insights. This tutorial summarizes the efforts to date, starting from its early adaptations, semantic-aware and task-oriented communications, covering the foundations, algorithms and potential implementations. The focus is on approaches that utilize information theory to provide the foundations, as well as the significant role of learning in semantics and task-aware communications. |
|---|---|
| AbstractList | Communication systems to date primarily aim at reliably communicating bit sequences. Such an approach provides efficient engineering designs that are agnostic to the meanings of the messages or to the goal that the message exchange aims to achieve. Next generation systems, however, can be potentially enriched by folding message semantics and goals of communication into their design. Further, these systems can be made cognizant of the context in which communication exchange takes place, thereby providing avenues for novel design insights. This tutorial summarizes the efforts to date, starting from its early adaptations, semantic-aware and task-oriented communications, covering the foundations, algorithms and potential implementations. The focus is on approaches that utilize information theory to provide the foundations, as well as the significant role of learning in semantics and task-aware communications. |
| Author | Yang, Zhaohui Qin, Zhijin Dhillon, Harpreet S. Aguerri, Inaki Estella Gunduz, Deniz Wong, Kai Kit Yener, Aylin Chae, Chan-Byoung |
| Author_xml | – sequence: 1 givenname: Deniz orcidid: 0000-0002-7725-395X surname: Gunduz fullname: Gunduz, Deniz organization: Department of Electrical and Electronic Engineering, Imperial College London, London, U.K – sequence: 2 givenname: Zhijin orcidid: 0000-0002-8507-3975 surname: Qin fullname: Qin, Zhijin organization: Department of Electronic Engineering, Tsinghua University, Beijing, China – sequence: 3 givenname: Inaki Estella orcidid: 0000-0001-5110-6858 surname: Aguerri fullname: Aguerri, Inaki Estella organization: Amazon, Barcelona, Spain – sequence: 4 givenname: Harpreet S. orcidid: 0000-0003-2829-9449 surname: Dhillon fullname: Dhillon, Harpreet S. organization: Bradley Department of ECE, Virginia Tech, Wireless@Virginia Tech, Blacksburg, VA, USA – sequence: 5 givenname: Zhaohui surname: Yang fullname: Yang, Zhaohui organization: Zhejiang Lab, Hangzhou, China – sequence: 6 givenname: Aylin orcidid: 0000-0003-0820-3390 surname: Yener fullname: Yener, Aylin organization: Department of Electrical and Computer Engineering, The Ohio State University, OH, USA – sequence: 7 givenname: Kai Kit orcidid: 0000-0001-7521-0078 surname: Wong fullname: Wong, Kai Kit organization: Department of Electronic and Electrical Engineering, University College London, London, U.K – sequence: 8 givenname: Chan-Byoung orcidid: 0000-0001-9561-3341 surname: Chae fullname: Chae, Chan-Byoung organization: School of Integrated Technology, Yonsei University, Seoul, Korea |
| BookMark | eNp9kD1PwzAURS1UJNrCD0AskVib4o84sdnaiE9VdGiZLcexkUvjFNuV6L8noYiBgekN95739M4IDFzrNACXCE4RgvzmeTUrpxhiPCUYkwyyEzBElLIUQsgGYAgLQlJWoPwMjELYQIiyjOEheJnrQ-vqZO2lC42N0bq3ZG5juE3K1kX9GSfJSjfSRavCJJF9VYb3dOmt7uK6azXN3lklo21dOAenRm6DvviZY_B6f7cuH9PF8uGpnC1SRSiPKapkUeWUZZIRnJuc0ULXpmKVqkmuSI15TQwn0uiCZlWX4AphLpXJIJScV2QMro97d7792OsQxabde9edFLhDOGU4y7sWOraUb0Pw2oidt430B4Gg6LWJXpvotYkfbR1T_GGUjd_PRS_t9l_y6kharfXvJc4ppZiSL1hSfK0 |
| CODEN | ISACEM |
| CitedBy_id | crossref_primary_10_1109_LCOMM_2025_3538486 crossref_primary_10_1109_TCOMM_2024_3385922 crossref_primary_10_1109_LCOMM_2023_3327412 crossref_primary_10_1109_TCCN_2024_3465651 crossref_primary_10_1109_LWC_2022_3232946 crossref_primary_10_1109_TCOMM_2023_3343787 crossref_primary_10_1109_TVT_2024_3523674 crossref_primary_10_1109_TCOMM_2024_3386577 crossref_primary_10_1109_TWC_2025_3552255 crossref_primary_10_1109_COMST_2024_3412852 crossref_primary_10_1109_TMC_2024_3478048 crossref_primary_10_1109_JSAC_2024_3369654 crossref_primary_10_3390_e26050394 crossref_primary_10_1109_JIOT_2025_3581393 crossref_primary_10_1109_JSAC_2025_3559120 crossref_primary_10_1109_LCOMM_2023_3288070 crossref_primary_10_3390_s25010269 crossref_primary_10_1109_MBITS_2024_3504521 crossref_primary_10_1109_TCCN_2024_3422496 crossref_primary_10_1109_JIOT_2025_3555437 crossref_primary_10_1109_MCOM_001_2400546 crossref_primary_10_1109_JSAC_2025_3559113 crossref_primary_10_1007_s11432_024_4408_1 crossref_primary_10_1109_JSAC_2025_3559115 crossref_primary_10_1109_TCOMM_2024_3507636 crossref_primary_10_1109_TVT_2024_3442204 crossref_primary_10_1109_TWC_2024_3480352 crossref_primary_10_1109_TCCN_2023_3315386 crossref_primary_10_1109_JIOT_2025_3528937 crossref_primary_10_1109_TCCN_2024_3375506 crossref_primary_10_1109_TWC_2024_3497593 crossref_primary_10_1109_JSTSP_2024_3511403 crossref_primary_10_1109_JSAC_2025_3531575 crossref_primary_10_1109_TVT_2024_3521948 crossref_primary_10_1109_COMST_2024_3427324 crossref_primary_10_1109_ACCESS_2025_3584000 crossref_primary_10_1109_LCOMM_2025_3568427 crossref_primary_10_1109_TIT_2023_3296154 crossref_primary_10_1016_j_jfranklin_2024_106926 crossref_primary_10_1109_LCOMM_2025_3542293 crossref_primary_10_1109_TNET_2024_3464540 crossref_primary_10_3390_e27040429 crossref_primary_10_1109_COMST_2024_3416309 crossref_primary_10_1109_TCCN_2025_3567613 crossref_primary_10_1109_TWC_2025_3554442 crossref_primary_10_1109_TWC_2024_3415363 crossref_primary_10_1140_epjp_s13360_025_06520_9 crossref_primary_10_1109_TCSVT_2025_3539226 crossref_primary_10_1109_TBC_2025_3559003 crossref_primary_10_1109_TCOMM_2023_3274122 crossref_primary_10_1016_j_phycom_2024_102568 crossref_primary_10_1109_MBITS_2024_3491949 crossref_primary_10_1109_TCCN_2024_3435524 crossref_primary_10_1109_MCOM_006_2200878 crossref_primary_10_1016_j_iot_2024_101384 crossref_primary_10_1109_JSTSP_2023_3304140 crossref_primary_10_1109_TCOMM_2024_3485572 crossref_primary_10_3390_electronics12081908 crossref_primary_10_1016_j_jfranklin_2024_106873 crossref_primary_10_1109_JPROC_2024_3434700 crossref_primary_10_1109_TCOMM_2024_3400912 crossref_primary_10_1016_j_phycom_2025_102832 crossref_primary_10_1109_JSAC_2023_3288242 crossref_primary_10_1109_TCOMM_2024_3511935 crossref_primary_10_1109_JSAC_2023_3288243 crossref_primary_10_1109_LCOMM_2024_3391909 crossref_primary_10_1109_JSAC_2024_3431522 crossref_primary_10_1109_MWC_007_2300503 crossref_primary_10_1109_TVT_2023_3333350 crossref_primary_10_1109_JSAC_2023_3288246 crossref_primary_10_1109_LCOMM_2024_3389709 crossref_primary_10_1109_JIOT_2023_3347234 crossref_primary_10_1109_TWC_2024_3422794 crossref_primary_10_1109_COMST_2024_3380901 crossref_primary_10_1109_TMC_2025_3558793 crossref_primary_10_1016_j_iot_2024_101393 crossref_primary_10_3390_technologies13040137 crossref_primary_10_1109_JIOT_2024_3409271 crossref_primary_10_1109_JPROC_2024_3476675 crossref_primary_10_1109_MNET_2024_3414144 crossref_primary_10_1109_JSAC_2025_3536557 crossref_primary_10_1109_TII_2024_3441626 crossref_primary_10_1109_ACCESS_2025_3546514 crossref_primary_10_1109_JIOT_2025_3571962 crossref_primary_10_1109_TWC_2024_3424493 crossref_primary_10_1109_JIOT_2024_3440313 crossref_primary_10_1109_TCOMM_2024_3484939 crossref_primary_10_1109_TWC_2024_3386052 crossref_primary_10_1109_JSAC_2024_3365872 crossref_primary_10_1109_JIOT_2025_3553504 crossref_primary_10_1109_TCCN_2024_3520132 crossref_primary_10_1109_TVT_2024_3373812 crossref_primary_10_1109_JSAC_2025_3574587 crossref_primary_10_1109_LWC_2024_3451139 crossref_primary_10_3390_electronics12132755 crossref_primary_10_1109_JPROC_2024_3409428 crossref_primary_10_1109_TMC_2024_3483272 crossref_primary_10_1109_TCOMM_2024_3471992 crossref_primary_10_1109_COMST_2023_3300664 crossref_primary_10_1109_JSAC_2023_3288268 crossref_primary_10_1109_MNET_2024_3414396 crossref_primary_10_1109_MWC_006_2200494 crossref_primary_10_1016_j_phycom_2024_102555 crossref_primary_10_1109_LCOMM_2024_3450598 crossref_primary_10_1109_TWC_2024_3483314 crossref_primary_10_1109_JSAC_2025_3531546 crossref_primary_10_1109_TCCN_2024_3510586 crossref_primary_10_1109_TIFS_2025_3534562 crossref_primary_10_1073_pnas_2502353122 crossref_primary_10_1109_TIT_2024_3452976 crossref_primary_10_1109_MNET_2024_3425152 crossref_primary_10_1109_LCOMM_2025_3544882 crossref_primary_10_1109_TWC_2024_3371775 crossref_primary_10_1109_ACCESS_2023_3291405 crossref_primary_10_1109_TCOMM_2025_3538850 crossref_primary_10_1109_TWC_2024_3461336 crossref_primary_10_1109_OJCOMS_2025_3598312 crossref_primary_10_1109_TCOMM_2025_3535903 crossref_primary_10_1109_OJCOMS_2025_3605737 crossref_primary_10_1109_TWC_2025_3543373 crossref_primary_10_1109_ACCESS_2023_3326718 crossref_primary_10_1109_TWC_2024_3525087 crossref_primary_10_1109_JIOT_2024_3433431 crossref_primary_10_1109_JIOT_2025_3579582 crossref_primary_10_1109_LCOMM_2025_3565692 crossref_primary_10_1109_TSP_2025_3546458 crossref_primary_10_1016_j_comnet_2025_111463 crossref_primary_10_1109_LWC_2024_3520660 crossref_primary_10_1109_JPROC_2024_3437730 crossref_primary_10_1109_TCOMM_2025_3529221 crossref_primary_10_1109_ACCESS_2025_3602059 crossref_primary_10_1109_TCCN_2024_3424842 crossref_primary_10_1109_TWC_2023_3312115 crossref_primary_10_1109_ACCESS_2025_3593341 crossref_primary_10_1109_JIOT_2023_3342032 crossref_primary_10_1109_TCCN_2024_3394867 crossref_primary_10_1109_OJCOMS_2025_3570446 crossref_primary_10_1109_TSG_2024_3370822 crossref_primary_10_1109_LWC_2023_3256006 crossref_primary_10_1109_TWC_2024_3432918 crossref_primary_10_1109_LCOMM_2023_3293805 crossref_primary_10_1109_TMLCN_2025_3595841 crossref_primary_10_1109_JIOT_2024_3493611 crossref_primary_10_1109_TCOMM_2024_3447870 crossref_primary_10_1007_s11760_025_03826_0 crossref_primary_10_1109_ACCESS_2025_3532797 crossref_primary_10_1109_LWC_2024_3429295 crossref_primary_10_3390_electronics14061130 crossref_primary_10_1109_TVT_2024_3396426 crossref_primary_10_1109_JSAC_2024_3460084 crossref_primary_10_1109_OJCOMS_2025_3586462 crossref_primary_10_1109_TMC_2025_3525477 crossref_primary_10_3390_e27080813 crossref_primary_10_1016_j_jfranklin_2024_107055 crossref_primary_10_1109_JIOT_2025_3580597 crossref_primary_10_1109_JSAC_2025_3574605 crossref_primary_10_1016_j_fmre_2023_08_002 crossref_primary_10_1109_LCOMM_2025_3571544 crossref_primary_10_1016_j_eng_2025_07_022 crossref_primary_10_1109_MCOM_002_2300640 crossref_primary_10_3390_s25092823 crossref_primary_10_1109_TMC_2024_3456856 crossref_primary_10_1109_TCCN_2024_3375496 crossref_primary_10_1109_TCCN_2024_3511960 crossref_primary_10_1109_TCOMM_2024_3450877 crossref_primary_10_1109_JSAC_2025_3559160 crossref_primary_10_3390_s23146347 crossref_primary_10_1109_TCOMM_2023_3282256 crossref_primary_10_1109_ACCESS_2024_3412929 crossref_primary_10_1109_LWC_2024_3472211 crossref_primary_10_1109_TWC_2024_3376998 crossref_primary_10_1109_TWC_2023_3349330 crossref_primary_10_1109_MWC_002_2300460 crossref_primary_10_1109_ACCESS_2024_3418900 crossref_primary_10_1109_JSAC_2025_3559157 crossref_primary_10_3390_e27040373 crossref_primary_10_1109_TWC_2024_3433479 crossref_primary_10_1109_TCOMM_2024_3356456 crossref_primary_10_1109_TCCN_2024_3392803 crossref_primary_10_1109_JSAC_2025_3559152 crossref_primary_10_1109_JSAC_2025_3574624 crossref_primary_10_1109_MCOM_004_2200819 crossref_primary_10_1109_MNET_2024_3421517 crossref_primary_10_1109_TGCN_2024_3399108 crossref_primary_10_1109_TCCN_2023_3346481 crossref_primary_10_1109_TCOMM_2024_3480982 crossref_primary_10_1109_TWC_2025_3532501 crossref_primary_10_1109_ACCESS_2025_3558107 crossref_primary_10_1109_MCOM_003_2400411 crossref_primary_10_1109_ACCESS_2025_3552927 crossref_primary_10_1109_LCOMM_2024_3466995 crossref_primary_10_1109_LCOMM_2024_3407133 crossref_primary_10_1109_LCOMM_2024_3422176 crossref_primary_10_1109_TWC_2025_3542798 crossref_primary_10_1109_MNET_2023_3317110 crossref_primary_10_1109_JPROC_2024_3520707 crossref_primary_10_1109_TSG_2024_3368277 crossref_primary_10_1109_JIOT_2023_3263909 crossref_primary_10_1109_JSAC_2025_3560359 crossref_primary_10_1109_JIOT_2024_3430905 crossref_primary_10_1109_JSAC_2025_3559138 crossref_primary_10_3390_e25020304 crossref_primary_10_1109_MBITS_2023_3322667 crossref_primary_10_1109_JSAC_2025_3559134 |
| Cites_doi | 10.1109/TCOM.1979.1094335 10.1145/2708463.2709063 10.1109/INFCOM.2012.6195689 10.1109/GLOBECOM42002.2020.9322286 10.1109/TIT.2019.2953750 10.1016/0004-3702(81)90024-2 10.1145/3394486.3403143 10.1145/1851275.1851257 10.1109/IEEECONF53345.2021.9723337 10.1109/18.761288 10.1109/INFOCOM.2019.8737474 10.1007/978-3-030-54407-2_5 10.1109/18.490552 10.1109/CVPR.2018.00716 10.1109/TIT.1979.1056022 10.1109/CVPR.2016.280 10.1109/TIT.2020.2972348 10.1109/CVPR.2017.243 10.1109/TASLP.2021.3129994 10.1109/ICCWorkshops53468.2022.9914635 10.1109/TIT.1962.1057738 10.1109/JSAC.2004.830894 10.1109/18.42171 10.1109/JSAC.2021.3087240 10.1109/TCCN.2018.2872596 10.1007/978-3-030-01418-6_40 10.1109/ICASSP.2018.8461983 10.1109/TIT.1987.1057383 10.1109/TIT.2019.2938171 10.1109/18.623151 10.1109/ISLPED.2019.8824955 10.1109/TIT.1976.1055508 10.1109/TIT.2010.2048453 10.1109/18.119685 10.1109/TIT.2010.2040870 10.1109/JSTSP.2014.2314864 10.1109/ICCV.2019.00652 10.1109/TSP.2005.863033 10.1016/0893-6080(91)90077-I 10.1109/83.826773 10.1109/DSAA.2016.51 10.1109/TIT.1970.1054469 10.1109/TMC.2019.2936199 10.1109/TIT.2019.2937336 10.1109/ICASSP.2018.8461487 10.1109/TIT.2021.3095823 10.1109/JSAC.2020.3036955 10.1109/ICIP40778.2020.9190935 10.1561/1300000060 10.23919/JCIN.2021.9663101 10.1214/aos/1176347496 10.1109/TFUZZ.2019.2945239 10.1109/TIT.2016.2533395 10.1109/ISIT45174.2021.9518240 10.1109/TIT.2010.2044058 10.1109/TIT.1965.1053821 10.1016/0923-5965(94)90012-4 10.1109/TIT.2018.2865570 10.1109/TIT.1980.1056251 10.1109/ISIT50566.2022.9834372 10.1109/ICASSP43922.2022.9746335 10.1109/ACSSC.2002.1197184 10.1109/MCOM.001.1900041 10.24963/ijcai.2019/268 10.1109/18.61130 10.1109/INFOCOM.2019.8737464 10.1109/TIT.2015.2506575 10.1016/j.imavis.2010.07.001 10.1109/TIT.2018.2871079 10.1016/j.dsp.2021.103134 10.1109/SPAWC.2019.8815416 10.1109/ICCV.2017.322 10.1109/TIT.2019.2910065 10.1609/aaai.v34i05.6455 10.1109/TAC.2013.2254615 10.1109/ISIT.1994.394874 10.1002/j.1538-7305.1979.tb02263.x 10.1109/TCSVT.2010.2087472 10.1109/JSAC.2022.3191354 10.1109/CDC.2006.377336 10.1109/PADSW.2018.8645013 10.1109/ICC45855.2022.9838470 10.1109/ITW.2017.8278006 10.1109/TIP.2020.3016485 10.1016/j.neucom.2019.01.086 10.1109/JSAIT.2022.3158421 10.1007/s41745-020-00165-6 10.1109/JSAC.2021.3126087 10.1109/ICASSP.2018.8462529 10.1109/TCCN.2022.3151935 10.1109/SPAWC.2018.8445873 10.1109/CVPR.2017.660 10.1109/WASPAA52581.2021.9632723 10.1109/CVPR.2015.7298990 10.1109/18.623141 10.1109/TIT.2012.2206793 10.1109/TIP.2021.3091909 10.1109/CDC.2015.7402467 10.1109/ICCV.2019.00713 10.1109/TWC.2021.3065920 10.1109/JSAC.2021.3065072 10.1109/TIT.2017.2688348 10.1109/TWC.2020.2974748 10.1007/s10994-013-5363-6 10.1109/CVPR.2019.01126 10.1109/ICSC.2017.85 10.1109/CVPR46437.2021.00076 10.1109/TIT.2009.2030462 10.1109/TIT.2005.850110 10.1515/9783112316009 10.1109/PIMRC.2019.8904190 10.1109/TIT.2019.2897698 10.1109/ICIP.2014.7025976 10.1109/ICCWorkshops53468.2022.9814492 10.1145/1150402.1150464 10.1002/j.1538-7305.1969.tb01207.x 10.1109/SIBGRAPI.2016.019 10.1109/TIT.2015.2401000 10.1109/TWC.2020.3024629 10.1109/ISIT50566.2022.9834593 10.1109/18.796416 10.1109/ITA.2011.5743568 10.1109/IJCNN.2019.8852172 10.1109/ICIP.2003.1247383 10.1109/JSAIT.2020.2991561 10.1016/j.eng.2021.11.003 10.1109/TIT.2019.2897564 10.1109/LWC.2022.3204837 10.1109/TIT.2018.2883295 10.1109/TIT.2013.2288257 10.1109/TIT.2010.2040891 10.1109/18.476308 10.1111/j.2517-6161.1977.tb01600.x 10.1109/VCIP.2015.7457877 10.1109/ICCV.2019.00355 10.3390/e22020151 10.1117/12.20700 10.1109/78.668553 10.1109/TIT.2009.2034896 10.1002/j.1538-7305.1974.tb02812.x 10.1109/JSAC.2021.3118412 10.1109/MCOM.001.2001239 10.1109/PerComW.2014.6815245 10.1109/TIT.1975.1055374 10.1109/TIT.1976.1055607 10.1109/CVPR.2019.00326 10.1109/JSAIT.2020.2987203 10.1109/TIT.1975.1055437 10.1109/MCOM.001.2000604 10.1109/JSAC.2021.3118400 10.1109/MIC.2020.2979620 10.1109/TCSVT.2021.3082521 10.1109/TIT.2018.2818739 10.1109/TCOMM.2020.2997414 10.1109/TAC.2019.2926160 10.1090/dimacs/020/08 10.1109/LSP.2010.2087749 10.1007/978-3-030-01237-3_26 10.1109/TWC.2015.2413417 10.18653/v1/P18-1223 10.1109/BigData52589.2021.9671547 10.1007/978-3-031-79293-9 10.1109/TIT.1986.1057194 10.1109/ICASSP.2019.8683541 10.1109/ISIT.2007.4557285 10.1109/JPROC.2020.2976475 10.1109/7.670328 10.1109/TSP.2020.2981904 10.1109/TSP.2005.861896 10.1109/ACSSC.2003.1292216 10.1109/TIT.1982.1056491 10.1117/12.238451 10.1109/TPAMI.2019.2928806 10.1109/WACV51458.2022.00100 10.1109/JSAC.2021.3087248 10.1109/TSP.2002.806982 10.1109/TIT.2003.810631 10.1002/j.1538-7305.1948.tb01338.x 10.1109/TCOM.1984.1096155 10.2307/1292231 10.3390/e23010104 10.1109/TIP.2005.864165 10.1109/TIT.1975.1055469 10.1109/JSAC.2021.3118346 10.1109/CDC.2005.1582293 10.1145/1143844.1143891 10.3390/e21121159 10.1109/18.53739 10.1109/TIT.1980.1056273 10.1109/TCCN.2019.2919300 10.1109/TIT.1972.1054753 10.1109/TIT.1981.1056323 10.21236/AD0753260 10.1109/TIT.1966.1053879 10.1109/CISS.2006.286470 10.1109/ICCV.2019.00031 10.1109/ICASSP43922.2022.9746468 10.1109/CVPR46437.2021.00155 10.1109/JSAC.2022.3180802 10.1109/GLOBECOM46510.2021.9685250 10.1109/TWC.2021.3090048 10.1145/3038912.3052558 10.1109/TAC.2017.2709914 10.1109/TIT.2005.844077 10.1109/TIT.2020.2998100 10.1109/TIT.2022.3149450 10.1109/TNET.2020.3005549 10.1109/TIT.2009.2030487 10.1109/TAC.2011.2139370 10.1109/CVPR.2018.00068 10.1109/18.720540 10.24963/ijcai.2021/278 10.1561/0100000013 10.1109/TIT.1964.1053707 10.1109/TIT.2020.3019654 10.1109/TIT.1967.1054047 10.1109/TIT.1972.1054855 10.1109/TIT.1983.1056760 10.1109/TIT.2009.2032819 10.1109/TWC.2020.3039309 10.1109/JCN.2019.000039 10.1109/MCOM.001.2000394 10.1109/78.650093 10.1109/ISIT.2015.7282683 10.1002/j.1538-7305.1951.tb01366.x 10.1109/MNET.106.2100636 10.1109/18.915643 10.1109/76.554433 10.1109/TKDE.2017.2754499 10.1109/ICASSP.2019.8682704 10.1109/CVPR42600.2020.00853 10.1093/bjps/IV.14.147 10.5220/0010207607850792 10.1109/18.2629 10.1109/18.669153 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023 |
| DBID | 97E RIA RIE AAYXX CITATION 7SP 8FD L7M |
| DOI | 10.1109/JSAC.2022.3223408 |
| DatabaseName | IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE/IET Electronic Library (IEL) (UW System Shared) CrossRef Electronics & Communications Abstracts Technology Research Database Advanced Technologies Database with Aerospace |
| DatabaseTitle | CrossRef Technology Research Database Advanced Technologies Database with Aerospace Electronics & Communications Abstracts |
| DatabaseTitleList | Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE/IET Electronic Library (IEL) (UW System Shared) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1558-0008 |
| EndPage | 1 |
| ExternalDocumentID | 10_1109_JSAC_2022_3223408 9955525 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: CHIST-ERA program – fundername: UK EPSRC grantid: EP/T023600/1; EP/W035960/1 – fundername: Tsinghua University-China Mobile Communications Group Co., Ltd. Joint Institute – fundername: ERC grantid: 677854 funderid: 10.13039/100010663 – fundername: MSIT grantid: 2021-0-02208; 2022R1A5A1027646 |
| GroupedDBID | -~X .DC 0R~ 29I 3EH 4.4 41~ 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACGFS ACIWK ACNCT ADRHT AENEX AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS EJD HZ~ H~9 IBMZZ ICLAB IES IFIPE IFJZH IPLJI JAVBF LAI M43 O9- OCL P2P RIA RIE RNS TN5 VH1 AAYXX CITATION 7SP 8FD L7M |
| ID | FETCH-LOGICAL-c359t-1ba7b6584a8326f6857edfb8bcd36c3d29d3f93afe754bdfb2b129acf400a99b3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 362 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000927934500002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0733-8716 |
| IngestDate | Mon Jun 30 10:11:42 EDT 2025 Tue Nov 18 21:02:35 EST 2025 Sat Nov 29 03:23:05 EST 2025 Wed Aug 27 02:29:15 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c359t-1ba7b6584a8326f6857edfb8bcd36c3d29d3f93afe754bdfb2b129acf400a99b3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0002-7725-395X 0000-0003-0820-3390 0000-0001-7521-0078 0000-0001-9561-3341 0000-0001-5110-6858 0000-0003-2829-9449 0000-0002-8507-3975 |
| PQID | 2754958246 |
| PQPubID | 85481 |
| PageCount | 1 |
| ParticipantIDs | proquest_journals_2754958246 crossref_primary_10_1109_JSAC_2022_3223408 crossref_citationtrail_10_1109_JSAC_2022_3223408 ieee_primary_9955525 |
| PublicationCentury | 2000 |
| PublicationDate | 2023-01-01 |
| PublicationDateYYYYMMDD | 2023-01-01 |
| PublicationDate_xml | – month: 01 year: 2023 text: 2023-01-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York |
| PublicationTitle | IEEE journal on selected areas in communications |
| PublicationTitleAbbrev | J-SAC |
| PublicationYear | 2023 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | carnap (ref21) 1952 ref207 ref56 ref208 han (ref141) 2016 ref205 ref58 ref206 ref53 ref203 tung (ref250) 2022 ref204 ref55 ref201 ref54 ref202 theis (ref63) 2021 shannon (ref196) 1961; 1 gupta (ref134) 2015 ref210 ref211 toderici (ref155) 2016 ref50 ref46 ref218 ref45 ref219 ref216 ref47 ref217 ref42 ref214 ref41 ref215 ref212 ref43 ref213 higgins (ref277) 2017 ref7 rippel (ref156) 2017; 70 tschannen (ref49) 2018; 31 ref9 maddison (ref279) 2016 ref4 ref5 gong (ref140) 2014 ref100 ref221 ref101 ref222 ref220 mirza (ref57) 2014 ref35 ref306 ref34 ref307 ref37 ref304 ref36 ref305 ref31 ref303 ref33 ref300 ref32 ref301 ref39 ref38 ref308 ref309 ref310 jiang (ref322) 2018 yoo (ref254) 2022 ref317 liu (ref189) 2019; 32 ref23 ref318 ref315 ref25 ref316 frankle (ref258) 2019 torfason (ref180) 2018 ref20 ref313 ref314 ref311 arjovsky (ref51) 2017; 70 ref312 ref27 ref319 ref29 morris (ref3) 1938 ref320 ref200 lecun (ref127) 1990 niu (ref209) 2006; 54 liu (ref129) 2020 ref249 courbariaux (ref135) 2015 ref247 ref96 ref248 alemi (ref98) 2017 ref124 ref245 ref246 kotelnikov (ref259) 1959 farshbafan (ref239) 2021 jang (ref280) 2016 shannon (ref6) 1949 shannon (ref11) 1959; 4 ref93 ref133 ref92 ref255 ref95 ref94 ref132 ref130 ref91 ref90 ref86 ref85 qin (ref19) 2021 ref88 chen (ref139) 2015 ref256 ref87 chang (ref59) 2021 xiao (ref40) 2016 ref82 ref265 ref81 ref266 ref84 ref142 ref263 horn (ref70) 1980; 17 ref83 ref264 ref261 ref262 ref80 ref79 ref229 ref108 ref78 ref227 ref106 ref228 ref107 berger (ref151) 1977 ref75 ref225 ref104 ref74 ref226 ref105 ref77 ref223 ref102 ref76 ref103 patel (ref44) 2019 melamed (ref24) 1997 wen (ref131) 2016 dempster (ref271) 1977; 39 minnen (ref158) 2018 ref71 ref232 ref112 ref73 ref230 ref72 ref231 denton (ref125) 2014 ref68 ref119 ref117 ref118 foerster (ref321) 2016 ref64 ref236 ref115 ref237 ref116 ref234 ref235 ref114 seo (ref238) 2021 kingma (ref276) 2013 aguerri (ref109) 2018 li (ref257) 2017 ref60 ref243 ref122 kingma (ref281) 2014 ref244 ref123 ref62 ref241 ref120 ref242 ref121 jaques (ref323) 2019 ref168 ref289 theis (ref66) 2021 ref169 han (ref166) 2019; 32 hassibi (ref128) 1993 ref290 ref170 ref291 tishby (ref89) 1999 ref177 ref298 ref178 ref299 ref175 ref296 tung (ref253) 2020 ref297 chechik (ref275) 2005; 6 ref294 ref174 ref295 ref171 ref292 ref172 ref293 ref179 he (ref181) 2015 goodfellow (ref48) 2014; 27 han (ref113) 1995; 41 courbariaux (ref136) 2015 manoranjan (ref69) 2005 hanson (ref126) 1989 xie (ref233) 2021 ref188 ref186 ref187 wiener (ref8) 1950 ref184 ref185 ref182 xu (ref302) 2004; 4 ref183 yang (ref173) 2022 ref269 ref148 liu (ref252) 2022 ref267 ref146 ref268 ref147 shao (ref260) 2021 ref153 ref154 courbariaux (ref137) 2016 ref272 ref273 ref152 ref270 ref150 ref159 ref278 chattopadhyay (ref26) 2020 zhang (ref65) 2021; 34 das (ref324) 2019 ref287 ref288 ref167 ref285 ref164 ref286 ref165 ref283 mcmahan (ref149) 2017 ref162 choi (ref138) 2017 ref284 ref163 vera (ref97) 2018 ref160 ref282 ref161 ref12 ref15 ref14 iyer (ref17) 2022 ref10 sequoiah-grayson (ref22) 2022 han (ref111) 1998; 44 nickel (ref28) 2011 choi (ref251) 2019 ref16 wagner (ref67) 2022 howard (ref145) 2017 berger (ref110) 1979 dai (ref99) 2018 bulla (ref176) 2013 nowozin (ref52) 2016; 29 kurka (ref240) 2020 zhang (ref18) 2022; 8 globerson (ref274) 2004 hinton (ref143) 2015 ref2 ref1 ref191 ref192 rumelhart (ref224) 1986; 1 ref190 ref199 strinati (ref13) 2021; 190 ref197 iandola (ref144) 2016 ref198 ballé (ref157) 2017 ref195 ref193 ref194 blau (ref61) 2019; 97 liu (ref30) 2016 |
| References_xml | – ident: ref213 doi: 10.1109/TCOM.1979.1094335 – year: 2014 ident: ref57 article-title: Conditional generative adversarial nets publication-title: arXiv 1411 1784 – ident: ref47 doi: 10.1145/2708463.2709063 – ident: ref315 doi: 10.1109/INFCOM.2012.6195689 – ident: ref268 doi: 10.1109/GLOBECOM42002.2020.9322286 – ident: ref204 doi: 10.1109/TIT.2019.2953750 – volume: 17 start-page: 185 year: 1980 ident: ref70 article-title: Determining optical flow publication-title: Artif Intell doi: 10.1016/0004-3702(81)90024-2 – ident: ref33 doi: 10.1145/3394486.3403143 – ident: ref222 doi: 10.1145/1851275.1851257 – start-page: 1269 year: 2014 ident: ref125 article-title: Exploiting linear structure within convolutional networks for efficient evaluation publication-title: Proc Int Conf Neural Inf Process – start-page: 1 year: 2017 ident: ref157 article-title: End-to-end optimized image compression publication-title: Proc Int Conf Learn Represent (ICLR) – ident: ref319 doi: 10.1109/IEEECONF53345.2021.9723337 – ident: ref217 doi: 10.1109/18.761288 – ident: ref294 doi: 10.1109/INFOCOM.2019.8737474 – ident: ref54 doi: 10.1007/978-3-030-54407-2_5 – ident: ref79 doi: 10.1109/18.490552 – ident: ref146 doi: 10.1109/CVPR.2018.00716 – ident: ref150 doi: 10.1109/TIT.1979.1056022 – ident: ref130 doi: 10.1109/CVPR.2016.280 – ident: ref108 doi: 10.1109/TIT.2020.2972348 – volume: 29 start-page: 1 year: 2016 ident: ref52 article-title: F-GAN: Training generative neural samplers using variational divergence minimization publication-title: Proc Adv Neural Inf Process Syst – ident: ref147 doi: 10.1109/CVPR.2017.243 – ident: ref172 doi: 10.1109/TASLP.2021.3129994 – year: 2022 ident: ref254 article-title: Demo: Real-time semantic communications with a vision transformer publication-title: Proc IEEE Int Conf Commun Workshops (ICC Workshops) doi: 10.1109/ICCWorkshops53468.2022.9914635 – ident: ref75 doi: 10.1109/TIT.1962.1057738 – ident: ref208 doi: 10.1109/JSAC.2004.830894 – start-page: 1 year: 2015 ident: ref136 article-title: BinaryConnect: Training deep neural networks with binary weights during propagations publication-title: Proc Adv Neural Inf Process Syst (NIPS) – ident: ref117 doi: 10.1109/18.42171 – ident: ref232 doi: 10.1109/JSAC.2021.3087240 – ident: ref231 doi: 10.1109/TCCN.2018.2872596 – ident: ref184 doi: 10.1007/978-3-030-01418-6_40 – ident: ref226 doi: 10.1109/ICASSP.2018.8461983 – ident: ref116 doi: 10.1109/TIT.1987.1057383 – ident: ref293 doi: 10.1109/TIT.2019.2938171 – ident: ref80 doi: 10.1109/18.623151 – ident: ref186 doi: 10.1109/ISLPED.2019.8824955 – ident: ref85 doi: 10.1109/TIT.1976.1055508 – ident: ref200 doi: 10.1109/TIT.2010.2048453 – ident: ref118 doi: 10.1109/18.119685 – ident: ref202 doi: 10.1109/TIT.2010.2040870 – ident: ref177 doi: 10.1109/JSTSP.2014.2314864 – ident: ref164 doi: 10.1109/ICCV.2019.00652 – volume: 4 start-page: 3527 year: 2004 ident: ref302 article-title: Optimal communication logics in networked control systems publication-title: Proc 43rd IEEE Conf Decis Control – volume: 54 start-page: 1018 year: 2006 ident: ref209 article-title: Fusion of decisions transmitted over fading channels in wireless sensor networks publication-title: IEEE Trans Signal Process doi: 10.1109/TSP.2005.863033 – year: 1950 ident: ref8 publication-title: The Human Use of Human Beings – ident: ref133 doi: 10.1016/0893-6080(91)90077-I – volume: 31 start-page: 1 year: 2018 ident: ref49 article-title: Deep generative models for distribution-preserving lossy compression publication-title: Proc Adv Neural Inf Process Syst – ident: ref220 doi: 10.1109/83.826773 – start-page: 1737 year: 2015 ident: ref134 article-title: Deep learning with limited numerical precision publication-title: Proc Int Conf Mach Learn (ICML) – ident: ref34 doi: 10.1109/DSAA.2016.51 – ident: ref78 doi: 10.1109/TIT.1970.1054469 – year: 2016 ident: ref30 article-title: Probabilistic reasoning via deep learning: Neural association models publication-title: arXiv 1603 07704 – start-page: 368 year: 1999 ident: ref89 article-title: The information bottleneck method publication-title: Proc 37th Annu Allerton Conf Commun Control Comput – ident: ref316 doi: 10.1109/TMC.2019.2936199 – year: 2020 ident: ref129 article-title: Pruning algorithms to accelerate convolutional neural networks for edge applications: A survey publication-title: arXiv 2005 04275 – ident: ref298 doi: 10.1109/TIT.2019.2937336 – start-page: 1 year: 2017 ident: ref138 article-title: Towards the limit of network quantization publication-title: Proc 5th Int Conf Learn Represent (ICLR) – ident: ref169 doi: 10.1109/ICASSP.2018.8461487 – ident: ref288 doi: 10.1109/TIT.2021.3095823 – ident: ref188 doi: 10.1109/JSAC.2020.3036955 – ident: ref159 doi: 10.1109/ICIP40778.2020.9190935 – ident: ref283 doi: 10.1561/1300000060 – start-page: 35 year: 2018 ident: ref109 article-title: Distributed information bottleneck method for discrete and Gaussian sources publication-title: Proc Int Zurich Seminar on Communications (IZS) – ident: ref12 doi: 10.23919/JCIN.2021.9663101 – ident: ref114 doi: 10.1214/aos/1176347496 – ident: ref25 doi: 10.1109/TFUZZ.2019.2945239 – ident: ref289 doi: 10.1109/TIT.2016.2533395 – ident: ref76 doi: 10.1109/ISIT45174.2021.9518240 – volume: 32 start-page: 1 year: 2019 ident: ref189 article-title: On the classification-distortion-perception tradeoff publication-title: Proc Adv Neural Inf Process Syst – ident: ref201 doi: 10.1109/TIT.2010.2044058 – ident: ref193 doi: 10.1109/TIT.1965.1053821 – ident: ref71 doi: 10.1016/0923-5965(94)90012-4 – ident: ref64 doi: 10.1109/TIT.2018.2865570 – volume: 6 start-page: 165 year: 2005 ident: ref275 article-title: Information bottleneck for Gaussian variables publication-title: J Mach Learn Res – ident: ref107 doi: 10.1109/TIT.1980.1056251 – start-page: 1135 year: 2018 ident: ref99 article-title: Compressing neural networks using the variational information bottleneck publication-title: Proc Int Conf Mach Learn – year: 1952 ident: ref21 publication-title: An Outline of A Theory of Semantic Information – ident: ref256 doi: 10.1109/ISIT50566.2022.9834372 – ident: ref243 doi: 10.1109/ICASSP43922.2022.9746335 – year: 2020 ident: ref26 publication-title: Quantifying Task Complexity Through Generalized Information Measures – year: 1979 ident: ref110 article-title: Decentralized estimation and decision theory publication-title: Proc IEEE 7th Spring Workshop Inf Theory – ident: ref87 doi: 10.1109/ACSSC.2002.1197184 – volume: 1 start-page: 318 year: 1986 ident: ref224 article-title: Learning internal representations by error propagation publication-title: Parallel Distributed Processing Explorations in the Microstructure of Cognition Foundations – ident: ref284 doi: 10.1109/MCOM.001.1900041 – year: 2021 ident: ref233 article-title: Task-oriented multi-user semantic communications publication-title: arXiv 2112 10255 – ident: ref31 doi: 10.24963/ijcai.2019/268 – start-page: 1 year: 2015 ident: ref135 article-title: Training deep neural networks with low precision multiplications publication-title: Proc Int Conf Learn Represent (ICLR) – ident: ref216 doi: 10.1109/18.61130 – year: 1997 ident: ref24 article-title: Measuring semantic entropy publication-title: Proc ACL Workshop Tagging Text With Lexical Semantics Why What How? – year: 2022 ident: ref173 article-title: An introduction to neural data compression publication-title: arXiv 2202 06533 – ident: ref264 doi: 10.1109/INFOCOM.2019.8737464 – ident: ref203 doi: 10.1109/TIT.2015.2506575 – year: 1977 ident: ref151 publication-title: Multiterminal source coding – ident: ref46 doi: 10.1016/j.imavis.2010.07.001 – ident: ref286 doi: 10.1109/TIT.2018.2871079 – ident: ref14 doi: 10.1016/j.dsp.2021.103134 – ident: ref242 doi: 10.1109/SPAWC.2019.8815416 – ident: ref192 doi: 10.1109/ICCV.2017.322 – ident: ref123 doi: 10.1109/TIT.2019.2910065 – ident: ref60 doi: 10.1609/aaai.v34i05.6455 – ident: ref306 doi: 10.1109/TAC.2013.2254615 – year: 2019 ident: ref44 article-title: Human perceptual evaluations for image compression publication-title: arXiv 1908 04187 – volume: 32 start-page: 1 year: 2019 ident: ref166 article-title: Deep generative video compression publication-title: Proc Adv Neural Inf Process Syst (NIPS) – ident: ref205 doi: 10.1109/ISIT.1994.394874 – year: 2017 ident: ref145 article-title: MobileNets: Efficient convolutional neural networks for mobile vision applications publication-title: arXiv 1704 04861 – ident: ref299 doi: 10.1002/j.1538-7305.1979.tb02263.x – ident: ref43 doi: 10.1109/TCSVT.2010.2087472 – ident: ref229 doi: 10.1109/JSAC.2022.3191354 – ident: ref305 doi: 10.1109/CDC.2006.377336 – year: 2022 ident: ref250 article-title: DeepJSCC-Q: Constellation constrained deep joint source-channel coding publication-title: arXiv 2206 08100 – ident: ref185 doi: 10.1109/PADSW.2018.8645013 – ident: ref41 doi: 10.1109/ICC45855.2022.9838470 – ident: ref102 doi: 10.1109/ITW.2017.8278006 – ident: ref73 doi: 10.1109/TIP.2020.3016485 – ident: ref190 doi: 10.1016/j.neucom.2019.01.086 – ident: ref296 doi: 10.1109/JSAIT.2022.3158421 – ident: ref2 doi: 10.1007/s41745-020-00165-6 – ident: ref255 doi: 10.1109/JSAC.2021.3126087 – start-page: 1 year: 2016 ident: ref155 article-title: Variable rate image compression with recurrent neural networks publication-title: Proc Int Conf Learn Represent (ICLR) – ident: ref170 doi: 10.1109/ICASSP.2018.8462529 – volume: 1 start-page: 611 year: 1961 ident: ref196 article-title: Two-way communication channels publication-title: Proc 4th Berkeley Symp Math Statist Probab – ident: ref248 doi: 10.1109/TCCN.2022.3151935 – start-page: 1 year: 2017 ident: ref257 article-title: Pruning filters for efficient convnets publication-title: Proc Int Conf Learn Represent (ICLR) – ident: ref317 doi: 10.1109/SPAWC.2018.8445873 – year: 2004 ident: ref274 article-title: On the optimality of the Gaussian information bottleneck curve – ident: ref55 doi: 10.1109/CVPR.2017.660 – ident: ref171 doi: 10.1109/WASPAA52581.2021.9632723 – ident: ref58 doi: 10.1109/CVPR.2015.7298990 – year: 1949 ident: ref6 publication-title: The Mathematical Theory of Communication – ident: ref221 doi: 10.1109/18.623141 – ident: ref120 doi: 10.1109/TIT.2012.2206793 – ident: ref191 doi: 10.1109/TIP.2021.3091909 – year: 2020 ident: ref253 article-title: DeepJSCC: The future of wireless video transmission publication-title: Proc IEEE Int Conf Acoust Speech Signal Process (ICASSP) – ident: ref312 doi: 10.1109/CDC.2015.7402467 – ident: ref165 doi: 10.1109/ICCV.2019.00713 – ident: ref83 doi: 10.1109/TIT.2020.2972348 – year: 2015 ident: ref181 article-title: Deep residual learning for image recognition publication-title: arXiv 1512 03385 – ident: ref267 doi: 10.1109/TWC.2021.3065920 – ident: ref282 doi: 10.1109/JSAC.2021.3065072 – ident: ref121 doi: 10.1109/TIT.2017.2688348 – start-page: 1 year: 2017 ident: ref98 article-title: Deep variational information bottleneck publication-title: Proc Int Conf Learn Represent – ident: ref262 doi: 10.1109/TWC.2020.2974748 – ident: ref29 doi: 10.1007/s10994-013-5363-6 – start-page: 1 year: 2016 ident: ref131 article-title: Learning structured sparsity in deep neural networks publication-title: Proc Adv Neural Inf Process Syst (NIPS) – volume: 34 start-page: 11517 year: 2021 ident: ref65 article-title: Universal rate-distortion-perception representations for lossy compression publication-title: Proc Adv Neural Inf Process Syst – start-page: 1 year: 2019 ident: ref258 article-title: The lottery ticket hypothesis: Finding sparse, trainable neural networks publication-title: Proc Int Conf Learn Represent (ICLR) – ident: ref162 doi: 10.1109/CVPR.2019.01126 – year: 1959 ident: ref259 publication-title: The Theory of Optimum Noise Immunity – volume: 27 start-page: 1 year: 2014 ident: ref48 article-title: Generative adversarial nets publication-title: Proc Adv Neural Inf Process Syst – ident: ref32 doi: 10.1109/ICSC.2017.85 – year: 2022 ident: ref67 article-title: The rate-distortion-perception tradeoff: The role of common randomness publication-title: arXiv 2202 04147 – ident: ref168 doi: 10.1109/CVPR46437.2021.00076 – ident: ref311 doi: 10.1109/TIT.2009.2030462 – ident: ref81 doi: 10.1109/TIT.2005.850110 – start-page: 1 year: 2021 ident: ref66 article-title: On the advantages of stochastic encoders publication-title: Proc ICLR – ident: ref5 doi: 10.1515/9783112316009 – ident: ref320 doi: 10.1109/PIMRC.2019.8904190 – ident: ref122 doi: 10.1109/TIT.2019.2897698 – ident: ref175 doi: 10.1109/ICIP.2014.7025976 – year: 2021 ident: ref238 article-title: Semantics-native communication with contextual reasoning publication-title: arXiv 2108 05681 – ident: ref237 doi: 10.1109/ICCWorkshops53468.2022.9814492 – start-page: 100 year: 2005 ident: ref69 article-title: Very low bit-rate video coding publication-title: Video Data Management and Information Retrieval – start-page: 1 year: 1989 ident: ref126 article-title: Comparing biases for minimal network construction with back-propagation publication-title: Proc Adv Neural Inf Process Syst (NIPS) – year: 2017 ident: ref277 article-title: ?-vae: Learning basic visual concepts with a constrained variational framework publication-title: Proc Int Conf Learn Represent (ICLR) – year: 2014 ident: ref281 article-title: Adam: A method for stochastic optimization publication-title: arXiv 1412 6980 – ident: ref142 doi: 10.1145/1150402.1150464 – ident: ref309 doi: 10.1002/j.1538-7305.1969.tb01207.x – volume: 70 start-page: 2922 year: 2017 ident: ref156 article-title: Real-time adaptive image compression publication-title: Proc Int Conf Mach Learn (ICML) – ident: ref178 doi: 10.1109/SIBGRAPI.2016.019 – ident: ref207 doi: 10.1109/TIT.2015.2401000 – year: 2019 ident: ref323 article-title: Social influence as intrinsic motivation for multi-agent deep reinforcement learning publication-title: arXiv 1810 08647 – ident: ref265 doi: 10.1109/TWC.2020.3024629 – ident: ref77 doi: 10.1109/ISIT50566.2022.9834593 – year: 2015 ident: ref143 article-title: Distilling the knowledge in a neural network publication-title: ArXiv 1503 02531 – ident: ref219 doi: 10.1109/18.796416 – ident: ref223 doi: 10.1109/ITA.2011.5743568 – ident: ref263 doi: 10.1109/IJCNN.2019.8852172 – ident: ref86 doi: 10.1109/ICIP.2003.1247383 – ident: ref101 doi: 10.1109/JSAIT.2020.2991561 – volume: 8 start-page: 60 year: 2022 ident: ref18 article-title: Toward wisdom-evolutionary and primitive-concise 6G: A new paradigm of semantic communication networks publication-title: Engineering doi: 10.1016/j.eng.2021.11.003 – ident: ref96 doi: 10.1109/TIT.2019.2897564 – ident: ref249 doi: 10.1109/LWC.2022.3204837 – ident: ref103 doi: 10.1109/TIT.2018.2883295 – ident: ref82 doi: 10.1109/TIT.2013.2288257 – ident: ref199 doi: 10.1109/TIT.2010.2040891 – volume: 41 start-page: 1802 year: 1995 ident: ref113 article-title: Parameter estimation with multiterminal data compression publication-title: IEEE Trans Inf Theory doi: 10.1109/18.476308 – year: 2022 ident: ref17 article-title: A survey on sematic communications for intelligent wireless networks publication-title: arXiv 2202 03705 – volume: 39 start-page: 1 year: 1977 ident: ref271 article-title: Maximum likelihood from incomplete data via the EM algorithm publication-title: J Roy Stat Soc Ser B doi: 10.1111/j.2517-6161.1977.tb01600.x – ident: ref179 doi: 10.1109/VCIP.2015.7457877 – ident: ref163 doi: 10.1109/ICCV.2019.00355 – ident: ref100 doi: 10.3390/e22020151 – ident: ref132 doi: 10.1117/12.20700 – ident: ref218 doi: 10.1109/78.668553 – ident: ref246 doi: 10.1109/TIT.2009.2034896 – ident: ref88 doi: 10.1002/j.1538-7305.1974.tb02812.x – ident: ref212 doi: 10.1109/JSAC.2021.3118412 – start-page: 10771 year: 2018 ident: ref158 article-title: Joint autoregressive and hierarchical priors for learned image compression publication-title: Proc Adv Neural Inf Process Syst – ident: ref15 doi: 10.1109/MCOM.001.2001239 – ident: ref230 doi: 10.1109/PerComW.2014.6815245 – ident: ref93 doi: 10.1109/TIT.1975.1055374 – ident: ref154 doi: 10.1109/TIT.1976.1055607 – ident: ref56 doi: 10.1109/CVPR.2019.00326 – ident: ref227 doi: 10.1109/JSAIT.2020.2987203 – ident: ref106 doi: 10.1109/TIT.1975.1055437 – ident: ref16 doi: 10.1109/MCOM.001.2000604 – ident: ref269 doi: 10.1109/JSAC.2021.3118400 – ident: ref38 doi: 10.1109/MIC.2020.2979620 – ident: ref241 doi: 10.1109/TCSVT.2021.3082521 – ident: ref290 doi: 10.1109/TIT.2018.2818739 – ident: ref291 doi: 10.1109/TCOMM.2020.2997414 – ident: ref314 doi: 10.1109/TAC.2019.2926160 – ident: ref153 doi: 10.1090/dimacs/020/08 – start-page: 7265 year: 2018 ident: ref322 article-title: Learning attentional communication for multi-agent cooperation publication-title: Proc 32nd Int Conf Neural Inf Process Syst – ident: ref68 doi: 10.1109/LSP.2010.2087749 – ident: ref161 doi: 10.1007/978-3-030-01237-3_26 – ident: ref307 doi: 10.1109/TWC.2015.2413417 – ident: ref35 doi: 10.18653/v1/P18-1223 – start-page: 1538 year: 2019 ident: ref324 article-title: TarMAC: Targeted multi-agent communication publication-title: Proc 36th Int Conf Mach Learn – volume: 190 year: 2021 ident: ref13 article-title: 6G networks: Beyond Shannon towards semantic and goal-oriented communications publication-title: Comput Netw – year: 2021 ident: ref260 article-title: Denoising noisy neural networks: A Bayesian approach with compensation publication-title: arXiv 2105 10699 – ident: ref37 doi: 10.1109/BigData52589.2021.9671547 – ident: ref285 doi: 10.1007/978-3-031-79293-9 – ident: ref115 doi: 10.1109/TIT.1986.1057194 – ident: ref53 doi: 10.1109/ICASSP.2019.8683541 – ident: ref105 doi: 10.1109/ISIT.2007.4557285 – ident: ref148 doi: 10.1109/JPROC.2020.2976475 – year: 2021 ident: ref59 article-title: A comprehensive survey of scene graphs: Generation and application publication-title: IEEE Trans Pattern Anal Mach Intell – start-page: 119 year: 2013 ident: ref176 article-title: Region of interest encoding in video conference systems publication-title: Proc MMEDIA – year: 2013 ident: ref276 article-title: Auto-encoding variational Bayes publication-title: arXiv 1312 6114 – ident: ref210 doi: 10.1109/7.670328 – ident: ref261 doi: 10.1109/TSP.2020.2981904 – ident: ref211 doi: 10.1109/TSP.2005.861896 – start-page: 1182 year: 2019 ident: ref251 article-title: Neural joint source-channel coding publication-title: Proc Int Conf Mach Learn – ident: ref42 doi: 10.1109/ACSSC.2003.1292216 – ident: ref300 doi: 10.1109/TIT.1982.1056491 – year: 1938 ident: ref3 publication-title: Foundations of the Theory of Signs – year: 2016 ident: ref40 article-title: KSR: A semantic representation of knowledge graph within a novel unsupervised paradigm publication-title: arXiv 1608 07685 – ident: ref174 doi: 10.1117/12.238451 – year: 2022 ident: ref22 article-title: Semantic conceptions of information publication-title: The Stanford Encyclopedia of Philosophy – ident: ref104 doi: 10.1109/TPAMI.2019.2928806 – ident: ref187 doi: 10.1109/WACV51458.2022.00100 – ident: ref318 doi: 10.1109/JSAC.2021.3087248 – ident: ref119 doi: 10.1109/TSP.2002.806982 – ident: ref194 doi: 10.1109/TIT.2003.810631 – ident: ref7 doi: 10.1002/j.1538-7305.1948.tb01338.x – ident: ref214 doi: 10.1109/TCOM.1984.1096155 – year: 2014 ident: ref140 article-title: Compressing deep convolutional networks using vector quantization publication-title: arXiv 1412 6115 – ident: ref4 doi: 10.2307/1292231 – start-page: 1 year: 2021 ident: ref63 article-title: A coding theorem for the rate-distortion-perception function publication-title: Proc ICLR – ident: ref182 doi: 10.3390/e23010104 – ident: ref62 doi: 10.1109/TIP.2005.864165 – ident: ref94 doi: 10.1109/TIT.1975.1055469 – ident: ref270 doi: 10.1109/JSAC.2021.3118346 – ident: ref301 doi: 10.1109/CDC.2005.1582293 – ident: ref236 doi: 10.1145/1143844.1143891 – start-page: 2285 year: 2015 ident: ref139 article-title: Compressing neural networks with the hashing trick publication-title: Proc Int Conf Mach Learn (ICML) – year: 2016 ident: ref279 article-title: The concrete distribution: A continuous relaxation of discrete random variables publication-title: arXiv 1611 00712 – ident: ref23 doi: 10.3390/e21121159 – ident: ref215 doi: 10.1109/18.53739 – volume: 4 start-page: 1 year: 1959 ident: ref11 article-title: Coding theorems for a discrete source with a fidelity criterion publication-title: Inst Radio Eng Int Conv Record – ident: ref195 doi: 10.1109/TIT.1980.1056273 – ident: ref225 doi: 10.1109/TCCN.2019.2919300 – year: 2021 ident: ref239 article-title: Common language for goal-oriented semantic communications: A curriculum learning framework publication-title: arXiv 2111 08051 – ident: ref273 doi: 10.1109/TIT.1972.1054753 – ident: ref197 doi: 10.1109/TIT.1981.1056323 – start-page: 1 year: 2016 ident: ref141 article-title: Deep compression: Compressing deep neural networks with pruning, trained quantization and Huffman coding publication-title: Proc Int Conf Learn Represent (ICLR) – ident: ref84 doi: 10.21236/AD0753260 – year: 2016 ident: ref321 article-title: Learning to communicate with deep multi-agent reinforcement learning publication-title: arXiv 1605 06676 – year: 2021 ident: ref19 article-title: Semantic communications: Principles and challenges publication-title: arXiv 2201 01389 – ident: ref245 doi: 10.1109/TIT.1966.1053879 – ident: ref198 doi: 10.1109/CISS.2006.286470 – ident: ref50 doi: 10.1109/ICCV.2019.00031 – ident: ref278 doi: 10.1109/ICASSP43922.2022.9746468 – ident: ref167 doi: 10.1109/CVPR46437.2021.00155 – ident: ref244 doi: 10.1109/JSAC.2022.3180802 – ident: ref234 doi: 10.1109/GLOBECOM46510.2021.9685250 – ident: ref228 doi: 10.1109/TWC.2021.3090048 – ident: ref36 doi: 10.1145/3038912.3052558 – ident: ref313 doi: 10.1109/TAC.2017.2709914 – ident: ref90 doi: 10.1109/TIT.2005.844077 – ident: ref287 doi: 10.1109/TIT.2020.2998100 – year: 2022 ident: ref252 article-title: Task-oriented semantic communication with semantic reconstruction: An extended rate-distortion theory based scheme publication-title: arXiv 2201 10929 – ident: ref295 doi: 10.1109/TIT.2022.3149450 – ident: ref297 doi: 10.1109/TNET.2020.3005549 – start-page: 1 year: 2018 ident: ref180 article-title: Towards image understanding from deep compression without decoding publication-title: Proc Int Conf Learn Represent – ident: ref92 doi: 10.1109/TIT.2009.2030487 – year: 2016 ident: ref137 article-title: Binarized neural networks: Training deep neural networks with weights and activations constrained to +1 or ?1 publication-title: arXiv 1602 02830 [cs] – start-page: 1 year: 1993 ident: ref128 article-title: Optimal brain surgeon: Extensions and performance comparisons publication-title: Proc Adv Neural Inf Process Syst (NIPS) – ident: ref303 doi: 10.1109/TAC.2011.2139370 – ident: ref45 doi: 10.1109/CVPR.2018.00068 – volume: 44 start-page: 2300 year: 1998 ident: ref111 article-title: Statistical inference under multiterminal data compression publication-title: IEEE Trans Inf Theory doi: 10.1109/18.720540 – ident: ref39 doi: 10.24963/ijcai.2021/278 – ident: ref91 doi: 10.1561/0100000013 – start-page: 1 year: 1990 ident: ref127 article-title: Optimal brain damage publication-title: Proc Adv Neural Inf Process Syst (NIPS) – ident: ref308 doi: 10.1109/TIT.1964.1053707 – volume: 97 start-page: 675 year: 2019 ident: ref61 article-title: Rethinking lossy compression: The rate-distortion-perception tradeoff publication-title: Proc Int Conf Mach Learn – ident: ref124 doi: 10.1109/TIT.2020.3019654 – start-page: 90 year: 2020 ident: ref240 article-title: Joint source-channel coding of images with (not very) deep learning publication-title: Proc Int Zurich Seminar on Communications (IZS) – ident: ref247 doi: 10.1109/TIT.1967.1054047 – ident: ref272 doi: 10.1109/TIT.1972.1054855 – start-page: 809 year: 2011 ident: ref28 article-title: A three-way model for collective learning on multi-relational data publication-title: Proc 28th Int Conf Mach Learn – ident: ref310 doi: 10.1109/TIT.1983.1056760 – ident: ref206 doi: 10.1109/TIT.2009.2032819 – ident: ref266 doi: 10.1109/TWC.2020.3039309 – ident: ref292 doi: 10.1109/JCN.2019.000039 – year: 2016 ident: ref280 article-title: Categorical reparameterization with Gumbel-Softmax publication-title: arXiv 1611 01144 – ident: ref1 doi: 10.1109/MCOM.001.2000394 – ident: ref235 doi: 10.1109/78.650093 – ident: ref304 doi: 10.1109/ISIT.2015.7282683 – ident: ref10 doi: 10.1002/j.1538-7305.1951.tb01366.x – ident: ref20 doi: 10.1109/MNET.106.2100636 – volume: 70 start-page: 214 year: 2017 ident: ref51 article-title: Wasserstein generative adversarial networks publication-title: Proc Int Conf Mach Learn – start-page: 1273 year: 2017 ident: ref149 article-title: Communication-efficient learning of deep networks from decentralized data publication-title: Proc Int Conf Artif Intell Stat – ident: ref152 doi: 10.1109/18.915643 – ident: ref72 doi: 10.1109/76.554433 – year: 2016 ident: ref144 article-title: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size publication-title: arXiv 1602 07360 – year: 2018 ident: ref97 article-title: The role of information complexity and randomization in representation learning publication-title: arXiv 1802 05355 – ident: ref27 doi: 10.1109/TKDE.2017.2754499 – ident: ref183 doi: 10.1109/ICASSP.2019.8682704 – ident: ref160 doi: 10.1109/CVPR42600.2020.00853 – ident: ref9 doi: 10.1093/bjps/IV.14.147 – ident: ref74 doi: 10.5220/0010207607850792 – ident: ref112 doi: 10.1109/18.2629 – ident: ref95 doi: 10.1109/18.669153 |
| SSID | ssj0014482 |
| Score | 2.7543094 |
| Snippet | Communication systems to date primarily aim at reliably communicating bit sequences. Such an approach provides efficient engineering designs that are agnostic... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 1 |
| SubjectTerms | Algorithms Communications systems Context Foundations Information theory Messages Semantics |
| Title | Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications |
| URI | https://ieeexplore.ieee.org/document/9955525 https://www.proquest.com/docview/2754958246 |
| Volume | 41 |
| WOSCitedRecordID | wos000927934500002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE/IET Electronic Library (IEL) (UW System Shared) customDbUrl: eissn: 1558-0008 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0014482 issn: 0733-8716 databaseCode: RIE dateStart: 19830101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dS8MwED-24YM--DXF6ZQ--CTr1iZN0_g2h0N8mMIU9laSNIWi22TtxD_fJK1logi-FXoH7V0u97tc7g7gUlBKBDap_8DnbqABviuQIC7W0ED6HmdBKu2wCTqZRLMZe2xAr66FUUrZy2eqbx5tLj9ZyrU5KhswRghBpAlNSsOyVqvOGOgww2YMKMauCQKqDKbvscH9dDjSkSBCfb16cWAmSW74IDtU5cdObN3LeO9_H7YPuxWMdIal3g-goRaHsLPRXLANk7I4xbHeaJ7Z-83OTVbk145tSfVR9JypmmvJZjLvOdyQ8vzFfTCdjzUOdb7VjuRH8Dy-fRrdudX0BFdiwgrXF5wKgy-4NtowDSNCVZKKSMgEhxIniCU4ZZinipJA6DdIaN_PZaqtmjMm8DG0FsuFOgGH0oSnCYsCqcGH0KCQS6njIKQ5eZgGrAPelzxjWbUWNxMuXmMbYngsNiqIjQriSgUduKpZ3sq-Gn8Rt43Ma8JK3B3ofiktriwvj5H-G0YiFISnv3OdwbYZGV8eo3ShVazW6hy25HuR5asLu6g-AZpvyQk |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dS8MwED_mFNQHv8Xp1D74JKvr8tE0vqkoU-cUNsG3kqQpDN0mtop_vknajYki-FboHbR3udzvcrk7gCPJGJXYpv5JS_jEAHxfIkl9bKCBagWCk1S5YROs242envhDBRrTWhittbt8pk_so8vlJ2P1bo_KmpxTShGdg3lKCAqKaq1pzsAEGi5nwDD2bRhQ5jBbAW_e9M4uTCyI0IlZv5jYWZIzXsiNVfmxFzsHc7X6v09bg5USSHpnhebXoaJHG7A8015wE7pFeYrn_NFw4G44e-eDPDv1XFOqz7zh9fTQyHagsoYnLKnInv172_vYIFHvW_VItgWPV5f9i7Zfzk_wFaY891tSMGkRhjBmG6ZhRJlOUhlJleBQ4QTxBKcci1QzSqR5g6Tx_kKlxq4F5xJvQ3U0Hukd8BhLRJrwiCgDP6SBhUIpEwkhwynClPAaBBN5xqpsLm5nXLzELsgIeGxVEFsVxKUKanA8ZXktOmv8RbxpZT4lLMVdg_pEaXFpe1mMzN9wGiES7v7OdQiL7f5dJ-5cd2_3YMkOkC8OVepQzd_e9T4sqI98kL0duAX2BTmxzFA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Beyond+Transmitting+Bits%3A+Context%2C+Semantics%2C+and+Task-Oriented+Communications&rft.jtitle=IEEE+journal+on+selected+areas+in+communications&rft.au=Gunduz%2C+Deniz&rft.au=Qin%2C+Zhijin&rft.au=Inaki+Estella+Aguerri&rft.au=Dhillon%2C+Harpreet+S&rft.date=2023-01-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=0733-8716&rft.eissn=1558-0008&rft.volume=41&rft.issue=1&rft.spage=5&rft_id=info:doi/10.1109%2FJSAC.2022.3223408&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0733-8716&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0733-8716&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0733-8716&client=summon |