Mitigating Low-Level Visual Hallucinations Requires Self-Awareness: Database, Model and Training Strategy
The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several tasks into a single visual question-answering framework. However, these models are prone to hallucinations, which limit their reliability as...
Uloženo v:
| Vydáno v: | IEEE transactions on circuits and systems for video technology s. 1 |
|---|---|
| Hlavní autoři: | , , , , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
IEEE
2025
|
| Témata: | |
| ISSN: | 1051-8215, 1558-2205 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several tasks into a single visual question-answering framework. However, these models are prone to hallucinations, which limit their reliability as artificial intelligence systems. While this issue is extensively researched in natural language processing and image captioning, there remains a lack of investigation of hallucinations in Low-level Visual Perception and Understanding (HLPU), especially in the context of image quality assessment tasks. We consider that these hallucinations arise from an absence of clear self-awareness within the models. To address this issue, we first introduce the HLPU instruction database, the first instruction database specifically focused on hallucinations in low-level vision tasks. This database contains approximately 200K question-answer pairs and comprises four subsets, each covering different types of instructions. Subsequently, we propose the Self-Awareness Failure Elimination (SAFEQA) model, which utilizes image features, salient region features and quality features to improve the perception and comprehension abilities of the model in low-level vision tasks. Furthermore, we propose the Enhancing Self-Awareness Preference Optimization (ESA-PO) framework to increase the model's awareness of knowledge boundaries, thereby mitigating the incidence of hallucination. Finally, we conduct comprehensive experiments on low-level vision tasks, with the results demonstrating that our proposed method significantly enhances self-awareness of the model in these tasks and reduces hallucinations. Notably, our proposed method improves both accuracy and self-awareness of the proposed model and outperforms close-source models in terms of various evaluation metrics. This research contributes to the advancement of self-awareness capabilities in multimodal large language models, particularly for low-level visual perception and understanding tasks. |
|---|---|
| AbstractList | The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several tasks into a single visual question-answering framework. However, these models are prone to hallucinations, which limit their reliability as artificial intelligence systems. While this issue is extensively researched in natural language processing and image captioning, there remains a lack of investigation of hallucinations in Low-level Visual Perception and Understanding (HLPU), especially in the context of image quality assessment tasks. We consider that these hallucinations arise from an absence of clear self-awareness within the models. To address this issue, we first introduce the HLPU instruction database, the first instruction database specifically focused on hallucinations in low-level vision tasks. This database contains approximately 200K question-answer pairs and comprises four subsets, each covering different types of instructions. Subsequently, we propose the Self-Awareness Failure Elimination (SAFEQA) model, which utilizes image features, salient region features and quality features to improve the perception and comprehension abilities of the model in low-level vision tasks. Furthermore, we propose the Enhancing Self-Awareness Preference Optimization (ESA-PO) framework to increase the model's awareness of knowledge boundaries, thereby mitigating the incidence of hallucination. Finally, we conduct comprehensive experiments on low-level vision tasks, with the results demonstrating that our proposed method significantly enhances self-awareness of the model in these tasks and reduces hallucinations. Notably, our proposed method improves both accuracy and self-awareness of the proposed model and outperforms close-source models in terms of various evaluation metrics. This research contributes to the advancement of self-awareness capabilities in multimodal large language models, particularly for low-level visual perception and understanding tasks. |
| Author | Min, Xiongkuo Zhang, Zicheng Gao, Yixuan Cao, Yuqin Sun, Yinan Zhai, Guangtao |
| Author_xml | – sequence: 1 givenname: Yinan orcidid: 0009-0004-3054-4268 surname: Sun fullname: Sun, Yinan – sequence: 2 givenname: Xiongkuo orcidid: 0000-0001-5693-0416 surname: Min fullname: Min, Xiongkuo – sequence: 3 givenname: Zicheng orcidid: 0000-0002-7247-7938 surname: Zhang fullname: Zhang, Zicheng – sequence: 4 givenname: Yixuan orcidid: 0000-0002-6292-0529 surname: Gao fullname: Gao, Yixuan – sequence: 5 givenname: Yuqin surname: Cao fullname: Cao, Yuqin – sequence: 6 givenname: Guangtao orcidid: 0000-0001-8165-9322 surname: Zhai fullname: Zhai, Guangtao |
| BookMark | eNpFkF1LwzAYhYNMcJv-AfEiP8DOvEmTdt6N-TGhQ3B1t-Vtk45ITTXpHPv3dm7g1TlweM7FMyID1zpDyDWwCQCb3uXz1TqfcMblRCiYSpmekSH0EXHO5KDvTEKUcpAXZBTCB2MQp3EyJHZpO7vBzroNzdpdlJkf09C1DVts6AKbZltZ18-tC_TNfG-tN4GuTFNHsx1640wI9_QBOywxmFu6bHWPo9M092jd4XXVeezMZn9Jzmtsgrk65Zi8Pz3m80WUvT6_zGdZVIFQXSRrBF0qzZIqQdQx04mSlWJTUaVCoZKJqGPQMUcDNRPAy5KBFoiSMVYqFGPCj7-Vb0Pwpi6-vP1Evy-AFQdZxZ-s4iCrOMnqoZsjZI0x_wDANJFCil8S9mlk |
| CODEN | ITCTEM |
| ContentType | Journal Article |
| DBID | 97E RIA RIE AAYXX CITATION |
| DOI | 10.1109/TCSVT.2025.3619558 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1558-2205 |
| EndPage | 1 |
| ExternalDocumentID | 10_1109_TCSVT_2025_3619558 11197535 |
| Genre | orig-research |
| GroupedDBID | -~X 0R~ 29I 4.4 5GY 6IK 97E AAJGR AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACGFS ACIWK AENEX AGQYO AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS HZ~ IFIPE IPLJI JAVBF LAI O9- OCL P2P RIA RIE RNS RXW TAE TN5 5VS AAYXX AETIX AGSQL AI. AIBXA ALLEH CITATION EJD H~9 ICLAB IFJZH M43 VH1 |
| ID | FETCH-LOGICAL-c136t-5fa1db6d07c7aad40d765c6093c836a6573f41d42ae1f0312bb01d3aa5000b6a3 |
| IEDL.DBID | RIE |
| ISSN | 1051-8215 |
| IngestDate | Sat Nov 29 07:11:06 EST 2025 Wed Oct 15 14:20:46 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c136t-5fa1db6d07c7aad40d765c6093c836a6573f41d42ae1f0312bb01d3aa5000b6a3 |
| ORCID | 0000-0001-5693-0416 0009-0004-3054-4268 0000-0001-8165-9322 0000-0002-7247-7938 0000-0002-6292-0529 |
| PageCount | 1 |
| ParticipantIDs | crossref_primary_10_1109_TCSVT_2025_3619558 ieee_primary_11197535 |
| PublicationCentury | 2000 |
| PublicationDate | 2025-00-00 |
| PublicationDateYYYYMMDD | 2025-01-01 |
| PublicationDate_xml | – year: 2025 text: 2025-00-00 |
| PublicationDecade | 2020 |
| PublicationTitle | IEEE transactions on circuits and systems for video technology |
| PublicationTitleAbbrev | TCSVT |
| PublicationYear | 2025 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| SSID | ssj0014847 |
| Score | 2.4584467 |
| Snippet | The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several... |
| SourceID | crossref ieee |
| SourceType | Index Database Publisher |
| StartPage | 1 |
| SubjectTerms | Accuracy Analytical models Feature extraction hallucination Image quality image quality assessment Large language models low-level vision Multimodal large language models Reliability Training Visual databases Visual perception Visualization |
| Title | Mitigating Low-Level Visual Hallucinations Requires Self-Awareness: Database, Model and Training Strategy |
| URI | https://ieeexplore.ieee.org/document/11197535 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1558-2205 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0014847 issn: 1051-8215 databaseCode: RIE dateStart: 19910101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV05T8MwFLYAMcDAjbjlgQ0MSezYCRsqoA6lQrRU3aLnC0WqUkRbEP8e20mhCwObFdlS9D7bz-_8EDrnqaVGWkukjXPCZMYISOH2MiSJEpZpxSCQTYhuNxsO86emWD3UwhhjQvKZufLDEMvXYzXzrrLr2Me8Upouo2UheF2s9RMyYFlgE3PvhZhkTpHNK2Si_Lrf6g36zhZM0ivqDIbU87svaKEFWpWgVR42__k_W2ijeT7i2xrvbbRkqh20vtBUcBeVj2XdN6N6xZ3xJ-n4tCA8KCczt7ANo9FMlbULcIKfjU8ENhPcMyNLbj99ZZi7-m7wHUzBK7hL7MnSRhgqjfsNmwRuOtp-7aGXh_t-q00aQgWiYsqnJLUQa8l1JJQA0CzSgqeKRzlVGeXAU0EtizVLwMTWnfZEyijWFAJrguRA99FKNa7MAcJ55kzb3AFpGTBuJLh7KlLOGIWI55LBIbqYC7h4q_tmFMHeiPIiwFF4OIoGjkO056X7O7MR7NEf34_Rml9eu0JO0Mr0fWZO0ar6mJaT97OwL74Brb-3SQ |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LT9wwELbaBalw4NGCeLX4wK0YnPiRhBuCokUsK1QC4haNXyjSKovYXVb997Wd0O6lh94iK46sGcfjeXzzIXQkhWNWOUeUSwrCVc4JqMzvZUhTnTluNIdINpENh_nTU3HXgdUjFsZaG4vP7El4jLl8M9azECo7TULOSzDxES0JzlPawrX-JA14HvnE_I0hIbk3Ze8YGVqclhf3j6X3BlNxwrzLIALD-4IdWiBWiXblav0_V7SB1roLJD5vNb6JPtjmM1pdaCv4BdW3dds5o3nGg_GcDEJhEH6sJzM_sQ-j0UzXbRBwgn_aUApsJ_jejhw5nwdsmD_8zvAlTCGYuGMc6NJGGBqDy45PAnc9bX9toYerH-VFn3SUCkQnTE6JcJAYJQ3NdAZgODWZFFrSgumcSZAiY44nhqdgE-f_91QpmhgGkTdBSWDbqNeMG7uDcJF757bwqnQcuLQK_ElFtXdHgcpCcdhF398FXL20nTOq6HHQoorqqII6qk4du2grSPfvm51g9_4xfog-9cvbQTW4Ht7so5XwqTYwcoB609eZ_YqW9du0nrx-i3vkN2S5upA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Mitigating+Low-Level+Visual+Hallucinations+Requires+Self-Awareness%3A+Database%2C+Model+and+Training+Strategy&rft.jtitle=IEEE+transactions+on+circuits+and+systems+for+video+technology&rft.au=Sun%2C+Yinan&rft.au=Min%2C+Xiongkuo&rft.au=Zhang%2C+Zicheng&rft.au=Gao%2C+Yixuan&rft.date=2025&rft.pub=IEEE&rft.issn=1051-8215&rft.spage=1&rft.epage=1&rft_id=info:doi/10.1109%2FTCSVT.2025.3619558&rft.externalDocID=11197535 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1051-8215&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1051-8215&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1051-8215&client=summon |