Large-Scale Crowdsourcing Subjective Quality Evaluation of Learning-Based Image Coding

Learning-based image codecs produce different compression artifacts, when compared to the blocking and blurring degradation introduced by conventional image codecs, such as JPEG, JPEG 2000 and HEIC. In this paper, a crowdsourcing based subjective quality evaluation procedure was used to benchmark a...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Visual communications and image processing (Online) s. 1 - 5
Hlavní autoři: Upenik, Evgeniy, Testolina, Michela, Ascenso, Joao, Pereira, Fernando, Ebrahimi, Touradj
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 05.12.2021
Témata:
Benchmark testing
Codecs
Crowdsourcing
deep learning
Degradation
Image coding
learning-based compression
subjective evaluation
Transform coding
Visual communication
visual quality
ISSN:2642-9357
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Learning-based image codecs produce different compression artifacts, when compared to the blocking and blurring degradation introduced by conventional image codecs, such as JPEG, JPEG 2000 and HEIC. In this paper, a crowdsourcing based subjective quality evaluation procedure was used to benchmark a representative set of end-to-end deep learning-based image codecs submitted to the MMSP'2020 Grand Challenge on Learning-Based Image Coding and the JPEG AI Call for Evidence. For the first time, a double stimulus methodology with a continuous quality scale was applied to evaluate this type of image codecs. The subjective experiment is one of the largest ever reported including more than 240 pair-comparisons evaluated by 118 naïve subjects. The results of the benchmarking of learning-based image coding solutions against conventional codecs are organized in a dataset of differential mean opinion scores along with the stimuli and made publicly available.
ISSN:2642-9357
DOI:10.1109/VCIP53242.2021.9675314