HDR and WCG Image Quality Assessment Using Color Difference Metrics

Anustup Choudhury, Jaclyn Pytlarz, Scott Daly

High Dynamic Range (HDR) and Wide Color Gamut (WCG) imagery is now mainstream across content creation. Thus, having a reliable way of evaluating HDR systems is essential. One common way of measuring the quality of an HDR system is measuring the color errors introduced along the imaging pipeline. Unfortunately, development of color difference metrics has been based on test patches, as opposed to natural imagery, with evaluation mostly limited to Standard Dynamic Range (SDR) databases. In this paper, we evaluate several color difference metrics on five publicly available HDR distortion databases consisting of natural images and subjective scores. Distortion types include lower frequency distortions such as those from tone-mapping as well as higher frequency distortions resulting from compression artifacts by the various compression schemes such as JPEG. We analyze these databases with the well-established CIE L*a*b* metrics (ΔE00, ΔE94) as well as two HDR specific metrics: ΔEz (Jzazbz) and ΔEITP (ICTCP). To quantify the performance, we use four standard performance evaluation procedures. We observe that ΔEITP outperforms the other color difference metrics on four out of five databases. We also perform statistical analysis which demonstrates the effectiveness of using ΔEITP to assess overall image quality of HDR/WCG content. Weaknesses of all metrics for one database suggests more advanced spatio-chromatic visual models are worth pursuing.

Published
2019-10
Content type
Original Research
Keywords
High Dynamic Range, Wide Color Gamut, Color Difference Metric, ICTCP, ΔEITP
DOI
10.5594/M001882