High dynamic range (HDR) and wide color gamut imagery has an established video ecosystem, spanning image capture to encoding and display. This drives the need for evaluating how image quality is affected by the multitudes of ecosystem parameters. The simplest quality metrics evaluate color differences on a pixel-by-pixel basis. In this article, we evaluate a series of these color difference metrics on four HDR and three standard dynamic range publicly available distortion databases consisting of natural images and subjective scores. We compare the performance of the well-established CIE L*a*b* metrics (Delta E-00, Delta E-94) alongside two HDR-specific metrics (Delta E-Z [J(z)a(z)b(z)], Delta E-ITP [ICTCP]) and a spatial CIE L*a*b* extension (Delta E00S). We also present a novel spatial extension to Delta E-ITP derived by optimizing the opponent color contrast sensitivity functions. We observe that this advanced metric, Delta EITPSC, outperforms the other color difference metrics, and we quantify the improved performance with the steps of metric advancement.