Purpose: Whole slide imaging (WSI) scanners produce tissue slide images with a large field of view and a high resolution for pathologists to use in diagnoses. Color performance tests of these color imaging devices are necessary and can use stained tissue slides if the color truth is established using a hyperspectral imaging microscopy system (HIMS). The purpose of this study was to estimate the reproducibility uncertainty of CIELAB coordinates for a reference tissue slide measured by both the HIMS and a WSI scanner.

Approach: We compared the color performances of the WSI scanner to those of the reference established by the HIMS using the International Commission on Illumination (Commission Internationale de l’Éclairage, or CIE) 1976 ΔEab* color difference with the just noticeable color difference (JNCD, ΔEab*≤2), and the results from the overlap of the CIELAB coordinates’ uncertainty within the error bar, with a coverage factor k  =  2. The reported uncertainty results from measurements and image registration uncertainties.

Results: For the blank area common to the HIMS and the WSI average images, the color agreement was higher using the JNCD condition versus the CIELAB uncertainty overlap criterion (82% and 20% of the pixels in the images, respectively). This difference is explained by the fact that numerous pixels have CIELAB coordinates near one another but corresponding to CIELAB uncertainty values small enough not to overlap. In the colored area of the images, the JNCD condition was met for 0.19% of the pixels in the images, compared with 4.3% for the CIELAB uncertainty overlap criterion.

Conclusions: The distribution of uncertainties on the CIELAB coordinates was broader for the HIMS compared with the WSI scanner. The WSI scanner had a systemic error in the color reproduction, which pointed to a potential inadequate color calibration of this device.