Bridging the Gap Between Imaging Performance and Image Quality Measures

Fry, E., Triantaphillidou, S., Jacobson, R., Jarvis, J. and Fagard-Jenkin, R. 2018. Bridging the Gap Between Imaging Performance and Image Quality Measures. IS&T Electronic Imaging Symposium 2018 - Image Quality System Performance XV. San Francisco, CA, USA 28 Jan - 01 Feb 2018 The Society of Imaging Science and Technology. doi:10.2352/ISSN.2470-1173.2018.12.IQSP-231

TitleBridging the Gap Between Imaging Performance and Image Quality Measures
AuthorsFry, E., Triantaphillidou, S., Jacobson, R., Jarvis, J. and Fagard-Jenkin, R.
TypeConference paper
Abstract

Imaging system performance measures and Image Quality Metrics (IQM) are reviewed from a systems engineering perspective, focusing on spatial quality of still image capture systems. We classify IQMs broadly as: Computational IQMs (CPIQM), Multivariate Formalism IQMs (MF-IQM), Image Fidelity Metrics (IF-IQM), and Signal Transfer Visual IQMs (STV-IQM). Comparison of each genre finds STV-IQMs well suited for capture system quality evaluation: they incorporate performance measures relevant to optical systems design, such as Modulation Transfer Function (MTF) and Noise-Power Spectrum (NPS); their bottom, modular approach enables system components to be optimised separately. We suggest that correlation between STV IQMs and observer quality scores is limited by three factors: current MTF and NPS measures do not characterize scene-dependent performance introduced by imaging system non-linearities; contrast sensitivity models employed do not account for contextual masking effects; cognitive factors are not considered. We hypothesise that implementation of scene and process-dependent MTF (SPD-MTF) and NPS (SPD-NPS) measures should mitigate errors originating from scene dependent system performance. Further, we propose implementation of contextual contrast detection and discrimination models to better represent low-level visual performance in image quality analysis. Finally, we discuss image quality optimization functions that may potentially close the gap between contrast detection/discrimination and quality.

KeywordsImage quality, Imaging system performance, image quality metrics, MTF, NPS
Year2018
ConferenceIS&T Electronic Imaging Symposium 2018 - Image Quality System Performance XV
PublisherThe Society of Imaging Science and Technology
Publisher's versioniqsp-2824359_1515877562990.pdf
Publication dates
Published13 Jan 2018
JournalElectronic Imaging
ISSN2470-1173
Digital Object Identifier (DOI)doi:10.2352/ISSN.2470-1173.2018.12.IQSP-231
Web address (URL) of conference proceedingshttp://ist.publisher.ingentaconnect.com/content/ist/ei
Web address (URL)http://www.ingentaconnect.com/content/ist/ei/pre-prints/content-ei2018-iqsp-231

Related outputs

Scene-and-Process-Dependent Spatial Image Quality Metrics
Fry, E., Triantaphillidou, S., Jenkin, R., Jacobson, R.E. and Jarvis, J. 2019. Scene-and-Process-Dependent Spatial Image Quality Metrics. Journal of Imaging Science and Technology.

Validation of Modulation Transfer Functions and Noise Power Spectra from Natural Scenes
Fry, E., Triantaphillidou, S., Jenkin, R., Jarvis, J. and Jacobson, R.E. 2019. Validation of Modulation Transfer Functions and Noise Power Spectra from Natural Scenes. Journal of Imaging Science and Technology.

Edge Detection Techniques for Quantifying Spatial Imaging System Performance and Image Quality
Van Zwanenberg, O., Triantaphillidou, S., Jenkin, R. and Psarrou, A. 2019. Edge Detection Techniques for Quantifying Spatial Imaging System Performance and Image Quality. The Conference on Computer Vision and Pattern Recognition (CVPR 2019). Long Beach California 15 - 21 Jun 2019 ACM/IEEE.

Contrast sensitivity in images of natural scenes
Triantaphillidou, S., Psarrou, A., Jarvis, J. and Gupta, G. 2019. Contrast sensitivity in images of natural scenes. Signal Processing: Image Communication . 75, pp. 64-75. doi:10.1016/j.image.2019.03.002

Image Quality Loss and Compensation for Visually Impaired Observers
Triantaphillidou, S., Fry, E., Sanchis, V. and Pons, A. 2018. Image Quality Loss and Compensation for Visually Impaired Observers. IS&T Electronic Imaging Symposium: Image Quality System Performance Conference. San Francisco, California, USA 28 Jan - 02 Feb 2018 The Society of Imaging Science and Technology. doi:10.2352/ISSN.2470-1173.2018.12.IQSP-365

Texture MTF from images of natural scenes
Branca, R., Triantaphillidou, S. and Burns, P.D. 2017. Texture MTF from images of natural scenes. Jenkin, R. and Jin, E. (ed.) Electronic Imaging: Image Quality and System Performance XIV. San Francisco, California, USA 29 Jan - 02 Feb 2017 The Society of Imaging Science and Technology. doi:10.2352/ISSN.2470-1173.2017.12.IQSP-255

Comparative performance between human and automated face recognition systems, using CCTV imagery, different compression levels and scene parameters
Tsifouti, A., Triantaphillidou, S., Larabi M-C, Bilissi, E. and Psarrou, A. 2015. Comparative performance between human and automated face recognition systems, using CCTV imagery, different compression levels and scene parameters . SPIE Electronic Imaging: Image Quality and System Performance XII. San Fransisco, USA Jan 2015 SPIE. doi:10.1117/12.2083325

The effects of scene content parameters, compression, and frame rate on the performance of analytics systems
Tsifouti, A., Triantaphillidou, S., Larabi, M.C., Doré, G, Bilissi, E. and Psarrou, A. 2015. The effects of scene content parameters, compression, and frame rate on the performance of analytics systems. SPIE Elecgtronic Imaging: Image Quality and System Performance XII. San Fransisco, USA Jan 2015 SPIE. doi:10.1117/12.2083426

Image quality optimization, via application of contextual contrast sensitivity and discrimination functions
Fry, E., Triantaphillidou, S., Jarvis, J. and Gupta, G. 2015. Image quality optimization, via application of contextual contrast sensitivity and discrimination functions. SPIE Electronic Imaging: Image Quality and System Performance XII. San Fransisco Jan 2015 SPIE. doi:10.1117/12.2082937

A case study in identifying acceptable bitrates for human face recognition tasks
Tsifouti, A., Triantaphillidou, S., Larabi, M.C., Bilissi, E. and Psarrou, A. 2015. A case study in identifying acceptable bitrates for human face recognition tasks. Signal Processing: Image Communication . 36, p. 14–28. doi:10.1016/j.image.2015.05.002

Perceptibility and acceptability of JPEG 2000 compressed images of various scene types
Allen, E., Triantaphillidou, S. and Jacobson, R.E. 2014. Perceptibility and acceptability of JPEG 2000 compressed images of various scene types. Triantaphillidou, S. and Larabi, M.C. (ed.) 2014 IS&T/SPIE Electronic Imaging. San Francisco, California 02 - 06 Feb 2014 SPIE. doi:10.1117/12.2042582

Special Section Guest Editorial: Image/Video Quality and System Performance
Larabi, M.C., Watson, A.B. and Triantaphillidou, S. 2014. Special Section Guest Editorial: Image/Video Quality and System Performance. Journal of Electronic Imaging. 23 (6), pp. 061101-1 - 061101-2. doi:10.1117/1.JEI.23.6.061101

Perceptibility and acceptability of JPEG 2000 compressed images of various scene types
Allen, E., Triantaphillidou, S. and Jacobson, R.E. 2014. Perceptibility and acceptability of JPEG 2000 compressed images of various scene types. SPIE Electronic Imaging: Image Quality and System Performance XI. San Francisco, USA Jan 2014 SPIE. doi:10.1117/12.2042582

Just noticeable differences in perceived image contrast with changes in displayed image size
Triantaphillidou, S., Park, J.Y. and Jacobson, R.E. 2014. Just noticeable differences in perceived image contrast with changes in displayed image size. SPIE Proceedings 9016, Image Quality and System Performance XI. San Francisco, USA doi:10.1117/12.2042534

Contrast sensitivity and discrimination in pictorial images
Triantaphillidou, S., Jarvis, J. and Gupta, G. 2014. Contrast sensitivity and discrimination in pictorial images. in: SPIE Proceedings 9016, Image Quality and System Performance XI SPIE.

Acceptable bit-rates for human face identification from CCTV imagery
Tsifouti, A., Triantaphillidou, S., Bilissi, E. and Larabi, M.C. 2013. Acceptable bit-rates for human face identification from CCTV imagery. in: Burns, P.D. and Triantaphillidou, S. (ed.) Image Quality and System Performance X SPIE.

Defining human contrast sensitivity and discrimination from complex imagery
Triantaphillidou, S., Jarvis, J., Gupta, G. and Rana, H. 2013. Defining human contrast sensitivity and discrimination from complex imagery. in: SPIE proceedings: Optics and Photonics for Counterterrorism, Crime Fighting and Defence IX; and Optical Materials and Biomaterials in Security and Defence Systems Technology X, 89010C SPIE.

Contrast sensitivity and discrimination of complex scenes
Triantaphillidou, S., Jarvis, J. and Gupta, G. 2013. Contrast sensitivity and discrimination of complex scenes. in: Burns, P.D. and Triantaphillidou, S. (ed.) Image Quality and System Performance X SPIE.

Mechanistic modeling of vertebrate spatial contrast sensitivity and acuity at low luminance
Jarvis, J. and Wathes, C.M. 2012. Mechanistic modeling of vertebrate spatial contrast sensitivity and acuity at low luminance. Visual Neuroscience. 29 (3), pp. 169-181. doi:10.1017/S0952523812000120

Evaluation of perceived image sharpness with changes in the displayed image size
Park, J.Y., Triantaphillidou, S., Jacobson, R.E. and Gupta, G. 2012. Evaluation of perceived image sharpness with changes in the displayed image size. in: SPIE proceedings: Electronic Imaging: Image Quality & System Performance IX, 82930J SPIE.

Visual scene busyness measures through a region growing spatial segmentation
Gupta, G., Psarrou, A., Triantaphillidou, S. and Park, J.Y. 2012. Visual scene busyness measures through a region growing spatial segmentation. in: Lewis, C. and Burgess, D. (ed.) Optics and Photonics for Counterterrorism, Crime Fighting, and Defence VIII SPIE.

Device-dependent scene-dependent quality predictions using effective pictorial information capacity
Oh, K.H., Triantaphillidou, S. and Jacobson, R.E. 2011. Device-dependent scene-dependent quality predictions using effective pictorial information capacity. in: SPIE proceedings: Image Quality and System Performance VIII, 78670R SPIE.

Scene classification with respect to image quality measurements
Oh, K.H., Triantaphillidou, S. and Jacobson, R.E. 2010. Scene classification with respect to image quality measurements. in: Farnand, S.P. and Gaykema, F. (ed.) Image quality and system performance VII : 18-19 January 2010, San Jose, California, United States Bellingham, Wash. SPIE.

Multidimensional image selection and classification system based on visual feature extraction and scaling
Mancusi, F., Triantaphillidou, S. and Allen, E. 2010. Multidimensional image selection and classification system based on visual feature extraction and scaling. in: Farnand, S.P. and Gaykema, F. (ed.) Image quality and system performance VII : 18-19 January 2010, San Jose, California, United States Bellingham, Wash. SPIE.

Stimulus luminance and the spatial acuity of domestic fowl (Gallus g. domesticus)
Gover, N., Jarvis, J., Abeyesinghe, S.M. and Wathes, C.M. 2009. Stimulus luminance and the spatial acuity of domestic fowl (Gallus g. domesticus). Vision Research: an international journal for functional aspects of vision. 49 (23), pp. 2747-2753. doi:10.1016/j.visres.2009.08.011

Measuring and modelling the spatial contrast sensitivity of the chicken (Gallus g. domesticus)
Jarvis, J., Abeyesinghe, S.M., McMahon, C.E. and Wathes, C.M. 2009. Measuring and modelling the spatial contrast sensitivity of the chicken (Gallus g. domesticus). Vision Research: an international journal for functional aspects of vision. 49 (11), pp. 1448-1454. doi:10.1016/j.visres.2009.02.019

Identification of image attributes that are most affected with changes in displayed image size
Park, J.Y., Triantaphillidou, S. and Jacobson, R.E. 2009. Identification of image attributes that are most affected with changes in displayed image size. in: Farnand, S.P. and Gaykema, F. (ed.) Image quality and system performance VI : 19-21 January 2009, San Jose, California, USA IS&T - The Society for Imaging and Science and Technology and SPIE.

Perceptual image attribute scales derived from overall image quality assessments
Oh, K.H., Triantaphillidou, S. and Jacobson, R.E. 2009. Perceptual image attribute scales derived from overall image quality assessments. in: Farnand, S.P. and Gaykema, F. (ed.) Image quality and system performance VI : 19-21 January 2009, San Jose, California, USA IS&T - The Society for Imaging and Science and Technology and SPIE.

A mechanistic inter-species comparison of spatial contrast sensitivity
Jarvis, J. and Wathes, C.M. 2008. A mechanistic inter-species comparison of spatial contrast sensitivity. Vision Research: an international journal for functional aspects of vision. 48 (21), pp. 2284-2292. doi:10.1016/j.visres.2008.07.002

Calculating luminous flux and lighting levels for domesticated mammals and birds
Saunders, J.E., Jarvis, J. and Wathes, C.M. 2008. Calculating luminous flux and lighting levels for domesticated mammals and birds. Animal: the international journal of animal biosciences. 2 (6), pp. 921-932. doi:10.1017/S1751731108002012

Subjective and objective measures of colour hard copy images
Attridge, G.G., Vagal, G., Allen, E., Triantaphillidou, S. and Pointer, M.R. 2008. Subjective and objective measures of colour hard copy images. Imaging Science Journal. 56 (3), pp. 163-174. doi:10.1179/174313108X281326

Colour analysis and verification of CCTV images under different lighting conditions
Smith, R.J., MacLennan-Brown, K., Triantaphillidou, S., MacDonald, L.W., Tighe, J.F. and Cohen, N. 2008. Colour analysis and verification of CCTV images under different lighting conditions. in: Farnand, S.P. and Gaykema, F. (ed.) Image quality and system performance V : 28-30 January 2008, San Jose, California, USA IS&T - The Society for Imaging and Science and Technology and SPIE.

Predicting image quality using a modular image difference model
Orfanidou, M., Triantaphillidou, S. and Allen, E. 2008. Predicting image quality using a modular image difference model. in: Farnand, S.P. and Gaykema, F. (ed.) Image quality and system performance V : 28-30 January 2008, San Jose, California, USA IS&T - The Society for Imaging and Science and Technology and SPIE.

On the calculation of optical performance factors from vertebrate spatial contrast sensitivity
Jarvis, J. and Wathes, C.M. 2007. On the calculation of optical performance factors from vertebrate spatial contrast sensitivity. Vision Research: an international journal for functional aspects of vision. 47 (17), pp. 2259-2271. doi:10.1016/j.visres.2007.04.015

Image quality comparison between JPEG and JPEG2000. II. Scene dependency, scene analysis, and classification
Triantaphillidou, S., Allen, E. and Jacobson, R.E. 2007. Image quality comparison between JPEG and JPEG2000. II. Scene dependency, scene analysis, and classification. Journal of Imaging Science and Technology. 51 (3), pp. 259-270.

Image quality comparison between JPEG and JPEG2000. I. Psychophysical investigation
Allen, E., Triantaphillidou, S. and Jacobson, R.E. 2007. Image quality comparison between JPEG and JPEG2000. I. Psychophysical investigation. Journal of Imaging Science and Technology. 51 (3), pp. 248-258. doi:10.2352/J.ImagingSci.Technol.(2007)51:3(248)

Effective pictorial information capacity as an image quality metric
Jenkin, R.B., Triantaphillidou, S. and Richardson, M.A. 2007. Effective pictorial information capacity as an image quality metric. in: Cui, L.C. and Miyake, Y. (ed.) Image Quality and System Performance IV: Proceedings of SPIE vol. 6494 SPIE.

Measurements of the modulation transfer function of image displays
Triantaphillidou, S. and Jacobson, R.E. 2004. Measurements of the modulation transfer function of image displays. Journal of Imaging Science and Technology. 48 (1), pp. 58-65.

Light, vision and the welfare of poultry
Prescott, N.B., Wathes, C.M. and Jarvis, J. 2003. Light, vision and the welfare of poultry. Animal Welfare. 12 (2), pp. 269-288.

A case study in the digitisation of a photographic collection
Triantaphillidou, S., Jacobson, R.E. and Attridge, G.G. 2002. A case study in the digitisation of a photographic collection. Imaging Science Journal. 50 (2), pp. 97-115.

Metric approaches to image quality
Jacobson, R.E. and Triantaphillidou, S. 2002. Metric approaches to image quality. in: MacDonald, L.W. and Luo, M.R. (ed.) Colour image science: exploiting digital media Chichester, UK Wiley. pp. 371-392

A Simple Approach in Digitising a Photographic Collection
Triantaphillidou, S. and Jacobson, R.E. 2001. A Simple Approach in Digitising a Photographic Collection. IS&T PICS. Montreal, Quebec, Canada April 2001 pp. 160-165

A simple approach to digitizing a photographic collection
Triantaphillidou, S. and Jacobson, R.E. 2001. A simple approach to digitizing a photographic collection. in: PICS 2001: Image Processing, Image Quality, Image Capture Systems Conference Society for Imaging Science and Technology. pp. 160-165

An evaluation of MTF determination methods for 35mm scanners
Triantaphillidou, S., Jacobson, R.E. and Fagard-Jenkin, R. 1999. An evaluation of MTF determination methods for 35mm scanners. IS&T PICS. Savannah, Georgia, USA April 1999 pp. 231-235

Preferred Tone Reproduction of Images on Soft Displays
Triantaphillidou, S., Jacobson, R.E. and Ford, A.M. 1998. Preferred Tone Reproduction of Images on Soft Displays. ICPS 1998. Antwerp September 1998 pp. 205-208

Permalink - https://westminsterresearch.westminster.ac.uk/item/q44vv/bridging-the-gap-between-imaging-performance-and-image-quality-measures


Share this
Tweet
Email