Pixel Value Adjustment to Reduce the Energy Requirements of Display Devices

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 132, No. 7, pp. 10–19
Abstract: The media and entertainment industry consumes a significant amount of energy to create, distribute, and present video content to consumers. A large proportion of this energy is used by display devices, notably by the 1.9+ billion displays installed in consumers’ homes globally. The production of light within a display is the main reason for this energy use, independent of display technology. Reducing the global energy use of display devices by any means possible is, therefore, a topic of prime concern. Due to the very large number of displays currently in use, even small reductions per display may end up globally saving enormous amounts of energy. In this spirit, we present a video processing technique that can reduce energy requirements without altering the visual quality of the displayed material. For use cases whereby a viewer would accept a certain loss of visual quality, a user parameter could be exposed that further reduces display energy requirements.
Publication Date: 2023-08-01
DOI: 10.5594/JMI.2023.3285245
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2023.3285245
Author(s): Erik Reinhard
bio
Erik Reinhard is a distinguished scientist at InterDigital Cesson-Sévigné, France, since June 2019. Before that, he held the same position at Technicolor R&I Cesson-Sevigné, starting in July 2013 and before that he held various academic positions at universities and research institutes in Europe and North America. He was the founder and editor-in-chief of ACM Transactions on Applied Perception and authored books on high dynamic range (HDR) imaging, color imaging, computer graphics, and natural image statistics. He has published more than 100 papers and was a member of more than 50 program committees. He was a program co-chair of six conferences and workshops, including the Eurographics Symposium on Rendering 2011. He delivered keynotes at Eurographics 2010, the Computational Color Imaging Workshop 2011, the IS&T European Conference on Color in Graphics, Imaging, and Vision 2012, the IS&T Color Imaging Conference 2022, and the ACM/SIGGRAPH Conference on Visual Media Processing 2022. He is the co-chair of the Rapporteur Group on Energy Aware Broadcasting at ITU-R and co-lead of the Study Mission on Energy Aware Service Delivery and Consumption at DVB. Finally, he won a test of time award for his color transfer paper in IEEE Computer Graphics and Applications
Claire-Hélène Demarty
bio
Claire-Hélène Demarty is a senior scientist at InterDigital Cesson-Sévigné, France. She graduated from Telecom ParisTech, Paris, France, in 1994 and received a PhD degree in computer science and mathematical morphology, from Mines ParisTech, Paris, in 2000. She joined InterDigital Research & Innovation Center in 2019 as a senior scientist. Before InterDigital, she worked at Technicolor Cesson-Sevigné (2004–2018), LTUTechnologies, Paris (2002–2004), and INRIA Rennes—IRISA, Rennes, France (2003–2004), as a researcher in image analysis and computer vision technologies. Her research focuses on multimedia indexing technologies and perceptual understanding of content, through the use of machine learning, and more recently energy-aware media. She is the author or coauthor of more than 30 papers and holds several patents.
Laurent Blondé
bio
Laurent Blondé is a seasoned principal scientist at InterDigital Cesson-Sévigné, France. He graduated from Institut d’Optique Graduate School Palaiseau, France, in 1985 and received a PhD degree in signal and image processing from Rennes University, Rennes, France. His career has focused in part on various applications of image analysis, synthesis, depth, and color vision, mainly for TV and cinema applications. He has also focused on optics, light propagation understanding, light-matter interaction at wavelength scale, and metasurfaces. In his toolbox, he has image processing, mathematics, teamwork experience, and, mostly, creative thinking. He likes working in an international environment and enjoys interacting with diverse people from various cultures and fields of expertise. He is the author and co-author of papers and patents.
Keyword(s): Display, Energy Consumption, Image Processing, Visual Perception
Copyright: © 2023 SMPTE

Bibliographic Reference(s)

Perceptual Signal Coding for More Efficient Usage of Bit Codes [Active]
P. Chondro and S.-J. Ruan, “Perceptually Hue-Oriented Power-Saving Scheme With Overexposure Corrector for AMOLED Displays,” J. Display Technol., 12(8):791–800, 2016. EXTERNAL
A. Iranli and M. Pedram, “DTM: Dynamic Tone Mapping for Backlight Scaling,” Proc. of the 42nd Annu. Des. Autom. Conf., pp. 612–617, 2005. EXTERNAL
O. Le Meur, C.-H. Demarty, E. Reinhard, F. Aumont, and EXTERNAL
M. Park and M. Song, “Saving Power in Video Playback on OLED Displays by Acceptable Changes to Perceived Brightness,” J. Display Technol., 12(5):483–490, 2015. EXTERNAL
T. K. Wee and R. K. Balan, “Adaptive Display Power Management for OLED Displays,” Proc. of the First ACM Int. Workshop on Mobile Gaming, pp. 25–30, 2012. EXTERNAL
T. K. Wee, T. Okoshi, A. Misra, and R. K. Balan, “FOCUS: A Usable & Effective Approach to OLED Display Power Management,” Proc. of the 2013 ACM Int. Joint Conf. on Pervasive and Ubiquitous Comput., pp. 573–582, 2013. EXTERNAL
K. Hirai, N. Tsumura, T. Nakaguchi, and Y. Miyake, “Measurement and Modeling of Viewing-Condition-Dependent a stronger reduction of energy before the results were to become noticeable. For viewers who would accept a certain degradation of the visual quality in return for a reduction of energy use, we note that as the parameter f is increased further, the visual quality reduces in a graceful and predictable manner. EXTERNAL
European Union, “A European Green Deal: Striving to be the First Climate-Neutral Continent,” Dec. 2019. Accessed: Jun. 23, 2023. [Online]. Available: https://com-mission.europa.eu/strategy-and-policy/priorities-2019-2024/european-green-deal_en EXTERNAL
P. G. J. Barten, Contrast Sensitivity of the Human Eye and Its Effects on Image Quality, SPIE Press, 1999. EXTERNAL
J. Malmodin, “The Power Consumption of Mobile and Fixed Network Data Services—The Case of Streaming Video and Downloading Large Files,” Electronics Goes Green 2020+, pp. 87–96, 2020. EXTERNAL
P. Chondro, Z.-R. Yao, and S.-J. Ruan, “Depth-Based Dynamic Lightness adjustment Power-Saving Algorithm for AMOLED in Head-Mounted Display,” Opt. Express, 26(25):33158–33165, 2018. EXTERNAL
H. Jegou, M. Douze, and C. Schmid, “Hamming Embedding and Weak Geometry Consistency for Large Scale Image Search— Extended Version,” INRIA, Tech. Rep. 6709, 2008. EXTERNAL
H.-Y. Lin, P.-C. Hsiu, and T.-W. Kuo, “ShiftMask: Dynamic OLED Power Shifting Based on Visual Acuity for Interactive Mobile Applications,” 2017 IEEE/ACM Int. Symp. on Low Power Electron. and Des. (ISLPED), IEEE, pp. 1–6, 2017. EXTERNAL
D. Schien, P. Shabajee, J. Chandaria, D. Williams, C. Preist, and C. Fletcher, “Using Behavioural Data to Assess the Environmental Impact of Electricity Consumption of Alternate Television Service Distribution Platforms,” BBC Research, Tech. Rep., WHP 372, 2020. EXTERNAL
The Carbon Trust, “Carbon Impact of Video Streaming,” The Carbon Trust, Tech. Rep., 2021. EXTERNAL
N. Ricker, “Wavelet Functions and Their Polynomials,” Geophysics, 9(3):314–323, 1944. EXTERNAL
J. A. Movshon and L. Kiorpes, “Analysis of the Development of Spatial Contrast Sensitivity in Monkey and Human Infants,” J. Opt. Soc. America A, 5(12):2166–2172, 1988. EXTERNAL
J. G. Robson, “Spatial and Temporal Contrast-Sensitivity Functions of the Visual System,” JOSA, 56(8):1141–1142, 1966. EXTERNAL
T.-C. Chang, S. S.-D. Xu, and S.-F. Su, “SSIM-Based Qualityon-Demand Energy-Saving Schemes for OLED Displays,” IEEE Trans. Syst. Man Cybern. Syst., 46(5):623–635, 2015. EXTERNAL
A. Iranli, H. Fatemi, and M. Pedram, “HEBS: Histogram Equalization for Backlight Scaling,” Design, Autom. and Test in Europe, IEEE, pp. 346–351, 2005. EXTERNAL
Y. Wang, “Frequencies of the Ricker Wavelet,” Geophysics, 80(2):A31–A37, 2015. EXTERNAL
J. Malmodin and D. Lunde, “The Energy and Carbon Footprint of the Global ICT and E&M Sectors 2010–2015,” Sustainability, 10(9):3027, 2018. EXTERNAL
C.-H. Lin, C.-K. Kang, and P.-C. Hsiu, “CURA: A Framework for Quality-Retaining Power Saving on Mobile OLED Displays,” ACM Trans. Embedded Comput. Syst. (TECS), 15(4):1–25, 2016. EXTERNAL
United Nations, “Sustainable Development Goals,” 2022. Accessed: Jun. 23, 2023. [Online]. Available: https://www.un.org/sustainabledevelopment/ EXTERNAL
L.-M. Jan, F.-C. Cheng, C.-H. Chang, S.-J. Ruan, and C.-A. Shen, “A Power-Saving Histogram Adjustment Algorithm for OLED-Oriented Contrast Enhancement,” J. Display Technol., 12(4):368–375, 2015. EXTERNAL
M. Hort, M. Kechagia, F. Sarro, and M. Harman, “A Survey of Performance Optimization for Mobile Applications,” IEEE Trans. Softw. Eng., 48:2879–2904, 2021. EXTERNAL
D. H. Kelly, “Theory of Flicker and Transient Responses, I. Uniform fields,” J. Opt. Soc. America A, 61(4):537–546, 1971. EXTERNAL
C.-H. Yeh, K. S.-H. Lo, and W. Lin, “Visual-Attention-Based Pixel Dimming Technique for OLED Displays of Mobile Devices,” IEEE Trans. Ind. Electron., 66(9):7159–7167, 2018. EXTERNAL
X. Chen, K. W. Nixon, H. Zhou, Y. Liu, and Y. Chen, “Fingershadow: An OLED Power Optimization Based on Smartphone Touch Interactions,” 6th Workshop on Power-Aware Comput. and Syst. (HotPower 14), 2014. EXTERNAL
D. H. Kelly, “Motion and Vision. I. Stabilized Images of Stationary Gratings,” J. Opt. Soc. America A, 69(9):1266–1274, 1979. EXTERNAL
S. J. Daly, “Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity,” Human Vision, Visual Processing, and Digital Display III, International Society for Optics and Photonics, vol. 1666, pp. 2–15, 1992. EXTERNAL
S. Pasricha, R. Ayoub, M. Kishinevsky, S. K. Mandal, and U. Y. Ogras, “A Survey on Energy Management for Mobile and IOT Devices,” IEEE Des. Test, 37(5):7–24, 2020. EXTERNAL
D. H. Kelly, “Motion and Vision. II. Stabilized Spatio-Temporal Threshold Surface,” J. Opt. Soc. America A, 69(10):1340–1349, 1979. EXTERNAL
S. De Groot and J. Gebhard, “Pupil Size as Determined by Adapting Luminance,” J. Opt. Soc. America, 42(7):492–495, 1952. EXTERNAL
P.-C. Tsai, P. Chondro, and S.-J. Ruan, “Depth-Guided Pixel Dimming With Saliency-Oriented Power-Saving Transformation for Stereoscope AMOLED Displays,” IEEE Trans. Circuits Syst. Video Technol., 30(9):3095–3105, 2019. EXTERNAL
A. Iranli, W. Lee, and M. Pedram, “HVS-Aware Dynamic Backlight Scaling in TFT-LCDs,” IEEE Trans. VLSI Syst., 14(10):1103–1116, 2006. EXTERNAL
P. K. Choubey, A. K. Singh, R. B. Bankapur, P. Vaisakh, and M. Prabhu, “Content Aware Targeted Image Manipulation to Reduce Power Consumption in OLED Panels,” 2015 Eighth Int. Conf. on Contemporary Comput. (IC3), IEEE, pp. 467–471, 2015. EXTERNAL
D. Li, B. Guo, Y. Shen, J. Li, and Y. Huang, “Making Image More Energy Efficient for OLED Smart Devices,” Mobile Inf. Syst., 2016:1–8, 2016. EXTERNAL
Cisco, “VNI Complete Forecast Highlights,” 2018. Accessed: Jun. 23, 2023. [Online]. Available: https://www.cisco.com/c/dam/m/en_us/solutions/service-provider/vni-forecast-highlights/pdf/Global_2022_Forecast_Highlights.pdf EXTERNAL
M. Dong, Y.-S. K. Choi, and L. Zhong, “Power-Saving Color Transformation of Mobile Graphical User Interfaces on OLED-Based Displays,” Proc. of the 2009 ACM/IEEE Int. Symp. on Low Power Electron. and Des., pp. 339–342, 2009. EXTERNAL
N. Wang and C. Lu, “Two-Dimensional Continuous Wavelet Analysis and its Application to Meteorological Data,” J. Atmos. Ocean. Technol., 27(4):652–666, 2009. EXTERNAL
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image Quality Assessment: From Error Visibility to Structural Similarity,” IEEE Trans. Image Process., 13(4):600–612, 2004. EXTERNAL
J. Laird, M. Rosen, J. Pelz, E. Montag, and S. Daly, “Spatio-Velocity CSF as a Function of Retinal Velocity Using Unstabilized Stimuli,” Human Vision and Electron. Imag. XI, International Society for Optics and Photonics, vol. 6057, p. 605705, 2006. EXTERNAL
ITU-R BT.2100-2 [Active]
R-REC-BT.2521-0 — International Telecommunication Union—Radiocommunication (ITU-R), Recommendation BT.2521-0, “Practical Examples of Actions to Realize Energy Aware Broadcasting,” International Telecommunication Union, Tech. Rep., 2023. About the authors Erik Reinhard is a distinguished scientist at InterDigital Cesson-Sévigné, France, since June 2019. Before that, he held the same position at Technicolor R&I Cesson-Sevigné, starting in July 2013 and before that he held various academic positions at universities and research institutes in Europe and North America. He was the founder and editor-in-chief of ACM Transactions on Applied Perception and authored books on high dynamic range (HDR) imaging, color imaging, computer graphics, and natural image statistics. He has published more than 100 papers and was a member of more than 50 program committees. He was a program co-chair of six conferences and workshops, including the Eurographics Symposium on Rendering 2011. He delivered keynotes at Eurographics 2010, the Computational Color Imaging Workshop 2011, the IS&T European Conference on Color in Graphics, Imaging, and Vision 2012, the IS&T Color Imaging Conference 2022, and the ACM/SIGGRAPH Conference on Visual Media Processing 2022. He is the co-chair of the Rapporteur Group on Energy Aware Broadcasting at ITU-R and co-lead of the Study Mission on Energy Aware Service Delivery and Consumption at DVB. Finally, he won a test of time award for his color transfer paper in IEEE Computer Graphics and Applications. A contribution received April 2023. Copyright © 2023 by SMPTE. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2023.3285245.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Erik Reinhard, Claire-Hélène Demarty, and Laurent Blondé; Pixel Value Adjustment to Reduce the Energy Requirements of Display Devices, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 7, August 2023); SMPTE, 2023. Available at https://doi.org/10.5594/JMI.2023.3285245

Snippet:

Erik Reinhard, Claire-Hélène Demarty, and Laurent Blondé; Pixel Value Adjustment to Reduce the Energy Requirements of Display Devices, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 7, August 2023); SMPTE, 2023. Available at https://doi.org/10.5594/JMI.2023.3285245

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Erik Reinhard, Claire-Hélène Demarty, and Laurent Blondé; <cite>Pixel Value Adjustment to Reduce the Energy Requirements of Display Devices</cite>, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 7, August 2023); SMPTE, 2023. Available at <a href="https://doi.org/10.5594/JMI.2023.3285245" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2023.3285245</a></span>

SMPTE's HTML Pub

Preview:

Erik Reinhard, Claire-Hélène Demarty, and Laurent Blondé; Pixel Value Adjustment to Reduce the Energy Requirements of Display Devices, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 7, August 2023); SMPTE, 2023
doi: 10.5594/JMI.2023.3285245
url: https://doi.org/10.5594/JMI.2023.3285245

Snippet:

<li>
Erik Reinhard, Claire-Hélène Demarty, and Laurent Blondé; <cite id="bib-10-5594-jmi-2023-3285245">Pixel Value Adjustment to Reduce the Energy Requirements of Display Devices</cite>, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 7, August 2023); SMPTE, 2023
<span class="doi">10.5594/JMI.2023.3285245</span>
</li>