Improving Context-Aware Encoding by Adaptation to “True Resolution” of the Content

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2023, No. 10, pp. 9–12
Abstract: As well known, when the input video is upscaled, the effectiveness of its transcoding and delivery may suffer. The encoded stream may not look sharp and use more bits than necessary.
Publication Date: 2023-10-16
DOI: 10.5594/M002015
ISBN: Print: 978-1-61482-964-5
Link: https://doi.org/10.5594/M002015
Author(s): Yuriy ReznikBrightcove Inc, Boston, MA, USA
Karl LillevoldBrightcove Inc, Boston, MA, USA
Abhijith JagannathBrightcove Inc, Boston, MA, USA
Nabajeet BarmanKingston University, London, UK.
Keyword(s): Video Resolution Detection, Context-aware Encoding, Content-Adaptive Encoding, Adaptive Bitrate Streaming, DASH, HLS
Copyright: © 2023 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

Optimizing Mass-Scale Multi-Screen Video Delivery [Active]
Transitioning Broadcast to Cloud [Active]
Native Resolution Detection of Video Sequences [Active]
ISO/IEC 14496-10 [Active]
ISO/IEC 23008-2 [Active]
ISO.23009-1.2019 — International Organization for Standardization/International Electrotechnical Commision (ISO/IEC) 23009-1:2019, “Information Technology—Dynamic Adaptive Streaming Over HTTP (DASH)—Part 1: Media Presentation Description and Segment Formats (4th Ed.),” 2019. [Online]. Available: https://www.iso.org/standard/79329.html EXTERNAL
ISO.23090-3.2022 — ISO/IEC 23090-3:2022, "Information technology — Coded representation of immersive media — Part 3: Versatile video coding," ISO/IEC, 2022. EXTERNAL
D. P. Mitchell and A. N. Netravali, "Reconstruction filters in computer graphics," Computer Graphics, vol. 22, no. 4, pp. 221–228, Aug. 1988. EXTERNAL
R. Vanam, K. Lillevold, Y. Reznik, "Assessing objective video quality in systems with multigeneration transcoding," Proc. SPIE Applications of Digital Image Processing, San Diego, CA, August 24-27, 2020. EXTERNAL
Brightcove Context-Aware Encoding, https://apis.support.brightcove.com/general/overviewcontext-aware-encoding.html EXTERNAL
Chen, Y. Lin, S. Benting, and A. Kokaram, "Optimized Transcoding for Large Scale Adaptive Streaming Using Playback Statistics," Proc. 25th IEEE Int. Conf. Image Processing (ICIP), Athens, pp. 3269–3273, Oct. 2018. EXTERNAL
R. G. Keys, "Cubic Convolution Interpolation for Digital Image Processing," IEEE Trans. Acoustics, Speech, Signal Proc, Vol. ASSP-29, No. 6, 1981, pp. 1153-60. EXTERNAL
Brightcove VideoCloud platform, https://www.brightcove.com/en/onlinevideo-platform EXTERNAL
Apple, "HTTP Live Streaming (HLS) Authoring Specification for Apple Devices,"https://developer.apple.com/documentation/http_live_streaming/http_live_streaming_hls_a uthoring_specification_for_apple_devices, Apple, November 12, 2021. EXTERNAL
X. Feng, I. J. Cox, and G. Doerr, "Normalized Energy Density-Based Forensic Detection of Resampled Image," IEEE Transactions on Multimedia, vol. 14, no. 3, 2012, pp. 536-545. EXTERNAL
A. Eden, "No-reference estimation of the coding PSNR for H. 264-coded sequences," in IEEE transactions on consumer electronics, 667 –674 (2007). EXTERNAL
Y. Reznik, "Average Performance of Adaptive Streaming," Proc. Data Compression Conference (DCC'21), Snowbird, UT, Mar. 2021 EXTERNAL
Z. Wang, A. Bovik, H. Sheikh, E. Simoncelli, "Image quality assessment: from error visibility to structural similarity". IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, EXTERNAL
M. Haris, G. Shakhnarovich, and N. Ukita, "Recurrent Back-Projection Network for Video Super-Resolution," Proc. Of IEEE Conference on Computer Vision and Pattern Recognition EXTERNAL
"Tears of steel" video, Blender project. https://mango.blender.org/download/ EXTERNAL
J. Kim, J. K. Lee, and K. M. Lee, "Accurate Image Super-Resolution Using Very Deep Convolutional Networks." (2015). EXTERNAL
C. Ledig, et al., "Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network," 2017 IEEE Conference on Computer Vision and Pattern Recognition EXTERNAL
C. Dong, et al., "Image Super-Resolution Using Deep Convolutional Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence 38.2(2014). EXTERNAL
Aaron, Z. Li, M. Manohara, J. De Cock, and D. Ronca, “Per-Title Encode Optimization,” 15 Dec. 2015. Online: https://medium.com/netflix-techblog/per-title-encodeoptimization-7e99442b62a2 EXTERNAL
X. Ducloux, J.-L. Diascorn, and T. Fautier, "Exploring the benefits of dynamic resolution encoding and support in DVB standards," IBC, Amsterdam, NL, 15-18 Sept. 2022. EXTERNAL
A. C. Gallagher, "Detection of linear and cubic interpolation in JPEG compressed images," Proc. The 2nd Canadian Conference on Computer and Robot Vision, 2005. EXTERNAL
Z. Yang, Y. Dong, L. Song, R. Xie, L. Li and Y. Feng, "Native Resolution Detection for 4K-UHD Videos," IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Paris, France, 2020, pp. 1-5. EXTERNAL
R. Pantos and W. May, "HTTP live streaming, RFC 8216," IETF, 2017. EXTERNAL
B. Lim, et al., "Enhanced Deep Residual Networks for Single Image Super-Resolution," 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) IEEE, 2017. EXTERNAL
A.V. Oppenheim and R.W. Schafer, "Digital signal processing," Englewood Cliffs, N. J., Prentice-Hall, Inc., 1975. 598 p. EXTERNAL
Y. A. Reznik, K. O. Lillevold, A. Jagannath, J. Greer, and J. Corley, "Optimal Design of Encoding Profiles for ABR Streaming," Proc. 23rd Packet Video Workshop (PV'2018), Amsterdam, The Netherlands, pp. 43–47, 12 Jun. 2018. EXTERNAL
M. Manohara, A. Moorthy, J. De Cock, I. Katsavounidis, and A. Aaron, "Optimized shot-based encodes: Now Streaming!," Mar 9, 2018. Online: https://netflixtechblog.com/optimized-shot-based-encodes-now-streaming-4b9464204830 EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M002015.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Yuriy Reznik, Karl Lillevold, Abhijith Jagannath, and Nabajeet Barman; Improving Context-Aware Encoding by Adaptation to “True Resolution” of the Content, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002015

Snippet:

Yuriy Reznik, Karl Lillevold, Abhijith Jagannath, and Nabajeet Barman; Improving Context-Aware Encoding by Adaptation to “True Resolution” of the Content, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002015

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Yuriy Reznik, Karl Lillevold, Abhijith Jagannath, and Nabajeet Barman; <cite>Improving Context-Aware Encoding by Adaptation to “True Resolution” of the Content</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at <a href="https://doi.org/10.5594/M002015" target="_blank" rel="noopener">https://doi.org/10.5594/M002015</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Yuriy Reznik, Karl Lillevold, Abhijith Jagannath, and Nabajeet Barman; <cite id="bib-10-5594-m002015">Improving Context-Aware Encoding by Adaptation to “True Resolution” of the Content</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5
<span class="doi">10.5594/M002015</span>
</li>