API Build-data JSON Resources
Theme

Choose how MSRBot.io looks on this device.

Auto (match system) Light mode Dark mode

Preference is stored in this browser only.

MTS 2025, Article 19 (pp. 1 to 17)
[ACTIVE]

An Efficient Quality Metric for Video Frame Interpolation

Metadata

Publisher
SMPTE — Pasadena, CA
Doc Type
Conference Paper
Content Type
Original Research
Volume
00, pp. 1–17
Abstract
Video Frame Interpolation (VFI) enhances temporal video quality for applications like slow-motion effects and broadcast frame-rate conversion. While modern VFI methods using optical flow and deep networks can handle complex motion and occlusions, evaluating interpolated content quality remains challenging. Traditional metrics like PSNR and SSIM ignore temporal information, while perceptual metrics like LPIPS focus only on spatial aspects, missing critical motion coherence that significantly affects perceived quality. Recent VFI-specific metrics like FloLPIPS incorporate optical flow errors to detect temporal inconsistencies but are computationally expensive (5.5× slower than LPIPS), limiting practical use in training or real-time assessment. Building on our previous work in motion picture restoration, we developed PSNR DIV , which uses vector field divergence to detect spatial irregularities in optical flow that indicate temporal inconsistencies. By weighting PSNR with this feature, we can identify problematic motion patterns, that most degrade perceptual quality in interpolated frames. PSNR DIV requires only one sequence's motion field, significantly reducing computational load. Evaluation on the BVI-VFI dataset (180 diverse sequences) shows statistically significant improvements over FloLPIPS: +0.09 Pearson Linear Correlation Coefficient, +0.05 Spearman Rank-Order Correlation Coefficient, and -1.38 Root Mean Squared Error improvement. It achieves these gains while being 2.5× faster and using 6× less memory, with consistent performance across content categories and robustness to different optical flow estimators.
Publication Date
2025-10-13
ISBN
Electronic: 978-1-61482-966-9
Author(s)
Conall Daly
Darren Ramsook
Anil Kokaram
Keyword(s)
Video Frame Interpolation Quality, Temporal Consistency Metrics
Copyright
© 2025 SMPTE

Bibliographic Reference(s)

  • A. Paliwal and N. Khademi Kalantari, “Deep slow motion video reconstruction with hybrid imaging system,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 7, pp. 1557–1569, 2020. EXTERNAL
  • K. M. Briedis, A. Djelouah, M. Meyer, I. McGonigal, M. Gross and C. Schroers, “Neural frame interpolation for rendered content,” ACM Transactions on Graphics, vol. 40, no. 6, pp. 1–13, 2021. EXTERNAL
  • Y. Guo, L. Chen, Z. Gao and X. Zhang, “Frame rate up-conversion method for video processing applications,” IEEE Transactions on Broadcasting, vol. 60, no. 4, pp. 659–669, 2014. EXTERNAL
  • Z. Teed and J. Deng, “RAFT: Recurrent all-pairs field transforms for optical flow,” in European Conference on Computer Vision, 2020. EXTERNAL
  • Z. Liu, R. A. Yeh, X. Tang, Y. Liu and A. Agarwala, “Video frame synthesis using deep voxel flow,” in IEEE International Conference on Computer Vision, 2017. EXTERNAL
  • S. Niklaus, L. Mai and F. Liu, “Video frame interpolation via adaptive separable convolution,” in IEEE International Conference on Computer Vision, 2017. EXTERNAL
  • D. Danier, F. Zhang and D. Bull, “ST-MFNet: A spatiotemporal multi- flow network for frame interpolation,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022. EXTERNAL
  • Z. Shi, X. Xu, X. Liu, J. Chen and M. H. Yang, “Video frame interpolation transformer,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022. EXTERNAL
  • R. Zhang, P. Isola, A. A. Efros, E. Shechtman and O. Wang, “The unreasonable effectiveness of deep features as a perceptual metric,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018. EXTERNAL
  • A. Mackin, K. C. Noland and D. R. Bull, “High frame rates and the visibility of motion artifacts,” SMPTE Motion Imaging Journal, vol. 126, no. 5, pp. 41–51, 2017. EXTERNAL
  • D. Danier, F. Zhang and D. Bull, “A subjective quality study for video frame interpolation,” in IEEE International Conference on Image Processing, 2022. EXTERNAL
  • S. Ge, A. Mahapatra, G. Parmar, J. Y. Zhu and J. B. Huang, “On the content bias in Fréchet video distance,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024. EXTERNAL
  • D. Danier, F. Zhang and D. Bull, “FloLPIPS: A bespoke video quality metric for frame interpolation,” in IEEE Picture Coding Symposium, 2022. EXTERNAL
  • C. Daly, D. Ramsook and A. Kokaram, “An Efficient Quality Metric for Video Frame Interpolation Based on Motion-Field Divergence,” in IEEE International Conference on Quality of Multimedia Experience, 2025. EXTERNAL
  • Video Quality Experts Group, Final report from the video quality experts group on the validation of objective quality metrics for video quality assessment, 2000. EXTERNAL
  • J. Han, X. Min, J. Jia, Y. Gao, X. Liu and G. Zhai, “Full-reference and no-reference quality assessment for video frame interpolation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 36, no. 7, pp. 6575–6588, 2025. EXTERNAL
  • Q. Hou, A. Ghildyal and F. Liu, “A perceptual quality metric for video frame interpolation,” in European Conference on Computer Vision, 2022. EXTERNAL
  • G. M. Çökmez, Y. Zhang, C. Schroers and T. O. Aydin, “CLIP-Fusion: A Spatio-Temporal Quality Metric for Frame Interpolation,” in IEEE/CVF Winter Conference on Applications of Computer Vision, 2025. EXTERNAL
  • D. Danier, F. Zhang and D. Bull, “BVI-VFI: A video quality database for video frame interpolation,” IEEE Transactions on Image Processing, vol. 32, pp. 6004–6019, 2023. EXTERNAL
  • D. Corrigan, N. Harte and A. Kokaram, “Pathological motion detection for robust missing data treatment in degraded archived medi,” in IEEE International Conference on Image Processing, 2006. EXTERNAL
  • X. Xu, L. Siyao, W. Sun, Q. Yin and M. Yang, “Quadratic video interpolation,” in International Conference on Neural Information Processing Systems, 2019. EXTERNAL
  • International Telecommunication Union, “Recommendation ITU-T P. 910. subjective video quality assessment methods for multimedia applications,” 2000. EXTERNAL
  • G. Farneback, “Two-Frame Motion Estimation Based on Polynomial Expansion,” in Scandinavian Conference on Image Analysis, 2003. EXTERNAL
Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/978-1-61482-966-9-19.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree
Reference this Doc

Plain text (ISO 690 compliant)

Preview:
Conall Daly, Darren Ramsook, and Anil Kokaram; An Efficient Quality Metric for Video Frame Interpolation, MTS 2025, Article 19 (pp. 1 to 17); SMPTE, 2025, ISBN: 978-1-61482-966-9
Snippet:
Conall Daly, Darren Ramsook, and Anil Kokaram; An Efficient Quality Metric for Video Frame Interpolation, MTS 2025, Article 19 (pp. 1 to 17); SMPTE, 2025, ISBN: 978-1-61482-966-9

HTML (ISO 690 compliant)

Preview:
Conall Daly, Darren Ramsook, and Anil Kokaram; An Efficient Quality Metric for Video Frame Interpolation, MTS 2025, Article 19 (pp. 1 to 17); SMPTE, 2025, ISBN: 978-1-61482-966-9
Snippet:
<span class="citation">Conall Daly, Darren Ramsook, and Anil Kokaram; <cite>An Efficient Quality Metric for Video Frame Interpolation</cite>, MTS 2025, Article 19 (pp. 1 to 17); SMPTE, 2025, ISBN: 978-1-61482-966-9</span>

SMPTE Icon SMPTE's HTML Pub

Preview:
Conall Daly, Darren Ramsook, and Anil Kokaram; An Efficient Quality Metric for Video Frame Interpolation, MTS 2025, Article 19 (pp. 1 to 17); SMPTE, 2025, ISBN: 978-1-61482-966-9
Snippet:
<li>
Conall Daly, Darren Ramsook, and Anil Kokaram; <cite id="bib-978-1-61482-966-9-19">An Efficient Quality Metric for Video Frame Interpolation</cite>, MTS 2025, Article 19 (pp. 1 to 17); SMPTE, 2025, ISBN: 978-1-61482-966-9
</li>