English
Related papers

Related papers: Hacking VMAF and VMAF NEG: vulnerability to differ…

200 papers

NeRF aims to learn a continuous neural scene representation by using a finite set of input images taken from various viewpoints. A well-known limitation of NeRF methods is their reliance on data: the fewer the viewpoints, the higher the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Matteo Bortolon , Alessio Del Bue , Fabio Poiesi

Deep learning based video frame interpolation (VIF) method, aiming to synthesis the intermediate frames to enhance video quality, have been highly developed in the past few years. This paper investigates the adversarial robustness of VIF…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Junpei Liao , Zhikai Chen , Liang Yi , Wenyuan Yang , Baoyuan Wu , Xiaochun Cao

In recent years, the proliferation of multimedia applications and formats, such as IPTV, Virtual Reality (VR, 360-degree), and point cloud videos, has presented new challenges to the video compression research community. Simultaneously,…

Image and Video Processing · Electrical Eng. & Systems 2023-10-23 Thomas Amestoy , Naty Sidaty , Wassim Hamidouche , Pierrick Philippe , Daniel Menard

Recent research has shown that temporal downsampling of high-frame-rate sequences can be exploited to improve the rate-distortion performance in video coding. However, until now, research only targeted downsampling factors of powers of two,…

Image and Video Processing · Electrical Eng. & Systems 2022-09-22 Christian Herglotz , Geetha Ramasubbu , André Kaup

Quality assessment of videos is crucial for many computer graphics applications, including video games, virtual reality, and augmented reality, where visual performance has a significant impact on user experience. When test videos cannot be…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sipeng Yang , Jiayu Ji , Qingchuan Zhu , Zhiyao Yang , Xiaogang Jin

Neural view synthesis (NVS) is one of the most successful techniques for synthesizing free viewpoint videos, capable of achieving high fidelity from only a sparse set of captured images. This success has led to many variants of the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Hanxue Liang , Tianhao Wu , Param Hanji , Francesco Banterle , Hongyun Gao , Rafal Mantiuk , Cengiz Oztireli

The promising improvement in compression efficiency of Versatile Video Coding (VVC) compared to High Efficiency Video Coding (HEVC) comes at the cost of a non-negligible encoder side complexity. The largely increased complexity overhead is…

Multimedia · Computer Science 2023-12-19 Yiqun Liu , Mohsen Abdoli , Thomas Guionnet , Christine Guillemot , Aline Roumy

With the advancements in deep learning, video colorization by propagating color information from a colorized reference frame to a monochrome video sequence has been well explored. However, the existing approaches often suffer from…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Yaping Zhao , Haitian Zheng , Jiebo Luo , Edmund Y. Lam

The rapid surge of text-to-speech and face-voice reenactment models makes video fabrication easier and highly realistic. To encounter this problem, we require datasets that rich in type of generation methods and perturbation strategy which…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zhixi Cai , Kartik Kuckreja , Shreya Ghosh , Akanksha Chuchra , Muhammad Haris Khan , Usman Tariq , Tom Gedeon , Abhinav Dhall

Purpose: Finding effective methods of discriminating surgeon technical skill is a complex problem to solve computationally. Previous research has shown non-expert crowd evaluations of surgical performances are as accurate as the gold…

Human-Computer Interaction · Computer Science 2019-11-05 Jason D Kelly , Ashley Petersen , Thomas S Lendvay , Timothy M Kowalewski

Many important physical phenomena involve subtle signals that are difficult to observe with the unaided eye, yet visualizing them can be very informative. Current motion magnification techniques can reveal these small temporal variations in…

Computer Vision and Pattern Recognition · Computer Science 2018-08-13 Weixuan Chen , Daniel McDuff

The detection of digital face manipulation in video has attracted extensive attention due to the increased risk to public trust. To counteract the malicious usage of such techniques, deep learning-based deepfake detection methods have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yuhang Lu , Touradj Ebrahimi

Ensuring consistent quality in vacuum thermoforming presents challenges due to variations in material properties and tooling configurations. This research introduces a vision-based quality control system to predict and optimise process…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Andi Kuswoyo , Christos Margadji , Sebastian W. Pattinson

Based on the standard VMAF implementation we propose an implementation of VMAF using PyTorch framework. For this implementation comparisons with the standard (libvmaf) show the discrepancy $\lesssim 10^{-2}$ in VMAF units. We investigate…

Machine Learning · Computer Science 2024-07-17 Kirill Aistov , Maxim Koroteev

Video-quality measurement is a critical task in video processing. Nowadays, many implementations of new encoding standards - such as AV1, VVC, and LCEVC - use deep-learning-based decoding algorithms with perceptual metrics that serve as…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Anastasia Antsiferova , Sergey Lavrushkin , Maksim Smirnov , Alexander Gushchin , Dmitriy Vatolin , Dmitriy Kulikov

Video Foundation Models (VFMs) have recently been used to simulate the real world to train physical AI systems and develop creative visual experiences. However, there are significant challenges in training large-scale, high quality VFMs…

No-reference video quality assessment (NR-VQA) for user generated content (UGC) is crucial for understanding and improving visual experience. Unlike video recognition tasks, VQA tasks are sensitive to changes in input resolution. Since…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Junjie Ke , Tianhao Zhang , Yilin Wang , Peyman Milanfar , Feng Yang

Staircase-like contours introduced to a video by quantization in flat areas, commonly known as banding, have been a long-standing problem in both video processing and quality assessment communities. The fact that even a relatively small…

Multimedia · Computer Science 2022-02-23 Lukáš Krasula , Zhi Li , Christos G. Bampis , Mariana Afonso , Nil Fons Miret , Joel Sole

Array processing performance depends on the number of microphones available. Virtual microphone estimation (VME) has been proposed to increase the number of microphone signals artificially. Neural network-based VME (NN-VME) trains an NN…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Hanako Segawa , Tsubasa Ochiai , Marc Delcroix , Tomohiro Nakatani , Rintaro Ikeshita , Shoko Araki , Takeshi Yamada , Shoji Makino

With COVID-19, the interest for digital interactions has raised, putting in turn real-time (or low-latency) codecs into a new light. Most of the codec research has been traditionally focusing on coding efficiency, while very little…

Multimedia · Computer Science 2020-11-05 Ludovic Roux , Alexandre Gouaillard