English
Related papers

Related papers: Beyond FVD: Enhanced Evaluation Metrics for Video …

200 papers

Bit depth adaptation, where the bit depth of a video sequence is reduced before transmission and up-sampled during display, can potentially reduce data rates with limited impact on perceptual quality. In this context, we conducted a…

Image and Video Processing · Electrical Eng. & Systems 2021-09-17 Alex Mackin , Di Ma , Fan Zhang , David Bull

Diffusion-based video generation models have demonstrated remarkable success in obtaining high-fidelity videos through the iterative denoising process. However, these models require multiple denoising steps during sampling, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Zhixing Zhang , Yanyu Li , Yushu Wu , Yanwu Xu , Anil Kag , Ivan Skorokhodov , Willi Menapace , Aliaksandr Siarohin , Junli Cao , Dimitris Metaxas , Sergey Tulyakov , Jian Ren

The deployment of vision-language models remains constrained by substantial computational requirements. We present \textbf{FrEVL}, a framework exploring whether frozen pretrained embeddings can support effective vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Emmanuelle Bourigault , Pauline Bourigault

Notable breakthroughs in diffusion modeling have propelled rapid improvements in video generation, yet current foundational model still face critical challenges in simultaneously balancing prompt following, motion plausibility, and visual…

Image-to-Video generation (I2V) animates a static image into a temporally coherent video sequence following textual instructions, yet preserving fine-grained object identity under changing viewpoints remains a persistent challenge. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Mingyang Wu , Ashirbad Mishra , Soumik Dey , Shuo Xing , Naveen Ravipati , Hansi Wu , Binbin Li , Zhengzhong Tu

Depth-image-based rendering is a key view synthesis algorithm in 3D video systems, which enables the synthesis of virtual views from texture images and depth maps. An efficient view synthesis distortion estimation model is critical for…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Chongyuan Bi , Jie Liang

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Latent diffusion models have enabled high-quality video synthesis, yet their inference remains costly and time-consuming. As diffusion transformers become increasingly efficient, the latency bottleneck inevitably shifts to VAE decoders. To…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lunjie Zhu , Yushi Huang , Xingtong Ge , Yufei Xue , Zhening Liu , Yumeng Zhang , Zehong Lin , Jun Zhang

Point tracking is becoming a powerful solver for motion estimation and video editing. Compared to classical feature matching, point tracking methods have the key advantage of robustly tracking points under complex camera motion trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jianzheng Huang , Xianyu Mo , Ziling Liu , Jinyu Yang , Feng Zheng

Quantifying degrees of fusion and separability between data groups in representation space is a fundamental problem in representation learning, particularly under domain shift. A meaningful metric should capture fusion-altering factors like…

Machine Learning · Computer Science 2026-01-30 Xiaolong Zhang , Jianwei Zhang , Xubo Song

Metric data plays an important role in various settings such as metric-based indexing, clustering, classification, and approximation algorithms in general. Due to measurement error, noise, or an inability to completely gather all the data,…

Computational Geometry · Computer Science 2018-07-24 Chenglin Fan , Benjamin Raichel , Gregory Van Buskirk

The proliferation of DeepFake technology is a rising challenge in today's society, owing to more powerful and accessible generation methods. To counter this, the research community has developed detectors of ever-increasing accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Federico Baldassarre , Quentin Debard , Gonzalo Fiz Pontiveros , Tri Kurniawan Wijaya

The high computational cost and slow inference time are major obstacles to deploying Video Diffusion Models (VDMs). To overcome this, we introduce a new Video Diffusion Model Compression approach using individual content and motion dynamics…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Yiming Wu , Zhenghao Chen , Huan Wang , Dong Xu

We focus on the task of far-field 3D detection (Far3Det) of objects beyond a certain distance from an observer, e.g., $>$50m. Far3Det is particularly important for autonomous vehicles (AVs) operating at highway speeds, which require…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Shubham Gupta , Jeet Kanjani , Mengtian Li , Francesco Ferroni , James Hays , Deva Ramanan , Shu Kong

Video gaming streaming services are growing rapidly due to new services such as passive video streaming, e.g. Twitch.tv, and cloud gaming, e.g. Nvidia Geforce Now. In contrast to traditional video content, gaming content has special…

Multimedia · Computer Science 2020-05-05 Markus Utke , Saman Zadtootaghaj , Steven Schmidt , Sebastian Möller

Recently, many video enhancement methods have been proposed to improve video quality from different aspects such as color, brightness, contrast, and stability. Therefore, how to evaluate the quality of the enhanced video in a way consistent…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Yixuan Gao , Yuqin Cao , Tengchuan Kou , Wei Sun , Yunlong Dong , Xiaohong Liu , Xiongkuo Min , Guangtao Zhai

Autonomous driving perceives its surroundings for decision making, which is one of the most complex scenarios in visual perception. The success of paradigm innovation in solving the 2D object detection task inspires us to seek an elegant,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Junjie Huang , Guan Huang , Zheng Zhu , Yun Ye , Dalong Du

Monocular Depth Estimation (MDE) is a fundamental 3D vision problem with numerous applications such as 3D scene reconstruction, autonomous navigation, and AI content creation. However, robust and generalizable MDE remains challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yunpeng Bai , Qixing Huang

Generative Adversarial Networks (GANs) are by far the most successful generative models. Learning the transformation which maps a low dimensional input noise to the data distribution forms the foundation for GANs. Although they have been…

Machine Learning · Computer Science 2020-04-16 Manisha Padala , Debojit Das , Sujit Gujar

Motion estimation is one of the important procedures in the all video encoders. Most of the complexity of the video coder depends on the complexity of the motion estimation step. The original motion estimation algorithm has a remarkable…

Image and Video Processing · Electrical Eng. & Systems 2018-03-14 Amin Banitalebi , Said Nader-Esfahani , Alireza Nasiri Avanaki