English
Related papers

Related papers: A Unified Solution to Video Fusion: From Multi-Fra…

200 papers

Fusion-based quality assessment has emerged as a powerful method for developing high-performance quality models from quality models that individually achieve lower performances. A prominent example of such an algorithm is VMAF, which has…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Abhinau K. Venkataramanan , Cosmin Stejerean , Alan C. Bovik

Visual Tracking is a complex problem due to unconstrained appearance variations and dynamic environment. Extraction of complementary information from the object environment via multiple features and adaption to the target's appearance…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Kapil Sharma , Himanshu Ahuja , Ashish Kumar , Nipun Bansal , Gurjit Singh Walia

Video colorization aims to transform grayscale videos into vivid color representations while maintaining temporal consistency and structural integrity. Existing video colorization methods often suffer from color bleeding and lack…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Zixun Fang , Zhiheng Liu , Kai Zhu , Yu Liu , Ka Leong Cheng , Wei Zhai , Yang Cao , Zheng-Jun Zha

Visible and infrared image fusion (VIF) is an important multimedia task in computer vision. Most VIF methods focus primarily on optimizing fused image quality. Recent studies have begun incorporating downstream tasks, such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 He Li , Xinyu Liu , Weihang Kong , Xingchen Zhang

Video sequence capturing through refractive dynamic media, such as a turbulent air or water surface, often suffer from severe geometric distortions and temporal instability. While recent advances address mild atmospheric turbulence, no…

Infrared-visible image fusion (IVIF) is a critical task in computer vision, aimed at integrating the unique features of both infrared and visible spectra into a unified representation. Since 2018, the field has entered the deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Jinyuan Liu , Guanyao Wu , Zhu Liu , Di Wang , Zhiying Jiang , Long Ma , Wei Zhong , Xin Fan , Risheng Liu

Precise audio-visual synchronization in speech videos is crucial for content quality and viewer comprehension. Existing methods have made significant strides in addressing this challenge through rule-based approaches and end-to-end learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Tao Feng , Yifan Xie , Xun Guan , Jiyuan Song , Zhou Liu , Fei Ma , Fei Yu

In a scenario where multi-modal cameras are operating together, the problem of working with non-aligned images cannot be avoided. Yet, existing image fusion algorithms rely heavily on strictly registered input image pairs to produce more…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zeyang Zhang , Hui Li , Tianyang Xu , Xiaojun Wu , Josef Kittler

While current video generation focuses on text or image conditions, practical applications like video editing and vlogging often need to seamlessly connect separate clips. In our work, we introduce Video Connecting, an innovative task that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Zhiyu Yin , Zhipeng Liu , Kehai Chen , Lemao Liu , Jin Liu , Hong-Dong Li , Yang Xiang , Min Zhang

With the rapid growth in deepfake video content, we require improved and generalizable methods to detect them. Most existing detection methods either use uni-modal cues or rely on supervised training to capture the dissonance between the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Trevine Oorloff , Surya Koppisetti , Nicolò Bonettini , Divyaraj Solanki , Ben Colman , Yaser Yacoob , Ali Shahriyari , Gaurav Bharaj

Existing video editing methods face a critical trade-off: expert models offer precision but rely on task-specific priors like masks, hindering unification; conversely, unified temporal in-context learning models are mask-free but lack…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xiangpeng Yang , Ji Xie , Yiyuan Yang , Yue Ma , Yan Huang , Min Xu , Qiang Wu

Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Dahyeon Kye , Changhyun Roh , Sukhun Ko , Chanho Eom , Jihyong Oh

The creation of diverse and realistic driving scenarios has become essential to enhance perception and planning capabilities of the autonomous driving system. However, generating long-duration, surround-view consistent driving videos…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Rui Chen , Zehuan Wu , Yichen Liu , Yuxin Guo , Jingcheng Ni , Haifeng Xia , Siyu Xia

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

Generating visual instructions in a given context is essential for developing interactive world simulators. While prior works address this problem through either text-guided image manipulation or video prediction, these tasks are typically…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yujiang Pu , Zhanbo Huang , Vishnu Boddeti , Yu Kong

Recent video generation models demonstrate impressive synthesis capabilities but remain limited by single-modality conditioning, constraining their holistic world understanding. This stems from insufficient cross-modal interaction and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiehui Huang , Yuechen Zhang , Xu He , Yuan Gao , Zhi Cen , Bin Xia , Yan Zhou , Xin Tao , Pengfei Wan , Jiaya Jia

Vision Foundation Models (VFMs) have become the cornerstone of modern computer vision, offering robust representations across a wide array of tasks. While recent advances allow these models to handle varying input sizes during training,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Bocheng Zou , Mu Cai , Mark Stanley , Dingfu Lu , Yong Jae Lee

The evaluation of visual editing models remains fragmented across methods and modalities. Existing benchmarks are often tailored to specific paradigms, making fair cross-paradigm comparisons difficult, while video editing lacks reliable…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Lifan Jiang , Tianrun Wu , Yuhang Pei , Chenyang Wang , Boxi Wu , Deng Cai

Real-time video analysis remains a challenging problem in computer vision, requiring efficient processing of both spatial and temporal information while maintaining computational efficiency. Existing approaches often struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shahla John

Fluorescence microscopy is widely employed for the analysis of living biological samples; however, the utility of the resulting recordings is frequently constrained by noise, temporal variability, and inconsistent visualisation of signals…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Hassan Eshkiki , Sarah Costa , Mostafa Mohammadpour , Farinaz Tanhaei , Christopher H. George , Fabio Caraffini