English
Related papers

Related papers: One Transform To Compute Them All: Efficient Fusio…

200 papers

The exponential growth of video content necessitates effective video summarization to efficiently extract key information from long videos. However, current approaches struggle to fully comprehend complex videos, primarily because they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Sumin Kim , Hyemin Jeong , Mingu Kang , Yejin Kim , Yoori Oh , Joonseok Lee

Several complex tasks that arise in organizations can be simplified by mapping them into a matrix completion problem. In this paper, we address a key challenge faced by our company: predicting the efficiency of artists in rendering visual…

Machine Learning · Computer Science 2020-05-19 Emanuele Bugliarello , Swayambhoo Jain , Vineeth Rakesh

Many deep learning based video compression artifact removal algorithms have been proposed to recover high-quality videos from low-quality compressed videos. Recently, methods were proposed to mine spatiotemporal information via utilizing…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Yi Xu , Minyi Zhao , Jing Liu , Xinjian Zhang , Longwen Gao , Shuigeng Zhou , Huyang Sun

Video-language models (VLMs) face rapid inference costs as visual token counts scale with video length. For example, 32 frames at $448{\times}448$ resolution already yield >8,000 visual tokens in Qwen3-VL, making LLM prefill the dominant…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Simin Huo , Ning LI

Multi-sensor modal fusion has demonstrated strong advantages in 3D object detection tasks. However, existing methods that fuse multi-modal features require transforming features into the bird's eye view space and may lose certain…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Chunyong Hu , Hang Zheng , Kun Li , Jianyun Xu , Weibo Mao , Maochun Luo , Lingxuan Wang , Mingxia Chen , Qihao Peng , Kaixuan Liu , Yiru Zhao , Peihan Hao , Minzhe Liu , Kaicheng Yu

Audio-visual quality assessment (AVQA) is essential for streaming, teleconferencing, and immersive media. In realistic streaming scenarios, distortions are often asymmetric, where one modality may be severely degraded while the other…

Multimedia · Computer Science 2026-05-05 Mayesha Maliha R. Mithila , Mylene C. Q. Farias

Unified multimodal models integrating visual understanding and generation face a fundamental challenge: visual generation incurs substantially higher computational costs than understanding, particularly for video. This imbalance motivates…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Luozheng Qin , Jia Gong , Qian Qiao , Tianjiao Li , Li Xu , Haoyu Pan , Chao Qu , Zhiyu Tan , Hao Li

Visual inspection is the predominant technique for evaluating the condition of civil infrastructure. The recent advances in unmanned aerial vehicles (UAVs) and artificial intelligence have made the visual inspections faster, safer, and more…

Image and Video Processing · Electrical Eng. & Systems 2022-10-25 Kareem Eltouny , Seyedomid Sajedi , Xiao Liang

Multimodal object detection improves robustness in chal- lenging conditions by leveraging complementary cues from multiple sensor modalities. We introduce Filtered Multi- Modal Cross Attention Fusion (FMCAF), a preprocess- ing architecture…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Jad Berjawi , Yoann Dupas , Christophe C'erin

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

Multimedia · Computer Science 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

Hate speech in online videos is posing an increasingly serious threat to digital platforms, especially as video content becomes increasingly multimodal and context-dependent. Existing methods often struggle to effectively fuse the complex…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Shuonan Yang , Tailin Chen , Jiangbei Yue , Guangliang Cheng , Jianbo Jiao , Zeyu Fu

This paper presents LiteEval, a simple yet effective coarse-to-fine framework for resource efficient video recognition, suitable for both online and offline scenarios. Exploiting decent yet computationally efficient features derived at a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Zuxuan Wu , Caiming Xiong , Yu-Gang Jiang , Larry S. Davis

Reliable multi-source fusion is crucial for robust perception in autonomous systems. However, evaluating fusion performance independently of detection errors remains challenging. This work introduces a systematic evaluation framework that…

Robotics · Computer Science 2025-07-08 Maryem Fadili , Louis Lecrosnier , Steve Pechberti , Redouane Khemmar

Multi-focus image fusion aims to generate an all-in-focus image from a sequence of partially focused input images. Existing fusion algorithms generally assume that, for every spatial location in the scene, there is at least one input image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Xinzhe Xie , Buyu Guo , Bolin Li , Shuangyan He , Yanzhen Gu , Qingyan Jiang , Peiliang Li

Video-based person recognition is challenging due to persons being blocked and blurred, and the variation of shooting angle. Previous research always focused on person recognition on still images, ignoring similarity and continuity between…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Fangtao Li , Wenzhe Wang , Zihe Liu , Haoran Wang , Chenghao Yan , Bin Wu

While VideoQA Transformer models demonstrate competitive performance on standard benchmarks, the reasons behind their success are not fully understood. Do these models capture the rich multimodal structures and dynamics from video and text…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Ishaan Singh Rawal , Alexander Matyasko , Shantanu Jaiswal , Basura Fernando , Cheston Tan

The rapid advancement of generative models has led to a growing prevalence of highly realistic AI-generated images, posing significant challenges for digital forensics and content authentication. Conventional detection methods mainly rely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Dabbrata Das , Mahshar Yahan , Md Tareq Zaman , Md Rishadul Bayesh

Dense image prediction tasks demand features with strong category information and precise spatial boundary details at high resolution. To achieve this, modern hierarchical models often utilize feature fusion, directly adding upsampled…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Linwei Chen , Ying Fu , Lin Gu , Chenggang Yan , Tatsuya Harada , Gao Huang

We propose a multi-stage framework for universal speech enhancement, designed for the Interspeech 2025 URGENT Challenge. Our system first employs a Sparse Compression Network to robustly separate sources and extract an initial clean speech…

Sound · Computer Science 2025-06-03 Nabarun Goswami , Tatsuya Harada

In the last decade, video workflows in the cinema production ecosystem have presented new use cases for video streaming technology. These new workflows, e.g. in On-set Virtual Production, present the challenge of requiring precise quality…

Image and Video Processing · Electrical Eng. & Systems 2025-10-15 Vibhoothi Vibhoothi , François Pitié , Anil Kokaram