English
Related papers

Related papers: Early Exit and Multi Stage Knowledge Distillation …

200 papers

In this work, we propose a division-and-summarization (DaS) framework for dense video captioning. After partitioning each untrimmed long video as multiple event proposals, where each event proposal consists of a set of short video segments,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Zhiwang Zhang , Dong Xu , Wanli Ouyang , Chuanqi Tan

High inter-class similarity, extreme scale variation, and limited computational budgets hinder reliable visual recognition across diverse real-world data. Existing vision-centric and cross-modal approaches often rely on rigid fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Qinghui Chen , Zekai Zhang , Zaigui Zhang , Kai Zhang , Dagang Li , Wenmin Wang , Jinglin Zhang , Cong Liu

Knowledge distillation from pretrained visual representation models offers an effective approach to improve small, task-specific production models. However, the effectiveness of such knowledge transfer drops significantly when distilling…

Machine Learning · Computer Science 2025-07-01 Chengyu Dong , Huan Gui , Noveen Sachdeva , Long Jin , Ke Yin , Jingbo Shang , Lichan Hong , Ed H. Chi , Zhe Zhao

Building scalable vision-language models to learn from diverse, multimodal data remains an open challenge. In this paper, we introduce an Efficient Vision-languagE foundation model, namely EVE, which is one unified multimodal Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Junyi Chen , Longteng Guo , Jia Sun , Shuai Shao , Zehuan Yuan , Liang Lin , Dongyu Zhang

Vision-Language Models (VLMs) are able to process increasingly longer videos. Yet, important visual information is easily lost throughout the entire context and missed by VLMs. Also, it is important to design tools that enable…

Computation and Language · Computer Science 2026-01-09 Galann Pennec , Zhengyuan Liu , Nicholas Asher , Philippe Muller , Nancy F. Chen

The deployment of foundation models for medical imaging has demonstrated considerable success. However, their training overheads associated with downstream tasks remain substantial due to the size of the image encoders employed, and the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Chengxi Zeng , Yuxuan Jiang , Fan Zhang , Alberto Gambaruto , Tilo Burghardt

Vision-Language Models (VLMs) are increasingly applied in autonomous driving for unified perception and reasoning, but high inference latency hinders real-time deployment. Early-exit reduces latency by terminating inference at intermediate…

Robotics · Computer Science 2025-10-13 Haibo Hu , Lianming Huang , Xinyu Wang , Yufei Cui , Shangyu Wu , Nan Guan , Chun Jason Xue

Image diffusion distillation achieves high-fidelity generation with very few sampling steps. However, applying these techniques directly to video diffusion often results in unsatisfactory frame quality due to the limited visual quality in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Zhai , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , David Doermann , Junsong Yuan , Lijuan Wang

Multimodal video summarization requires visual features that align semantically with language generation. Traditional approaches rely on CNN features trained for object classification, which represent visual concepts as discrete categories…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Maham Nazir , Muhammad Aqeel , Richong Zhang , Francesco Setti

Multimodal Large Language Models (MLLMs) have made significant strides by combining visual recognition and language understanding to generate content that is both coherent and contextually accurate. However, MLLMs continue to struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Haoran Zhou , Zihan Zhang , Hao Chen

Emotional Talking Face synthesis is pivotal in multimedia and signal processing, yet existing 3D methods suffer from two critical challenges: poor audio-vision emotion alignment, manifested as difficult audio emotion extraction and…

Artificial Intelligence · Computer Science 2026-01-28 Nanhan Shen , Zhilei Liu

Temporally consistent video-to-video generation is critical for applications such as style transfer and upsampling. In this paper, we provide a theoretical analysis of warped noise - a recently proposed technique for training video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Chao Liu , Arash Vahdat

Multimodal Large Language Models (MLLMs) hold promise for accelerating scientific discovery by interpreting complex experimental procedures. However, their true capabilities are poorly understood, as existing benchmarks neglect the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yicheng Xu , Yue Wu , Jiashuo Yu , Ziang Yan , Tianxiang Jiang , Yinan He , Qingsong Zhao , Kai Chen , Yu Qiao , Limin Wang , Manabu Okumura , Yi Wang

Motion expression video segmentation is designed to segment objects in accordance with the input motion expressions. In contrast to the conventional Referring Video Object Segmentation (RVOS), it places emphasis on motion as well as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hao Fang , Runmin Cong , Xiankai Lu , Zhiyang Chen , Wei Zhang

Large Vision Language Models (LVLMs) have demonstrated impressive zero-shot capabilities in various vision-language dialogue scenarios. However, the absence of fine-grained visual object detection hinders the model from understanding the…

Computation and Language · Computer Science 2024-04-15 Junyu Lu , Dixiang Zhang , Songxin Zhang , Zejian Xie , Zhuoyang Song , Cong Lin , Jiaxing Zhang , Bingyi Jing , Pingjian Zhang

Growing efforts to improve knowledge distillation (KD) in large language models (LLMs) replace dense teacher supervision with selective distillation, which uses a subset of token positions, vocabulary classes, or training samples for…

Computation and Language · Computer Science 2026-02-03 Almog Tavor , Itay Ebenspanger , Neil Cnaan , Mor Geva

With the rapid growth of video data on the internet, video summarization is becoming a very important AI technology. However, due to the high labelling cost of video summarization, existing studies have to be conducted on small-scale…

Multimedia · Computer Science 2026-01-13 Cairong Zhao , Chutian Wang , Zifan Song , Guosheng Hu , Haonan Chen , Xiaofan Zhai

Recent advances in test-time optimization have led to remarkable reasoning capabilities in Large Language Models (LLMs), enabling them to solve highly complex problems in math and coding. However, the reasoning capabilities of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Ce Zhang , Yan-Bo Lin , Ziyang Wang , Mohit Bansal , Gedas Bertasius

The parameter-efficient adaptation of the image-text pretraining model CLIP for video-text retrieval is a prominent area of research. While CLIP is focused on image-level vision-language matching, video-text retrieval demands comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Leqi Shen , Guoqiang Gong , Tianxiang Hao , Tao He , Yifeng Zhang , Pengzhang Liu , Sicheng Zhao , Jungong Han , Guiguang Ding

Reasoning segmentation enables open-set object segmentation via implicit text queries, therefore serving as a foundation for embodied agents that should operate autonomously in real-world environments. However, existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yiqing Shen , Mathias Unberath