English
Related papers

Related papers: ERVD: An Efficient and Robust ViT-Based Distillati…

200 papers

Multi-view 3D detection based on BEV (bird-eye-view) has recently achieved significant improvements. However, the huge memory consumption of state-of-the-art models makes it hard to deploy them on vehicles, and the non-trivial latency will…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yifan Zhang , Zhen Dong , Huanrui Yang , Ming Lu , Cheng-Ching Tseng , Yuan Du , Kurt Keutzer , Li Du , Shanghang Zhang

Retinal vessel segmentation is generally grounded in image-based datasets collected with bench-top devices. The static images naturally lose the dynamic characteristics of retina fluctuation, resulting in diminished dataset richness, and…

We present RangeRCNN, a novel and effective 3D object detection framework based on the range image representation. Most existing methods are voxel-based or point-based. Though several optimizations have been introduced to ease the sparsity…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Zhidong Liang , Ming Zhang , Zehan Zhang , Xian Zhao , Shiliang Pu

Convolutional neural networks (CNNs) and Vision Transformers (ViTs) have achieved excellent performance in image restoration. While ViTs generally outperform CNNs by effectively capturing long-range dependencies and input-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Lingshun Kong , Jiangxin Dong , Jinhui Tang , Ming-Hsuan Yang , Jinshan Pan

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

Despite advances in Multimodal LLMs (MLLMs), their ability to reason over 3D structures and temporal dynamics remains limited, constrained by weak 4D perception and temporal understanding. Existing 3D and 4D Video Question Answering (VQA)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chiao-An Yang , Ryo Hachiuma , Sifei Liu , Subhashree Radhakrishnan , Raymond A. Yeh , Yu-Chiang Frank Wang , Min-Hung Chen

Multimodal fusion of remote sensing images serves as a core technology for overcoming the limitations of single-source data and improving the accuracy of surface information extraction, which exhibits significant application value in fields…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Siyu Zhang , Lianlei Shan , Runhe Qiu

In recent years, Neural Radiance Fields (NeRF) have emerged as a powerful tool for 3D reconstruction and novel view synthesis. However, the computational cost of NeRF rendering and degradation in quality due to the presence of artifacts…

Robotics · Computer Science 2024-08-20 Juyeop Han , Lukas Lao Beyer , Guilherme V. Cavalheiro , Sertac Karaman

Distributed optical fiber vibration sensing (DVS) systems offer a promising solution for large-scale monitoring and intrusion event recognition. However, their practical deployment remains hindered by two major challenges: degradation of…

Signal Processing · Electrical Eng. & Systems 2025-07-29 Zhongyao Luo , Hao Wu , Zhao Ge , Ming Tang

While Knowledge Distillation (KD) has been recognized as a useful tool in many visual tasks, such as supervised classification and self-supervised representation learning, the main drawback of a vanilla KD framework is its mechanism, which…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Zhiqiang Shen , Eric Xing

Visual Relation Detection (VRD) aims to detect relationships between objects for image understanding. Most existing VRD methods rely on thousands of training samples of each relationship to achieve satisfactory performance. Some recent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Tianyu Yu , Yangning Li , Jiaoyan Chen , Yinghui Li , Hai-Tao Zheng , Xi Chen , Qingbin Liu , Wenqiang Liu , Dongxiao Huang , Bei Wu , Yexin Wang

Several video understanding tasks, such as natural language temporal video grounding, temporal activity localization, and audio description generation, require "temporally dense" reasoning over frames sampled at high temporal resolution.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Mattia Soldan , Fabian Caba Heilbron , Bernard Ghanem , Josef Sivic , Bryan Russell

As the development of lightweight deep learning algorithms, various deep neural network (DNN) models have been proposed for the remote sensing scene classification (RSSC) application. However, it is still challenging for these RSSC models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yang Zhao , Shusheng Li , Xueshang Feng

4D radar super-resolution, which aims to reconstruct sparse and noisy point clouds into dense and geometrically consistent representations, is a foundational problem in autonomous perception. However, existing methods often suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Minqing Huang , Shouyi Lu , Boyuan Zheng , Ziyao Li , Xiao Tang , Guirong Zhuo

This article addresses the problem of distilling knowledge from a large teacher model to a slim student network for LiDAR semantic segmentation. Directly employing previous distillation approaches yields inferior results due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yuenan Hou , Xinge Zhu , Yuexin Ma , Chen Change Loy , Yikang Li

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

The GelSight-like visual tactile (VT) sensor has gained popularity as a high-resolution tactile sensing technology for robots, capable of measuring touch geometry using a single RGB camera. However, the development of multi-modal perception…

Robotics · Computer Science 2023-09-18 Yuankai Lin , Yulin Zhou , Kaiji Huang , Qi Zhong , Tao Cheng , Hua Yang , Zhouping Yin

Reasoning is increasingly crucial for various tasks. While chain-of-thought prompting enables large language models to leverage reasoning effectively, harnessing the reasoning capabilities of Vision-Language Models (VLMs) remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Guande Wu , Huan Song , Yawei Wang , Qiaojing Yan , Yijun Tian , Lin Lee Cheong , Panpan Xu

Reasoning segmentation enables open-set object segmentation via implicit text queries, therefore serving as a foundation for embodied agents that should operate autonomously in real-world environments. However, existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yiqing Shen , Mathias Unberath

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific features directly to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shashank Mishra , Karan Patil , Didier Stricker , Jason Rambach