English
Related papers

Related papers: KDMOS:Knowledge Distillation for Motion Segmentati…

200 papers

Knowledge distillation (KD), a technique widely employed in computer vision, has emerged as a de facto standard for improving the performance of small neural networks. However, prevailing KD-based approaches in video tasks primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Guiqin Wang , Peng Zhao , Yanjiang Shi , Cong Zhao , Shusen Yang

Existing multi-object tracking algorithms typically fail to adequately address the issues in low-quality videos, resulting in a significant decline in tracking performance when image quality deteriorates in real-world scenarios. This…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jun Du

Multi-modal systems have the capacity of producing more reliable results than systems with a single modality in road detection due to perceiving different aspects of the scene. We focus on using raw sensor inputs instead of, as it is…

Robotics · Computer Science 2023-08-24 Erkan Milli , Özgür Erkent , Asım Egemen Yılmaz

Multi-view 3D detection based on BEV (bird-eye-view) has recently achieved significant improvements. However, the huge memory consumption of state-of-the-art models makes it hard to deploy them on vehicles, and the non-trivial latency will…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yifan Zhang , Zhen Dong , Huanrui Yang , Ming Lu , Cheng-Ching Tseng , Yuan Du , Kurt Keutzer , Li Du , Shanghang Zhang

Autonomous driving is an important and safety-critical task, and recent advances in LLMs/VLMs have opened new possibilities for reasoning and planning in this domain. However, large models demand substantial GPU memory and exhibit high…

This work addresses motion-guided few-shot video object segmentation (FSVOS), which aims to segment dynamic objects in videos based on a few annotated examples with the same motion patterns. Existing FSVOS datasets and methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Kaining Ying , Hengrui Hu , Henghui Ding

Recent advances in automotive four-dimensional (4D) Radar have enabled access to raw 4D Radar Tensor (4DRT), offering richer spatial and Doppler information than conventional point clouds. While most existing methods rely on heavily…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Seung-Hyun Song , Dong-Hee Paek , Minh-Quan Dao , Ezio Malis , Seung-Hyun Kong

LiDAR-based Moving Object Segmentation (MOS) aims to locate and segment moving objects in point clouds of the current scan using motion information from previous scans. Despite the promising results achieved by previous MOS methods, several…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Kang Zeng , Hao Shi , Jiacheng Lin , Siyu Li , Jintao Cheng , Kaiwei Wang , Zhiyong Li , Kailun Yang

As a general model compression paradigm, feature-based knowledge distillation allows the student model to learn expressive features from the teacher counterpart. In this paper, we mainly focus on designing an effective feature-distillation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Guang Yang , Yin Tang , Jun Li , Jianhua Xu , Xili Wan

Knowledge Distillation (KD) is a powerful approach for compressing a large model into a smaller, more efficient model, particularly beneficial for latency-sensitive applications like recommender systems. However, current KD research…

Information Retrieval · Computer Science 2024-08-28 Nikhil Khani , Shuo Yang , Aniruddh Nath , Yang Liu , Pendo Abbo , Li Wei , Shawn Andrews , Maciej Kula , Jarrod Kahn , Zhe Zhao , Lichan Hong , Ed Chi

Knowledge distillation (KD) is an effective training strategy to improve the lightweight student models under the guidance of cumbersome teachers. However, the large architecture difference across the teacher-student pairs limits the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Peijie Dong , Lujun Li , Zimian Wei

Moving object segmentation (MOS) using a 3D light detection and ranging (LiDAR) sensor is crucial for scene understanding and identification of moving objects. Despite the availability of various types of 3D LiDAR sensors in the market, MOS…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Hyungtae Lim , Seoyeon Jang , Benedikt Mersch , Jens Behley , Hyun Myung , Cyrill Stachniss

We propose a novel multi-task learning system that combines appearance and motion cues for a better semantic reasoning of the environment. A unified architecture for joint vehicle detection and motion segmentation is introduced. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Mennatullah Siam , Heba Mahgoub , Mohamed Zahran , Senthil Yogamani , Martin Jagersand , Ahmad El-Sallab

The joint use of multiple imaging modalities for medical image segmentation has been widely studied in recent years. The fusion of information from different modalities has demonstrated to improve the segmentation accuracy, with respect to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Minhao Hu , Matthis Maillard , Ya Zhang , Tommaso Ciceri , Giammarco La Barbera , Isabelle Bloch , Pietro Gori

Knowledge distillation establishes a learning paradigm that leverages both data supervision and teacher guidance. However, determining the optimal balance between learning from data and learning from the teacher is challenging, as some…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jingchen Sun , Shaobo Han , Deep Patel , Wataru Kohno , Can Jin , Changyou Chen

Vision-language models (VLMs) have achieved remarkable success across multimodal tasks, yet their substantial computational demands hinder efficient deployment. Knowledge distillation (KD) has emerged as a powerful approach for building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Pume Tuchinda , Parinthapat Pengpun , Romrawin Chumpu , Sarana Nutanong , Peerat Limkonchotiwat

Real-world driving involves intricate interactions among vehicles navigating through dense traffic scenarios. Recent research focuses on enhancing the interaction awareness of autonomous vehicles to leverage these interactions in…

Robotics · Computer Science 2024-04-03 Piyush Gupta , David Isele , Sangjae Bae

Semantic segmentation of road scenes is one of the key technologies for realizing autonomous driving scene perception, and the effectiveness of deep Convolutional Neural Networks(CNNs) for this task has been demonstrated. State-of-art CNNs…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zhiyuan Wu , Yu Jiang , Chupeng Cui , Zongmin Yang , Xinhui Xue , Hong Qi

Knowledge distillation has emerged as an effective strategy for compressing large language models' (LLMs) knowledge into smaller, more efficient student models. However, standard one-shot distillation methods often produce suboptimal…

Computation and Language · Computer Science 2025-04-04 Kushal Jain , Piyushi Goyal , Kumar Shridhar

Knowledge distillation (KD) is an efficient approach to transfer the knowledge from a large "teacher" network to a smaller "student" network. Traditional KD methods require lots of labeled training samples and a white-box teacher…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Dang Nguyen , Sunil Gupta , Kien Do , Svetha Venkatesh