English
Related papers

Related papers: Enhancing Mapless Trajectory Prediction through Kn…

200 papers

Knowledge Distillation (KD) is a model-agnostic technique to improve model quality while having a fixed capacity budget. It is a commonly used technique for model compression, where a larger capacity teacher model with better quality is…

Machine Learning · Computer Science 2021-03-02 Jiaxi Tang , Rakesh Shivanna , Zhe Zhao , Dong Lin , Anima Singh , Ed H. Chi , Sagar Jain

We propose a new approach, Knowledge Distillation using Optimal Transport (KNOT), to distill the natural language semantic knowledge from multiple teacher networks to a student network. KNOT aims to train a (global) student model by…

Computation and Language · Computer Science 2022-09-20 Rishabh Bhardwaj , Tushar Vaidya , Soujanya Poria

Despite the impressive performance achieved by data-fusion networks with duplex encoders for visual semantic segmentation, they become ineffective when spatial geometric data are not available. Implicitly infusing the spatial geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Sicen Guo , Ziwei Long , Zhiyuan Wu , Qijun Chen , Ioannis Pitas , Rui Fan

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

This work introduces a novel knowledge distillation framework for classification tasks where information on existing subclasses is available and taken into consideration. In classification tasks with a small number of classes or binary…

Machine Learning · Computer Science 2022-07-06 Ahmad Sajedi , Konstantinos N. Plataniotis

Unlike the conventional Knowledge Distillation (KD), Self-KD allows a network to learn knowledge from itself without any guidance from extra networks. This paper proposes to perform Self-KD from image Mixture (MixSKD), which integrates…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Chuanguang Yang , Zhulin An , Helong Zhou , Linhang Cai , Xiang Zhi , Jiwen Wu , Yongjun Xu , Qian Zhang

Trajectory prediction is an essential step in the pipeline of an autonomous vehicle. Inaccurate or inconsistent predictions regarding the movement of agents in its surroundings lead to poorly planned maneuvers and potentially dangerous…

Machine Learning · Computer Science 2025-07-04 Caio Azevedo , Lina Achaji , Stefano Sabatini , Nicola Poerio , Grzegorz Bartyzel , Sascha Hornauer , Fabien Moutarde

The popularity of multimodal sensors and the accessibility of the Internet have brought us a massive amount of unlabeled multimodal data. Since existing datasets and well-trained models are primarily unimodal, the modality gap between a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Zihui Xue , Sucheng Ren , Zhengqi Gao , Hang Zhao

Multimodal Deep Learning has garnered much interest, and transformers have triggered novel approaches, thanks to the cross-attention mechanism. Here we propose an approach to deal with two key existing challenges: the high computational…

Machine Learning · Computer Science 2021-10-20 Dhruv Agarwal , Tanay Agrawal , Laura M. Ferrari , François Bremond

Despite the success of Deep Learning (DL), the deployment of modern DL models requiring large computational power poses a significant problem for resource-constrained systems. This necessitates building compact networks that reduce…

Machine Learning · Computer Science 2020-06-24 Akshay Kulkarni , Navid Panchi , Sharath Chandra Raparthy , Shital Chiddarwar

In the surveillance and defense domain, multi-target detection and classification (MTD) is considered essential yet challenging due to heterogeneous inputs from diverse data sources and the computational complexity of algorithms designed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ngoc Tuyen Do , Tri Nhu Do

In visual tasks, large teacher models capture essential features and deep information, enhancing performance. However, distilling this information into smaller student models often leads to performance loss due to structural differences and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zhiwei Wang , Jun Huang , Longhua Ma , Chengyu Wu , Hongyu Ma

High-definition (HD) maps offer extensive and accurate environmental information about the driving scene, making them a crucial and essential element for planning within autonomous driving systems. To avoid extensive efforts from manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Michael Hubbertz , Pascal Colling , Qi Han , Tobias Meisen

Representing diverse and plausible future trajectories is critical for motion forecasting in autonomous driving. However, efficiently capturing these trajectories in a compact set remains challenging. This study introduces a novel approach…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Abhishek Vivekanandan , J. Marius Zöllner

Knowledge distillation (KD) has become a widely used technique in the field of model compression, which aims to transfer knowledge from a large teacher model to a lightweight student model for efficient network development. In addition to…

Machine Learning · Computer Science 2024-04-08 Weichao Lan , Yiu-ming Cheung , Qing Xu , Buhua Liu , Zhikai Hu , Mengke Li , Zhenghua Chen

Accumulating substantial volumes of real-world driving data proves pivotal in the realm of trajectory forecasting for autonomous driving. Given the heavy reliance of current trajectory forecasting models on data-driven methodologies, we aim…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yiheng Li , Seth Z. Zhao , Chenfeng Xu , Chen Tang , Chenran Li , Mingyu Ding , Masayoshi Tomizuka , Wei Zhan

Model-based deep learning has achieved astounding successes due in part to the availability of large-scale real-world data. However, processing such massive amounts of data comes at a considerable cost in terms of computations, storage,…

Machine Learning · Computer Science 2023-03-28 Jiawei Du , Yidi Jiang , Vincent Y. F. Tan , Joey Tianyi Zhou , Haizhou Li

Knowledge distillation is a method of transferring the knowledge from a pretrained complex teacher model to a student model, so a smaller network can replace a large teacher network at the deployment stage. To reduce the necessity of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Mingi Ji , Seungjae Shin , Seunghyun Hwang , Gibeom Park , Il-Chul Moon

Traffic prediction is a crucial topic because of its broad scope of applications in the transportation domain. Recently, various studies have achieved promising results. However, most studies assume the prediction locations have complete or…

Machine Learning · Computer Science 2024-02-07 Hao Mei , Junxian Li , Zhiming Liang , Guanjie Zheng , Bin Shi , Hua Wei

Improving the performance of semantic segmentation models using multispectral information is crucial, especially for environments with low-light and adverse conditions. Multi-modal fusion techniques pursue either the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Aniruddh Sikdar , Jayant Teotia , Suresh Sundaram