English
Related papers

Related papers: Are All Data Necessary? Efficient Data Pruning for…

200 papers

Autonomous driving has rapidly developed and shown promising performance due to recent advances in hardware and deep learning techniques. High-quality datasets are fundamental for developing reliable autonomous driving algorithms. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Mingyu Liu , Ekim Yurtsever , Jonathan Fossaert , Xingcheng Zhou , Walter Zimmer , Yuning Cui , Bare Luka Zagar , Alois C. Knoll

The goal of autonomous vehicles is to navigate public roads safely and comfortably. To enforce safety, traditional planning approaches rely on handcrafted rules to generate trajectories. Machine learning-based systems, on the other hand,…

Autoregressive Transformers adopted in Large Language Models (LLMs) are hard to scale to long sequences. Despite several works trying to reduce their computational cost, most of LLMs still adopt attention layers between all pairs of tokens…

Computation and Language · Computer Science 2024-06-03 Sotiris Anagnostidis , Dario Pavllo , Luca Biggio , Lorenzo Noci , Aurelien Lucchi , Thomas Hofmann

Dataset pruning has been widely studied for 2D images to remove redundancy and accelerate training, while particular pruning methods for 3D data remain largely unexplored. In this work, we study dataset pruning for 3D data, where its…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xiaohan Zhao , Xinyi Shang , Jiacheng Liu , Zhiqiang Shen

The availability of massive vehicle trajectory data enables the modeling of road-network constrained movement as travel-cost distributions rather than just single-valued costs, thereby capturing the inherent uncertainty of movement and…

Data Structures and Algorithms · Computer Science 2024-07-10 Chenjuan Guo , Ronghui Xu , Bin Yang , Ye Yuan , Tung Kieu , Yan Zhao , Christian S. Jensen

A new data-enabled control technique for uncertain linear time-invariant systems, recently conceived by Coulson et\ al., builds upon the direct optimization of controllers over input/output pairs drawn from a large dataset. We adopt an…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Filippo Fabiani , Paul J. Goulart

The rapid growth of resource-constrained mobile platforms, including mobile robots, wearable systems, and Internet-of-Things devices, has increased the demand for computationally efficient neural network controllers (NNCs) that can operate…

Robotics · Computer Science 2025-08-12 Ganesh Sundaram , Jonas Ulmen , Amjad Haider , Daniel Görges

Routing algorithms for public transport, particularly the widely used RAPTOR and its variants, often face performance bottlenecks during the transfer relaxation phase, especially on dense transfer graphs, when supporting unlimited…

Data Structures and Algorithms · Computer Science 2026-05-27 Andrii Rohovyi , Abdallah Abuaisha , Toby Walsh

Machine learning optimization often depends on stochastic gradient descent, where the precision of gradient estimation is vital for model performance. Gradients are calculated from mini-batches formed by uniformly selecting data samples…

Machine Learning · Computer Science 2025-01-29 Corentin Salaün , Xingchang Huang , Iliyan Georgiev , Niloy J. Mitra , Gurprit Singh

Data-efficient learning has garnered significant attention, especially given the current trend of large multi-modal models. Recently, dataset distillation has become an effective approach by synthesizing data samples that are essential for…

Machine Learning · Computer Science 2024-08-08 Yue Xu , Yong-Lu Li , Kaitong Cui , Ziyu Wang , Cewu Lu , Yu-Wing Tai , Chi-Keung Tang

The widespread availability of pre-trained vision models has enabled numerous deep learning applications through their transferable representations. However, their computational and storage costs often limit practical deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Leonardo Iurada , Beatrice Occhiena , Tatiana Tommasi

Visual instruction tuning adapts pre-trained Multimodal Large Language Models (MLLMs) to follow human instructions for real-world applications. However, the rapid growth of these datasets introduces significant redundancy, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Jinhe Bi , Aniri , Yifan Wang , Danqi Yan , Wenke Huang , Zengjie Jin , Xiaowen Ma , Sikuan Yan , Artur Hecker , Mang Ye , Xun Xiao , Hinrich Schuetze , Volker Tresp , Yunpu Ma

Data scaling is fundamental to modern deep learning, and grows increasingly critical as autonomous driving shifts to end-to-end learning. Real-world driving data is expensive to annotate and scene-biased, making real-synthetic co-training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hongzhi Ruan , Pei Liu , Weiliang Ma , Zhengning Li , Xueyang Zhang , Jun Ma , Dan Xu , Kun Zhan

Weight pruning is an effective model compression technique to tackle the challenges of achieving real-time deep neural network (DNN) inference on mobile devices. However, prior pruning schemes have limited application scenarios due to…

Machine Learning · Computer Science 2022-03-29 Yifan Gong , Geng Yuan , Zheng Zhan , Wei Niu , Zhengang Li , Pu Zhao , Yuxuan Cai , Sijia Liu , Bin Ren , Xue Lin , Xulong Tang , Yanzhi Wang

We study large-scale classification problems in changing environments where a small part of the dataset is modified, and the effect of the data modification must be quickly incorporated into the classifier. When the entire dataset is large,…

Machine Learning · Statistics 2016-06-02 Hiroyuki Hanada , Atsushi Shibagaki , Jun Sakuma , Ichiro Takeuchi

Active learning strategies for 3D object detection in autonomous driving datasets may help to address challenges of data imbalance, redundancy, and high-dimensional data. We demonstrate the effectiveness of entropy querying to select…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Ross Greer , Bjørk Antoniussen , Mathias V. Andersen , Andreas Møgelmose , Mohan M. Trivedi

Synthetic data has gained attention for training large language models, but poor-quality data can harm performance (see, e.g., Shumailov et al. (2023); Seddik et al. (2024)). A potential solution is data pruning, which retains only…

Machine Learning · Computer Science 2024-10-14 Aymane El Firdoussi , Mohamed El Amine Seddik , Soufiane Hayou , Reda Alami , Ahmed Alzubaidi , Hakim Hacid

Trajectory generation has recently drawn growing interest in privacy-preserving urban mobility studies and location-based service applications. Although many studies have used deep learning or generative AI methods to model trajectories and…

Machine Learning · Computer Science 2026-03-25 Yuanbo Tang , Yan Tang , Zixuan Zhang , Zihui Zhao , Yang Li

Causal discovery in the presence of missing data introduces a chicken-and-egg dilemma. While the goal is to recover the true causal structure, robust imputation requires considering the dependencies or, preferably, causal relations among…

Machine Learning · Computer Science 2024-06-04 Vy Vo , He Zhao , Trung Le , Edwin V. Bonilla , Dinh Phung

This paper presents a generalized technology of extraction of explicit knowledge from data. The main ideas are 1) maximal reduction of network complexity (not only removal of neurons or synapses, but removal all the unnecessary elements and…

Condensed Matter · Physics 2007-05-23 A. N. Gorban , Eu. M. Mirkes , V. G. Tsaregorodtsev