English
Related papers

Related papers: LiDAR dataset distillation within bayesian active …

200 papers

We present the Dayton Annotated LiDAR Earth Scan (DALES) data set, a new large-scale aerial LiDAR data set with over a half-billion hand-labeled points spanning 10 square kilometers of area and eight object categories. Large annotated point…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Nina Varney , Vijayan K. Asari , Quinn Graehling

With the goal of making deep learning more label-efficient, a growing number of papers have been studying active learning (AL) for deep models. However, there are a number of issues in the prevalent experimental settings, mainly stemming…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Nathan Beck , Durga Sivasubramanian , Apurva Dani , Ganesh Ramakrishnan , Rishabh Iyer

As an effective strategy, data augmentation (DA) alleviates data scarcity scenarios where deep learning techniques may fail. It is widely applied in computer vision then introduced to natural language processing and achieves improvements in…

Computation and Language · Computer Science 2022-06-28 Bohan Li , Yutai Hou , Wanxiang Che

Deep learning models have demonstrated great potential in medical 3D imaging, but their development is limited by the expensive, large volume of annotated data required. Active learning (AL) addresses this by training a model on a subset of…

Automatic machine learning (\AML) is a family of techniques to automate the process of training predictive models, aiming to both improve performance and make machine learning more accessible. While many recent works have focused on aspects…

Machine Learning · Computer Science 2020-03-24 Nadiia Chepurko , Ryan Marcus , Emanuel Zgraggen , Raul Castro Fernandez , Tim Kraska , David Karger

Active learning (AL) algorithms aim to identify an optimal subset of data for annotation, such that deep neural networks (DNN) can achieve better performance when trained on this labeled subset. AL is especially impactful in industrial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zeyad Ali Sami Emam , Hong-Min Chu , Ping-Yeh Chiang , Wojciech Czaja , Richard Leapman , Micah Goldblum , Tom Goldstein

Machine learning (ML) on tabular data is ubiquitous, yet obtaining abundant high-quality tabular data for model training remains a significant obstacle. Numerous works have focused on tabular data augmentation (TDA) to enhance the original…

Machine Learning · Computer Science 2024-08-01 Lingxi Cui , Huan Li , Ke Chen , Lidan Shou , Gang Chen

Herein, we propose a novel dataset distillation method for constructing small informative datasets that preserve the information of the large original datasets. The development of deep learning models is enabled by the availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Guang Li , Ren Togo , Takahiro Ogawa , Miki Haseyama

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

We propose a conceptually simple and lightweight framework for improving the robustness of vision models through the combination of knowledge distillation and data augmentation. We address the conjecture that larger models do not make for…

Machine Learning · Computer Science 2024-02-06 Andy Zhou , Jindong Wang , Yu-Xiong Wang , Haohan Wang

Multi-task learning is central to many real-world applications. Unfortunately, obtaining labelled data for all tasks is time-consuming, challenging, and expensive. Active Learning (AL) can be used to reduce this burden. Existing techniques…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Nikita Durasov , Nik Dorndorf , Pascal Fua

Data augmentation (DA) turns seemingly intractable computational problems into simple ones by augmenting latent missing data. In addition to computational simplicity, it is now well-established that DA equipped with a deterministic…

Methodology · Statistics 2020-05-26 Hyungsuk Tak , Kisung You , Sujit K. Ghosh , Bingyue Su , Joseph Kelly

Many real-world applications such as robotics provide hard constraints on power and compute that limit the viable model complexity of Reinforcement Learning (RL) agents. Similarly, in many distributed RL settings, acting is done on…

Machine Learning · Computer Science 2021-04-06 Emilio Parisotto , Ruslan Salakhutdinov

Data augmentations are important in training high-performance 3D object detectors for point clouds. Despite recent efforts on designing new data augmentations, perhaps surprisingly, most state-of-the-art 3D detectors only use a few simple…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Zhaoqi Leng , Guowang Li , Chenxi Liu , Ekin Dogus Cubuk , Pei Sun , Tong He , Dragomir Anguelov , Mingxing Tan

Adapter-Tuning (AT) method involves freezing a pre-trained model and introducing trainable adapter modules to acquire downstream knowledge, thereby calibrating the model for better adaptation to downstream tasks. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jiacheng Ruan , Jingsheng Gao , Mingye Xie , Daize Dong , Suncheng Xiang , Ting Liu , Yuzhuo Fu

In recent years, language models (LMs) have made remarkable progress in advancing the field of natural language processing (NLP). However, the impact of data augmentation (DA) techniques on the fine-tuning (FT) performance of these LMs has…

Computation and Language · Computer Science 2023-06-14 Zhengxiang Shi , Aldo Lipani

Supervised Deep Learning has been highly successful in recent years, achieving state-of-the-art results in most tasks. However, with the ongoing uptake of such methods in industrial applications, the requirement for large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Fabio De Sousa Ribeiro , Francesco Caliva , Mark Swainson , Kjartan Gudmundsson , Georgios Leontidis , Stefanos Kollias

Data augmentation (DA) has been widely utilized to improve generalization in training deep neural networks. Recently, human-designed data augmentation has been gradually replaced by automatically learned augmentation policy. Through finding…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Xinyu Zhang , Qiang Wang , Jian Zhang , Zhao Zhong

AutoAugment has been a powerful algorithm that improves the accuracy of many vision tasks, yet it is sensitive to the operator space as well as hyper-parameters, and an improper setting may degenerate network optimization. This paper delves…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Longhui Wei , An Xiao , Lingxi Xie , Xin Chen , Xiaopeng Zhang , Qi Tian

In Active Domain Adaptation (ADA), one uses Active Learning (AL) to select a subset of images from the target domain, which are then annotated and used for supervised domain adaptation (DA). Given the large performance gap between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Sharat Agarwal , Saket Anand , Chetan Arora