English
Related papers

Related papers: LaF: Labeling-Free Model Selection for Automated D…

200 papers

We introduce MODEL SELECTOR, a framework for label-efficient selection of pretrained classifiers. Given a pool of unlabeled target data, MODEL SELECTOR samples a small subset of highly informative examples for labeling, in order to…

Machine Learning · Computer Science 2024-10-28 Patrik Okanovic , Andreas Kirsch , Jannes Kasper , Torsten Hoefler , Andreas Krause , Nezihe Merve Gürel

Training sophisticated agents for optimal decision-making under uncertainty has been key to the rapid development of modern autonomous systems across fields. Notably, model-free reinforcement learning (RL) has enabled decision-making agents…

Machine Learning · Computer Science 2025-07-21 Thomas Banker , Ali Mesbah

Multi-label learning is a rapidly growing research area that aims to predict multiple labels from a single input data point. In the era of big data, tasks involving multi-label classification (MLC) or ranking present significant and…

Machine Learning · Computer Science 2024-06-27 Adane Nega Tarekegn , Mohib Ullah , Faouzi Alaya Cheikh

Deep Learning heavily depends on large labeled datasets which limits further improvements. While unlabeled data is available in large amounts, in particular in image recognition, it does not fulfill the closed world assumption of…

Machine Learning · Computer Science 2020-12-24 Maximilian Augustin , Matthias Hein

Deep active learning (AL) selects batches of instances for annotation to avoid retraining deep neural networks (DNNs) after each new label. Employing a naive top-$b$ selection can result in a batch of redundant (similar) instances. To…

Machine Learning · Computer Science 2026-03-12 Denis Huseljic , Marek Herde , Lukas Rauch , Paul Hahn , Zhixin Huang , Daniel Kottke , Stephan Vogt , Bernhard Sick

Training deep neural network (DNN) models, which has become an important task in today's software development, is often costly in terms of computational resources and time. With the inspiration of software reuse, building DNN models through…

Software Engineering · Computer Science 2023-08-01 Binhang Qi , Hailong Sun , Xiang Gao , Hongyu Zhang , Zhaotian Li , Xudong Liu

The accuracy of deep neural networks is significantly influenced by the effectiveness of mini-batch construction during training. In single-label scenarios, such as binary and multi-class classification tasks, it has been demonstrated that…

Machine Learning · Computer Science 2024-12-24 Ao Zhou , Bin Liu , Jin Wang , Grigorios Tsoumakas

Images of scenes have various objects as well as abundant attributes, and diverse levels of visual categorization are possible. A natural image could be assigned with fine-grained labels that describe major components, coarse-grained labels…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Hexiang Hu , Guang-Tong Zhou , Zhiwei Deng , Zicheng Liao , Greg Mori

Recent advancements in semi-supervised deep learning have introduced effective strategies for leveraging both labeled and unlabeled data to improve classification performance. This work proposes a semi-supervised framework that utilizes a…

Machine Learning · Computer Science 2025-05-21 Aydin Abedinia , Shima Tabakhi , Vahid Seydi

Active learning aims to alleviate the amount of labor involved in data labeling by automating the selection of unlabeled samples via an acquisition function. For example, variational adversarial active learning (VAAL) leverages an…

Machine Learning · Computer Science 2024-08-26 Zongyao Lyu , William J. Beksi

Recent advances in large language models (LLMs) have yielded impressive performance on various tasks, yet they often depend on high-quality feedback that can be costly. Self-refinement methods attempt to leverage LLMs' internal evaluation…

Computation and Language · Computer Science 2025-12-01 Hikaru Asano , Tadashi Kozuno , Yukino Baba

Semi-supervised learning (SSL) alleviates the cost of data labeling process by exploiting unlabeled data and has achieved promising results. Meanwhile, with the development of large foundation models, exploiting pre-trained models becomes a…

Machine Learning · Computer Science 2025-10-28 Song-Lin Lv , Rui Zhu , Tong Wei , Yu-Feng Li , Lan-Zhe Guo

Given an unsupervised outlier detection (OD) task on a new dataset, how can we automatically select a good outlier detection method and its hyperparameter(s) (collectively called a model)? Thus far, model selection for OD has been a "black…

Machine Learning · Computer Science 2021-03-18 Yue Zhao , Ryan A. Rossi , Leman Akoglu

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

Machine Learning · Computer Science 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

Automated neural network design has received ever-increasing attention with the evolution of deep convolutional neural networks (CNNs), especially involving their deployment on embedded and mobile platforms. One of the biggest problems that…

Machine Learning · Computer Science 2021-03-04 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng

Successfully training a deep neural network demands a huge corpus of labeled data. However, each label only provides limited information to learn from and collecting the requisite number of labels involves massive human effort. In this…

Computation and Language · Computer Science 2020-04-17 Dong-Ho Lee , Rahul Khanna , Bill Yuchen Lin , Jamin Chen , Seyeon Lee , Qinyuan Ye , Elizabeth Boschee , Leonardo Neves , Xiang Ren

Recent studies on multi-label image classification have focused on designing more complex architectures of deep neural networks such as the use of attention mechanisms and region proposal networks. Although performance gains have been…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Qian Wang , Ning Jia , Toby P. Breckon

In semi-supervised learning, methods that rely on confidence learning to generate pseudo-labels have been widely proposed. However, increasing research finds that when faced with noisy and biased data, the model's representation network is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Yanbiao Ma , Licheng Jiao , Fang Liu , Lingling Li , Shuyuan Yang , Xu Liu

Neural network potentials (NNPs) are crucial for accelerating computational materials science by surrogating density functional theory (DFT) calculations. Improving their accuracy is possible through pre-training and fine-tuning, where an…

Machine Learning · Computer Science 2025-05-29 Yosuke Oyama , Yusuke Majima , Eiji Ohta , Yasufumi Sakai

Deep Convolutional Neural Networks (CNN) enforces supervised information only at the output layer, and hidden layers are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Zhuolin Jiang , Yaming Wang , Larry Davis , Walt Andrews , Viktor Rozgic