English
Related papers

Related papers: Efficient SVDD Sampling with Approximation Guarant…

200 papers

Supervised deep learning requires a large amount of training samples with annotations (e.g. label class for classification task, pixel- or voxel-wised label map for segmentation tasks), which are expensive and time-consuming to obtain.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yuanhan Mo , Shuo Wang , Chengliang Dai , Rui Zhou , Zhongzhao Teng , Wenjia Bai , Yike Guo

Kernelized Support Vector Machines (SVMs) are among the best performing supervised learning methods. But for optimal predictive performance, time-consuming parameter tuning is crucial, which impedes application. To tackle this problem, the…

Machine Learning · Statistics 2016-02-11 Aydin Demircioglu , Daniel Horn , Tobias Glasmachers , Bernd Bischl , Claus Weihs

We introduce smallest valid partitioning (SVP), a segmentation method for multiple change-point detection in time-series. SVP relies on a local notion of segment validity: a candidate segment is retained only if it passes a user-chosen…

Methodology · Statistics 2026-02-05 Vincent Runge , Anica Kostic , Alexandre Combeau , Gaetano Romano

Diffusion models have become emerging generative models. Their sampling process involves multiple steps, and in each step the models predict the noise from a noisy sample. When the models make prediction, the output deviates from the ground…

Machine Learning · Computer Science 2025-10-28 Shifeng Xu , Yanzhu Liu , Adams Wai-Kin Kong

In modern data analysis, random sampling is an efficient and widely-used strategy to overcome the computational difficulties brought by large sample size. In previous studies, researchers conducted random sampling which is according to the…

Machine Learning · Statistics 2018-03-05 Rong Zhu

Recent advances in the theoretical understanding of SGD led to a formula for the optimal batch size minimizing the number of effective data passes, i.e., the number of iterations times the batch size. However, this formula is of no…

Machine Learning · Computer Science 2021-11-22 Motasem Alfarra , Slavomir Hanzely , Alyazeed Albasyoni , Bernard Ghanem , Peter Richtarik

Band selection is a great challenging task in the classification of hyperspectral remotely sensed images HSI. This is resulting from its high spectral resolution, the many class outputs and the limited number of training samples. For this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Hasna Nhaila , Asma Elmaizi , Elkebir Sarhrouni , Ahmed Hammouch

Federated learning is a machine learning paradigm in which multiple devices collaboratively train a model under the supervision of a central server while ensuring data privacy. However, its performance is often hindered by redundant,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Emre Ardıç , Yakup Genç

Large Language Models (LLMs) have become an indispensable part of natural language processing tasks. However, autoregressive sampling has become an efficiency bottleneck. Multi-Draft Speculative Decoding (MDSD) is a recent approach where,…

Computation and Language · Computer Science 2025-02-27 Zhengmian Hu , Tong Zheng , Vignesh Viswanathan , Ziyi Chen , Ryan A. Rossi , Yihan Wu , Dinesh Manocha , Heng Huang

Self-paced learning and hard example mining re-weight training instances to improve learning accuracy. This paper presents two improved alternatives based on lightweight estimates of sample uncertainty in stochastic gradient descent (SGD):…

Machine Learning · Statistics 2018-01-09 Haw-Shiuan Chang , Erik Learned-Miller , Andrew McCallum

Efficient and effective Out-of-Distribution (OOD) detection is essential for the safe deployment of AI systems. Existing feature space methods, while effective, often incur significant computational overhead due to their reliance on…

Machine Learning · Computer Science 2024-06-05 Litian Liu , Yao Qin

Active learning has been utilized as an efficient tool in building anomaly detection models by leveraging expert feedback. In an active learning framework, a model queries samples to be labeled by experts and re-trains the model with the…

Machine Learning · Computer Science 2023-09-19 Minkyung Kim , Junsik Kim , Jongmin Yu , Jun Kyun Choi

We propose FlowSVDD -- a flow-based one-class classifier for anomaly/outliers detection that realizes a well-known SVDD principle using deep learning tools. Contrary to other approaches to deep SVDD, the proposed model is instantiated using…

Machine Learning · Computer Science 2021-08-21 Marcin Sendera , Marek Śmieja , Łukasz Maziarka , Łukasz Struski , Przemysław Spurek , Jacek Tabor

The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its…

Methodology · Statistics 2022-01-11 Ryan Thompson

An adaptive sampling approach for efficient detection of bifurcation boundaries in parametrized fluid flow problems is presented herein. The study extends the machine-learning approach of Silvester~(J. Comput. Phys., 553 (2026), 114743),…

Fluid Dynamics · Physics 2026-02-19 Anshima Singh , David J. Silvester

Compressing self-supervised models has become increasingly necessary, as self-supervised models become larger. While previous approaches have primarily focused on compressing the model size, shortening sequences is also effective in…

Computation and Language · Computer Science 2022-10-26 Yen Meng , Hsuan-Jui Chen , Jiatong Shi , Shinji Watanabe , Paola Garcia , Hung-yi Lee , Hao Tang

While deep learning-based general object detection has made significant strides in recent years, the effectiveness and efficiency of small object detection remain unsatisfactory. This is primarily attributed not only to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zile Huang , Chong Zhang , Mingyu Jin , Fangyu Wu , Chengzhi Liu , Xiaobo Jin

We analyze a family of supervised learning algorithms based on sample compression schemes that are stable, in the sense that removing points from the training set which were not selected for the compression set does not alter the resulting…

Machine Learning · Computer Science 2020-11-10 Steve Hanneke , Aryeh Kontorovich

Despite plenty of efforts focusing on improving the domain adaptation ability (DA) under unsupervised or few-shot semi-supervised settings, recently the solution of active learning started to attract more attention due to its suitability in…

Machine Learning · Computer Science 2022-04-05 Ming Xie , Yuxi Li , Yabiao Wang , Zekun Luo , Zhenye Gan , Zhongyi Sun , Mingmin Chi , Chengjie Wang , Pei Wang

An importance sampling and bagging approach to solving the support vector machine (SVM) problem in the context of large databases is presented and evaluated. Our algorithm builds on the nearest neighbors ideas presented in Camelo at al.…

Machine Learning · Statistics 2018-08-20 R. Bárcenas , M. D. Gónzalez--Lima , A. J. Quiroz