English
Related papers

Related papers: On minimizing the training set fill distance in ma…

200 papers

We propose a new unsupervised anomaly detection method based on the sliced-Wasserstein distance for training data selection in machine learning approaches. Our filtering technique is interesting for decision-making pipelines deploying…

Machine Learning · Computer Science 2025-04-18 Julien Pallage , Antoine Lesage-Landry

We propose a few-shot learning method for spatial regression. Although Gaussian processes (GPs) have been successfully used for spatial regression, they require many observations in the target task to achieve a high predictive performance.…

Machine Learning · Statistics 2020-10-12 Tomoharu Iwata , Yusuke Tanaka

In image Super-Resolution (SR), relying on large datasets for training is a double-edged sword. While offering rich training material, they also demand substantial computational and storage resources. In this work, we analyze dataset…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Brian B. Moser , Federico Raue , Andreas Dengel

Accurate quantification of uncertainty is crucial for real-world applications of machine learning. However, modern deep neural networks still produce unreliable predictive uncertainty, often yielding over-confident predictions. In this…

Machine Learning · Computer Science 2020-10-29 Peng Cui , Wenbo Hu , Jun Zhu

Supervised learning from training data with imbalanced class sizes, a commonly encountered scenario in real applications such as anomaly/fraud detection, has long been considered a significant challenge in machine learning. Motivated by…

Machine Learning · Computer Science 2019-05-27 Yunru Liu , Tingran Gao , Haizhao Yang

The training phase is the most important stage during the machine learning process. In the case of labeled data and supervised learning, machine training consists in minimizing the loss function subject to different constraints. In an…

Machine Learning · Computer Science 2021-12-03 Davide La Torre , Danilo Liuzzi , Marco Repetto , Matteo Rocca

Despite successful use in a wide variety of disciplines for data analysis and prediction, machine learning (ML) methods suffer from a lack of understanding of the reliability of predictions due to the lack of transparency and black-box…

Materials Science · Physics 2023-04-04 Evan Askanazi , Ilya Grinberg

This paper studies federated learning for nonparametric regression in the context of distributed samples across different servers, each adhering to distinct differential privacy constraints. The setting we consider is heterogeneous,…

Statistics Theory · Mathematics 2024-06-12 T. Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

In scientific machine learning, regression networks have been recently applied to approximate solution maps (e.g., potential-ground state map of Schr\"odinger equation). In this paper, we aim to reduce the generalization error without…

Numerical Analysis · Mathematics 2021-02-16 Zhihan Li , Yuwei Fan , Lexing Ying

This paper introduces a novel meta-learning algorithm for time series forecast model performance prediction. We model the forecast error as a function of time series features calculated from the historical time series with an efficient…

Applications · Statistics 2022-07-11 Thiyanga S. Talagala , Feng Li , Yanfei Kang

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

Machine Learning · Computer Science 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

This paper uses techniques from Random Matrix Theory to find the ideal training-testing data split for a simple linear regression with m data points, each an independent n-dimensional multivariate Gaussian. It defines "ideal" as satisfying…

Machine Learning · Statistics 2022-07-26 Alexander Dubbs

Coreset selection is powerful in reducing computational costs and accelerating data processing for deep learning algorithms. It strives to identify a small subset from large-scale data, so that training only on the subset practically…

Machine Learning · Computer Science 2024-03-01 Xiaobo Xia , Jiale Liu , Shaokun Zhang , Qingyun Wu , Hongxin Wei , Tongliang Liu

Conformal prediction is a generic methodology for finite-sample valid distribution-free prediction. This technique has garnered a lot of attention in the literature partly because it can be applied with any machine learning algorithm that…

Methodology · Statistics 2024-04-12 Yachong Yang , Arun Kumar Kuchibhotla

Considered as a data-driven approach, Fingerprinting Localization Solutions (FPSs) enjoy huge popularity due to their good performance and minimal environment information requirement. This papers addresses applications of artificial…

Networking and Internet Architecture · Computer Science 2018-03-23 Linchen Xiao , Arash Behboodi , Rudolf Mathar

This is a technical report that extends and clarifies the results presented in [1]. The model identification problem for asymptotically stable linear time invariant systems is considered. The system output is affected by an additive noise…

Optimization and Control · Mathematics 2018-09-05 Marco Lauricella , Lorenzo Fagiano

Machine learning (ML) techniques are increasingly applied to decision-making and control problems in Cyber-Physical Systems among which many are safety-critical, e.g., chemical plants, robotics, autonomous vehicles. Despite the significant…

Systems and Control · Electrical Eng. & Systems 2019-09-12 Xiaozhe Gu , Arvind Easwaran

This work investigates the selection of high-quality pre-training data from massive corpora to enhance LMs' capabilities for downstream usage. We formulate data selection as a generalized Optimal Control problem, which can be solved…

Computation and Language · Computer Science 2025-03-20 Yuxian Gu , Li Dong , Hongning Wang , Yaru Hao , Qingxiu Dong , Furu Wei , Minlie Huang

Sampling is an essential part of raw point cloud data processing such as in the popular PointNet++ scheme. Farthest Point Sampling (FPS), which iteratively samples the farthest point and performs distance updating, is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Jingtao Li , Jian Zhou , Yan Xiong , Xing Chen , Chaitali Chakrabarti

Machine learning algorithms have grown in sophistication over the years and are increasingly deployed for real-life applications. However, when using machine learning techniques in practical settings, particularly in high-risk applications…

Machine Learning · Computer Science 2023-10-06 Sukrita Singh , Neeraj Sarna , Yuanyuan Li , Yang Li , Agni Orfanoudaki , Michael Berger