English
Related papers

Related papers: Optimal Sampling Density for Nonparametric Regress…

200 papers

As neural networks gain widespread adoption in embedded devices, there is a need for model compression techniques to facilitate deployment in resource-constrained environments. Quantization is one of the go-to methods yielding…

Machine Learning · Computer Science 2021-01-13 Karina Vasquez , Yeshwanth Venkatesha , Abhiroop Bhattacharjee , Abhishek Moitra , Priyadarshini Panda

Nonlinear regression problem is one of the most popular and important statistical tasks. The first methods like least squares estimation go back to Gauss and Legendre. Recent models and developments in statistics and machine learning like…

Statistics Theory · Mathematics 2025-02-20 Vladimir Spokoiny

Active learning is a unique abstraction of machine learning techniques where the model/algorithm could guide users for annotation of a set of data points that would be beneficial to the model, unlike passive machine learning. The primary…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Vishwesh Nath , Dong Yang , Bennett A. Landman , Daguang Xu , Holger R. Roth

Recently there has been a great deal of interest surrounding the calibration of quantum sensors using machine learning techniques. In this work, we explore the use of regression to infer a machine-learned point estimate of an unknown…

Quantum Physics · Physics 2024-06-19 Samuel P. Nolan , Luca Pezzè , Augusto Smerzi

We propose a kernel mixture of polynomials prior for Bayesian nonparametric regression. The regression function is modeled by local averages of polynomials with kernel mixture weights. We obtain the minimax-optimal rate of contraction of…

Statistics Theory · Mathematics 2018-09-17 Fangzheng Xie , Yanxun Xu

Data subsampling has become widely recognized as a tool to overcome computational and economic bottlenecks in analyzing massive datasets. We contribute to the development of adaptive design for estimation of finite population…

Methodology · Statistics 2024-07-08 Henrik Imberg , Xiaomi Yang , Carol Flannagan , Jonas Bärgman

In this work, we propose an adaptive sparse learning algorithm that can be applied to learn the physical processes and obtain a sparse representation of the solution given a large snapshot space. Assume that there is a rich class of…

Machine Learning · Computer Science 2022-07-26 Yating Wang , Wing Tat Leung , Guang Lin

Non-active adaptive sampling is a way of building machine learning models from a training data base which are supposed to dynamically and automatically derive guaranteed sample size. In this context and regardless of the strategy used in…

Computation and Language · Computer Science 2024-02-06 Manuel Vilares Ferro , Victor M. Darriba Bilbao , Jesús Vilares Ferro

Several pool-based active learning algorithms (AL) were employed to model potential energy surfaces (PESs) with a minimum number of electronic structure calculations. Theoretical and empirical results suggest that superior strategies can be…

Chemical Physics · Physics 2021-10-27 Yahya Saleh , Vishnu Sanjay , Armin Iske , Andrey Yachmenev , Jochen Küpper

We consider multi-antenna wireless systems aided by large intelligent surfaces (LIS). LIS presents a new physical layer technology for improving coverage and energy efficiency by intelligently controlling the propagation environment. In…

Signal Processing · Electrical Eng. & Systems 2020-11-17 Neel Kanth Kundu , Matthew R. McKay

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

Methodology · Statistics 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

Learning to infer Bayesian posterior from a few-shot dataset is an important step towards robust meta-learning due to the model uncertainty inherent in the problem. In this paper, we propose a novel Bayesian model-agnostic meta-learning…

Machine Learning · Computer Science 2018-11-20 Taesup Kim , Jaesik Yoon , Ousmane Dia , Sungwoong Kim , Yoshua Bengio , Sungjin Ahn

Performing machine learning with analog signals offers advantages in speed and energy efficiency, but sensitivity to component and measurement imperfections often foils training without a system-specific companion digital model. Here we…

Disordered Systems and Neural Networks · Physics 2026-03-18 Sam Dillavou , Marcelo Guzman , Andrea J. Liu , Douglas J. Durian

Semisupervised methods inevitably invoke some assumption that links the marginal distribution of the features to the regression function of the label. Most commonly, the cluster or manifold assumptions are used which imply that the…

Statistics Theory · Mathematics 2011-12-02 Martin Azizyan , Aarti Singh , Larry Wasserman

This paper presents a Bayesian sampling approach to bandwidth estimation for the local linear estimator of the regression function in a nonparametric regression model. In the Bayesian sampling approach, the error density is approximated by…

Methodology · Statistics 2020-11-10 Han Lin Shang , Xibin Zhang

Objective: Sparse Bayesian learning provides an effective scheme to solve the high-dimensional problem in brain signal decoding. However, traditional assumptions regarding data distributions such as Gaussian and binomial are potentially…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Yuanhao Li , Badong Chen , Wenjun Bai , Yasuharu Koike , Okito Yamashita

We present a deep learning strategy that enables, for the first time, contrast-agnostic semantic segmentation of completely unpreprocessed brain MRI scans, without requiring additional training or fine-tuning for new modalities. Classical…

Image and Video Processing · Electrical Eng. & Systems 2021-04-09 Benjamin Billot , Douglas Greve , Koen Van Leemput , Bruce Fischl , Juan Eugenio Iglesias , Adrian V. Dalca

Scaling limits, such as infinite-width limits, serve as promising theoretical tools to study large-scale models. However, it is widely believed that existing infinite-width theory does not faithfully explain the behavior of practical…

Machine Learning · Computer Science 2025-10-28 Moritz Haas , Sebastian Bordt , Ulrike von Luxburg , Leena Chennuru Vankadara

Active learning aims to reduce labeling efforts by selectively asking humans to annotate the most important data points from an unlabeled pool and is an example of human-machine interaction. Though active learning has been extensively…

Machine Learning · Computer Science 2020-01-31 Hongjing Zhang , S. S. Ravi , Ian Davidson

The cost of annotating transcriptions for large speech corpora becomes a bottleneck to maximally enjoy the potential capacity of deep neural network-based automatic speech recognition models. In this paper, we present a new training…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-06 Jihwan Bang , Heesu Kim , YoungJoon Yoo , Jung-Woo Ha