English
Related papers

Related papers: Sampling depth trade-off in function estimation un…

200 papers

Decision-makers often simultaneously face many related but heterogeneous learning problems. For instance, a large retailer may wish to learn product demand at different stores to solve pricing or inventory problems, making it desirable to…

Machine Learning · Statistics 2024-07-30 Kan Xu , Hamsa Bastani

A common strategy in modern learning systems is to learn a representation that is useful for many tasks, a.k.a. representation learning. We study this strategy in the imitation learning setting for Markov decision processes (MDPs) where…

Machine Learning · Computer Science 2020-02-26 Sanjeev Arora , Simon S. Du , Sham Kakade , Yuping Luo , Nikunj Saunshi

Conducting pairwise comparisons is a widely used approach in curating human perceptual preference data. Typically raters are instructed to make their choices according to a specific set of rules that address certain dimensions of image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Hossein Talebi , Ehsan Amid , Peyman Milanfar , Manfred K. Warmuth

Sampling-based planning is the predominant paradigm for motion planning in robotics. Most sampling-based planners use a global random sampling scheme to guarantee probabilistic completeness. However, most schemes are often inefficient as…

Robotics · Computer Science 2020-01-22 Tin Lai , Philippe Morere , Fabio Ramos , Gilad Francis

Subsampling methods aim to select a subsample as a surrogate for the observed sample. As a powerful technique for large-scale data analysis, various subsampling methods are developed for more effective coefficient estimation and model…

Methodology · Statistics 2021-05-05 Tao Li , Cheng Meng

We study gradient flow on the multi-index regression problem for high-dimensional Gaussian data. Multi-index functions consist of a composition of an unknown low-rank linear projection and an arbitrary unknown, low-dimensional link…

Machine Learning · Statistics 2023-11-03 Alberto Bietti , Joan Bruna , Loucas Pillaud-Vivien

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

Many circumstances of practical importance have performance or success metrics which exist implicitly---in the eye of the beholder, so to speak. Tuning aspects of such problems requires working without defined metrics and only considering…

Machine Learning · Statistics 2019-06-11 Michael McCourt , Ian Dewancker

Discrete-state, continuous-time Markov models are widely used in the modeling of biochemical reaction networks. Their complexity often precludes analytic solution, and we rely on stochastic simulation algorithms to estimate system…

Quantitative Methods · Quantitative Biology 2016-05-20 Christopher Lester , Christian A. Yates , Michael B. Giles , Ruth E. Baker

There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors $D$ is large, one encounters a daunting problem in attempting to estimate a $D$-dimensional surface…

Statistics Theory · Mathematics 2014-06-17 Yun Yang , David B. Dunson

We present a new method of modelling numerical systems where there are two distinct output solution classes, for example tipping points or bifurcations. Gaussian process emulation is a useful tool in understanding these complex systems and…

Methodology · Statistics 2022-12-08 Louise Kimpton , Peter Challenor , Daniel Williamson

Humans rely on effective representations to learn from few examples and abstract useful information from sensory data. Inducing such representations in machine learning models has been shown to improve their performance on various…

Machine Learning · Computer Science 2025-02-03 Raja Marjieh , Sreejan Kumar , Declan Campbell , Liyi Zhang , Gianluca Bencomo , Jake Snell , Thomas L. Griffiths

The sampling method has been paid much attention in the field of complex network in general and statistical physics in particular. This paper presents two new sampling methods based on the perspective that a small part of vertices with high…

Physics and Society · Physics 2014-05-23 Luo Peng , Li Yongli , Wu Chong

For scalable machine learning on large data sets, subsampling a representative subset is a common approach for efficient model training. This is often achieved through importance sampling, whereby informative data points are sampled more…

Cryptography and Security · Computer Science 2025-03-31 Dominik Fay , Sebastian Mair , Jens Sjölund

In Multi-Task Learning (MTL), it is a common practice to train multi-task networks by optimizing an objective function, which is a weighted average of the task-specific objective functions. Although the computational advantages of this…

Machine Learning · Computer Science 2022-07-19 Lucas Pascal , Pietro Michiardi , Xavier Bost , Benoit Huet , Maria A. Zuluaga

While several papers have investigated computationally and statistically efficient methods for learning Gaussian mixtures, precise minimax bounds for their statistical performance as well as fundamental limits in high-dimensional settings…

Machine Learning · Statistics 2013-06-11 Martin Azizyan , Aarti Singh , Larry Wasserman

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

Modern software systems are typically configurable, a fundamental prerequisite for wide applicability and reusability. This flexibility poses an extraordinary challenge for quality assurance, as the enormous number of possible…

Practitioners often use data from a randomized controlled trial to learn a treatment assignment policy that can be deployed on a target population. A recurring concern in doing so is that, even if the randomized trial was well-executed…

Econometrics · Economics 2023-04-25 Lihua Lei , Roshni Sahoo , Stefan Wager

To design Bayesian studies, criteria for the operating characteristics of posterior analyses - such as power and the type I error rate - are often assessed by estimating sampling distributions of posterior probabilities via simulation. In…

Methodology · Statistics 2025-03-17 Luke Hagar , Nathaniel T. Stevens