English
Related papers

Related papers: Wald-Kernel: Learning to Aggregate Information for…

200 papers

We consider the problem of making a quick decision in favor of one of two possible physical signal models while the numerical measurements are acquired by sensing devices featuring minimal digitization complexity. Therefore, the digital…

Signal Processing · Electrical Eng. & Systems 2019-10-29 Manuel S. Stein , Michael Fauß

Obtaining reliable, adaptive confidence sets for prediction functions (hypotheses) is a central challenge in sequential decision-making tasks, such as bandits and model-based reinforcement learning. These confidence sets typically rely on…

Machine Learning · Statistics 2022-06-20 Parnian Kassraie , Jonas Rothfuss , Andreas Krause

Although kernel methods are widely used in many learning problems, they have poor scalability to large datasets. To address this problem, sketching and stochastic gradient methods are the most commonly used techniques to derive efficient…

Machine Learning · Statistics 2022-06-03 Shingo Yashima , Atsushi Nitanda , Taiji Suzuki

Certifiable, adaptive uncertainty estimates for unknown quantities are an essential ingredient of sequential decision-making algorithms. Standard approaches rely on problem-dependent concentration results and are limited to a specific…

Machine Learning · Computer Science 2023-11-09 Nicolas Emmenegger , Mojmír Mutný , Andreas Krause

Classical penalized likelihood regression problems deal with the case that the independent variables data are known exactly. In practice, however, it is common to observe data with incomplete covariate information. We are concerned with a…

Methodology · Statistics 2010-08-04 Xiwen Ma , Bin Dai , Ronald Klein , Barbara E. K. Klein , Kristine E. Lee , Grace Wahba

We focus on the distribution regression problem: regressing to vector-valued outputs from probability measures. Many important machine learning and statistical tasks fit into this framework, including multi-instance learning and point…

Statistics Theory · Mathematics 2016-10-24 Zoltan Szabo , Bharath Sriperumbudur , Barnabas Poczos , Arthur Gretton

In the binary hypothesis testing problem, it is well known that sequentiality in taking samples eradicates the trade-off between two error exponents, yet implementing the optimal test requires the knowledge of the underlying distributions,…

Information Theory · Computer Science 2025-01-07 Ching-Fang Li , I-Hsiang Wang

The two-sample hypothesis testing problem is studied for the challenging scenario of high dimensional data sets with small sample sizes. We show that the two-sample hypothesis testing problem can be posed as a one-class set classification…

Machine Learning · Statistics 2017-11-15 Hamed Masnadi-Shirazi

We investigate sample-based learning of conditional distributions on multi-dimensional unit boxes, allowing for different dimensions of the feature and target spaces. Our approach involves clustering data near varying query points in the…

Machine Learning · Statistics 2024-06-14 Cyril Bénézet , Ziteng Cheng , Sebastian Jaimungal

We consider an incremental approximation method for solving variational problems in infinite-dimensional Hilbert spaces, where in each step a randomly and independently selected subproblem from an infinite collection of subproblems is…

Numerical Analysis · Mathematics 2018-03-06 Michael Griebel , Peter Oswald

We focus on the distribution regression problem: regressing to a real-valued response from a probability distribution. Although there exist a large number of similarity measures between distributions, very little is known about their…

Statistics Theory · Mathematics 2015-01-28 Zoltan Szabo , Arthur Gretton , Barnabas Poczos , Bharath Sriperumbudur

This paper studies an intriguing phenomenon related to the good generalization performance of estimators obtained by using large learning rates within gradient descent algorithms. First observed in the deep learning literature, we show that…

Machine Learning · Statistics 2022-06-06 Gaspard Beugnot , Julien Mairal , Alessandro Rudi

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

The problem of multiple kernel learning based on penalized empirical risk minimization is discussed. The complexity penalty is determined jointly by the empirical $L_2$ norms and the reproducing kernel Hilbert space (RKHS) norms induced by…

Statistics Theory · Mathematics 2012-11-14 Vladimir Koltchinskii , Ming Yuan

We extend the herding algorithm to continuous spaces by using the kernel trick. The resulting "kernel herding" algorithm is an infinite memory deterministic process that learns to approximate a PDF with a collection of samples. We show that…

Machine Learning · Computer Science 2012-03-19 Yutian Chen , Max Welling , Alex Smola

Learning to hash is an efficient paradigm for exact and approximate nearest neighbor search from massive databases. Binary hash codes are typically extracted from an image by rounding output features from a CNN, which is trained on a…

Machine Learning · Computer Science 2020-05-12 Heikki Arponen , Tom E. Bishop

In this paper, an online learning algorithm is proposed as sequential stochastic approximation of a regularization path converging to the regression function in reproducing kernel Hilbert spaces (RKHSs). We show that it is possible to…

Probability · Mathematics 2013-01-23 Pierre Tarrès , Yuan Yao

We develop, discuss, and compare several inference techniques to constrain theory parameters in collider experiments. By harnessing the latent-space structure of particle physics processes, we extract extra information from the simulator.…

High Energy Physics - Phenomenology · Physics 2018-09-19 Johann Brehmer , Kyle Cranmer , Gilles Louppe , Juan Pavez

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

We consider learning in decentralized heterogeneous networks: agents seek to minimize a convex functional that aggregates data across the network, while only having access to their local data streams. We focus on the case where agents seek…

Optimization and Control · Mathematics 2021-06-02 Hrusikesha Pradhan , Amrit Singh Bedi , Alec Koppel , Ketan Rajawat
‹ Prev 1 2 3 10 Next ›