中文
相关论文

相关论文: The Sample Complexity of Approximate Rejection Sam…

200 篇论文

This paper proves an abstract theorem addressing in a unified manner two important problems in function approximation: avoiding curse of dimensionality and estimating the degree of approximation for out-of-sample extension in manifold…

机器学习 · 计算机科学 2019-11-05 Hrushikesh N. Mhaskar

We show a connection between sampling and optimization on discrete domains. For a family of distributions $\mu$ defined on size $k$ subsets of a ground set of elements that is closed under external fields, we show that rapid mixing of…

机器学习 · 计算机科学 2021-09-16 Nima Anari , Thuy-Duong Vuong

Federated learning has attracted significant recent attention due to its applicability across a wide range of settings where data is collected and analyzed across disparate locations. In this paper, we study federated nonparametric…

统计理论 · 数学 2024-06-12 T. Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

Online prediction from experts is a fundamental problem in machine learning and several works have studied this problem under privacy constraints. We propose and analyze new algorithms for this problem that improve over the regret bounds of…

机器学习 · 计算机科学 2023-07-03 Hilal Asi , Vitaly Feldman , Tomer Koren , Kunal Talwar

We consider the problem of sampling from constrained distributions, which has posed significant challenges to both non-asymptotic analysis and algorithmic design. We propose a unified framework, which is inspired by the classical mirror…

机器学习 · 计算机科学 2021-01-01 Ya-Ping Hsieh , Ali Kavis , Paul Rolland , Volkan Cevher

Learning a robust classifier from a few samples remains a key challenge in machine learning. A major thrust of research has been focused on developing $k$-nearest neighbor ($k$-NN) based algorithms combined with metric learning that…

机器学习 · 统计学 2022-02-17 Shixiang Zhu , Liyan Xie , Minghe Zhang , Rui Gao , Yao Xie

We consider the problem of adaptive stratified sampling for Monte Carlo integration of a differentiable function given a finite number of evaluations to the function. We construct a sampling scheme that samples more often in regions where…

机器学习 · 统计学 2012-10-22 Alexandra Carpentier , Rémi Munos

Learning theory has largely focused on two main learning scenarios. The first is the classical statistical setting where instances are drawn i.i.d. from a fixed distribution and the second scenario is the online learning, completely…

机器学习 · 统计学 2011-04-28 Alexander Rakhlin , Karthik Sridharan , Ambuj Tewari

We consider the problem of online stratified sampling for Monte Carlo integration of a function given a finite budget of $n$ noisy evaluations to the function. More precisely we focus on the problem of choosing the number of strata $K$ as a…

统计理论 · 数学 2012-05-23 Alexandra Carpentier , Rémi Munos

We present an algorithm based on the \emph{Optimism in the Face of Uncertainty} (OFU) principle which is able to learn Reinforcement Learning (RL) modeled by Markov decision process (MDP) with finite state-action space efficiently. By…

机器学习 · 计算机科学 2020-01-01 Zihan Zhang , Xiangyang Ji

We investigate online convex optimization in non-stationary environments and choose the dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

机器学习 · 计算机科学 2020-12-01 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

We consider the problem of reconstructing an unknown function $u\in L^2(D,\mu)$ from its evaluations at given sampling points $x^1,\dots,x^m\in D$, where $D\subset \mathbb R^d$ is a general domain and $\mu$ a probability measure. The…

数值分析 · 数学 2020-10-29 Albert Cohen , Matthieu Dolbeault

We study online linear optimization with matrix variables constrained by the operator norm, a setting where the geometry renders designing data-dependent and efficient adaptive algorithms challenging. The best-known adaptive regret bounds…

最优化与控制 · 数学 2026-02-10 Ruichen Jiang , Zakaria Mhammedi , Mehryar Mohri , Aryan Mokhtari

Value function approximation has demonstrated phenomenal empirical success in reinforcement learning (RL). Nevertheless, despite a handful of recent progress on developing theory for RL with linear function approximation, the understanding…

机器学习 · 计算机科学 2020-06-22 Ruosong Wang , Ruslan Salakhutdinov , Lin F. Yang

We study theoretical properties of a broad class of regularized algorithms with vector-valued output. These spectral algorithms include kernel ridge regression, kernel principal component regression, various implementations of gradient…

机器学习 · 统计学 2024-05-24 Dimitri Meunier , Zikai Shen , Mattes Mollenhauer , Arthur Gretton , Zhu Li

The approximation ratio has become one of the dominant measures in mechanism design problems. In light of analysis of algorithms, we define the \emph{smoothed approximation ratio} to compare the performance of the optimal mechanism and a…

计算机科学与博弈论 · 计算机科学 2017-06-23 Xiaotie Deng , Yansong Gao , Jie Zhang

Despite plenty of efforts focusing on improving the domain adaptation ability (DA) under unsupervised or few-shot semi-supervised settings, recently the solution of active learning started to attract more attention due to its suitability in…

机器学习 · 计算机科学 2022-04-05 Ming Xie , Yuxi Li , Yabiao Wang , Zekun Luo , Zhenye Gan , Zhongyi Sun , Mingmin Chi , Chengjie Wang , Pei Wang

Similarity learning has received a large amount of interest and is an important tool for many scientific and industrial applications. In this framework, we wish to infer the distance (similarity) between points with respect to an arbitrary…

机器学习 · 统计学 2016-11-30 Michael Rabadi

This paper is concerned with offline reinforcement learning (RL), which learns using pre-collected data without further exploration. Effective offline RL would be able to accommodate distribution shift and limited data coverage. However,…

机器学习 · 统计学 2024-03-11 Gen Li , Laixi Shi , Yuxin Chen , Yuejie Chi , Yuting Wei

Hypothesis Selection is a fundamental distribution learning problem where given a comparator-class $Q=\{q_1,\ldots, q_n\}$ of distributions, and a sampling access to an unknown target distribution $p$, the goal is to output a distribution…

机器学习 · 计算机科学 2021-08-19 Olivier Bousquet , Mark Braverman , Klim Efremenko , Gillat Kol , Shay Moran