中文
相关论文

相关论文: Predictive Power of Nearest Neighbors Algorithm un…

200 篇论文

Bayesian optimization (BO) with Gaussian process (GP) surrogate models is a powerful black-box optimization method. Acquisition functions are a critical part of a BO algorithm as they determine how the new samples are selected. Some of the…

机器学习 · 计算机科学 2024-12-30 Jingyi Wang , Haowei Wang , Cosmin G. Petra , Nai-Yuan Chiang

We consider the problem of online learning in Linear Quadratic Control systems whose state transition and state-action transition matrices $A$ and $B$ may be initially unknown. We devise an online learning algorithm and provide guarantees…

机器学习 · 计算机科学 2021-09-30 Yassir Jedra , Alexandre Proutiere

Motivated by safety-critical applications, test-time attacks on classifiers via adversarial examples has recently received a great deal of attention. However, there is a general lack of understanding on why adversarial examples arise;…

机器学习 · 统计学 2019-06-20 Yizhen Wang , Somesh Jha , Kamalika Chaudhuri

In near-term quantum computations that do not employ error correction, noise can proliferate rapidly, corrupting the quantum state and making results unreliable. These errors originate from both decoherence and control imprecision. The…

The successful implementation of algorithms on quantum processors relies on the accurate control of quantum bits (qubits) to perform logic gate operations. In this era of noisy intermediate-scale quantum (NISQ) computing, systematic…

We study the extent to which standard machine learning algorithms rely on exchangeability and independence of data by introducing a monotone adversarial corruption model. In this model, an adversary, upon looking at a "clean" i.i.d.…

机器学习 · 计算机科学 2026-01-06 Kasper Green Larsen , Chirag Pabbaraju , Abhishek Shetty

The $k$-nearest neighbor ($k$-NN) algorithm is one of the most popular methods for nonparametric classification. However, a relevant limitation concerns the definition of the number of neighbors $k$. This parameter exerts a direct impact on…

机器学习 · 计算机科学 2024-09-10 Alexandre Luís Magalhães Levada , Frank Nielsen , Michel Ferreira Cardia Haddad

A lack of software reproducibility has become increasingly apparent in the last several years, calling into question the validity of scientific findings affected by published tools. Reproducibility issues may have numerous sources of error,…

神经元与认知 · 定量生物学 2020-04-23 Gregory Kiar , Pablo de Oliveira Castro , Pierre Rioux , Eric Petit , Shawn T. Brown , Alan C. Evans , Tristan Glatard

We introduce a new model of stochastic bandits with adversarial corruptions which aims to capture settings where most of the input follows a stochastic pattern but some fraction of it can be adversarially changed to trick the algorithm,…

机器学习 · 计算机科学 2018-03-28 Thodoris Lykouris , Vahab Mirrokni , Renato Paes Leme

We study online reinforcement learning for finite-horizon deterministic control systems with {\it arbitrary} state and action spaces. Suppose that the transition dynamics and reward function is unknown, but the state and action space is…

机器学习 · 计算机科学 2019-05-07 Lin F. Yang , Chengzhuo Ni , Mengdi Wang

We provide an approach for the analysis of randomised exploration algorithms like Thompson sampling that does not rely on forced optimism or posterior inflation. With this, we demonstrate that in the $d$-dimensional linear bandit setting,…

机器学习 · 计算机科学 2025-02-14 Marc Abeille , David Janz , Ciara Pike-Burke

Reinforcement learning from human feedback (RLHF) replaces hard-to-specify rewards with pairwise trajectory preferences, yet regret-oriented theory often assumes that preference labels are generated consistently from a single ground-truth…

机器学习 · 计算机科学 2026-04-03 Ming Shi , Yingbin Liang , Ness B. Shroff , Ananthram Swami

In some studies \citep[e.g.,][]{zhang2016understanding} of deep learning, it is observed that over-parametrized deep neural networks achieve a small testing error even when the training error is almost zero. Despite numerous works towards…

机器学习 · 统计学 2022-02-25 Yue Xing , Qifan Song , Guang Cheng

Performance of adaptive control policies is assessed through the regret with respect to the optimal regulator, which reflects the increase in the operating cost due to uncertainty about the dynamics parameters. However, available results in…

系统与控制 · 计算机科学 2020-03-24 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

In performative prediction, the deployment of a predictive model triggers a shift in the data distribution. As these shifts are typically unknown ahead of time, the learner needs to deploy a model to get feedback about the distribution it…

机器学习 · 计算机科学 2022-07-19 Meena Jagadeesan , Tijana Zrnic , Celestine Mendler-Dünner

The Competing Bandits framework is a recently emerging area that integrates multi-armed bandits in online learning with stable matching in game theory. While conventional models assume that all players and arms are constantly available, in…

机器学习 · 计算机科学 2026-03-23 Shinnosuke Uba , Yutaro Yamaguchi

Noise is the defining feature of the NISQ era, but it remains unclear if noisy quantum devices are capable of quantum speedups. Quantum supremacy experiments have been a major step forward, but gaps remain between the theory behind these…

量子物理 · 物理学 2022-03-08 Adam Bouland , Bill Fefferman , Zeph Landau , Yunchao Liu

The $k$th-nearest neighbor rule is arguably the simplest and most intuitively appealing nonparametric classification procedure. However, application of this method is inhibited by lack of knowledge about its properties, in particular, about…

统计理论 · 数学 2008-10-30 Peter Hall , Byeong U. Park , Richard J. Samworth

We analyse the performance of well-known evolutionary algorithms (1+1)EA and (1+$\lambda$)EA in the prior noise model, where in each fitness evaluation the search point is altered before evaluation with probability $p$. We present refined…

神经与进化计算 · 计算机科学 2018-12-04 Dirk Sudholt

Double Machine Learning is often justified by nuisance-rate conditions, yet finite-sample reliability also depends on the conditioning of the orthogonal-score Jacobian. This conditioning is typically assumed rather than tracked. When…

统计方法学 · 统计学 2026-01-08 Gabriel Saco