中文
相关论文

相关论文: Smooth Partial Lotteries for Stable Randomized Sel…

200 篇论文

Recent work in imitation learning has shown that having an expert controller that is both suitably smooth and stable enables stronger guarantees on the performance of the learned controller. However, constructing such smoothed expert…

系统与控制 · 电气工程与系统科学 2024-09-04 Daniel Pfrommer , Swati Padmanabhan , Kwangjun Ahn , Jack Umenberger , Tobia Marcucci , Zakaria Mhammedi , Ali Jadbabaie

In many applications of online decision making, the environment is non-stationary and it is therefore crucial to use bandit algorithms that handle changes. Most existing approaches are designed to protect against non-smooth changes,…

机器学习 · 计算机科学 2024-11-19 Su Jia , Qian Xie , Nathan Kallus , Peter I. Frazier

Lotteries are a prevalent form of gambling between a seller and buyers. Designing a lottery requires a model of how buyers make decisions when confronted with uncertain outcomes. Cumulative prospect theory (CPT) is a descriptive model that…

计算机科学与博弈论 · 计算机科学 2026-05-20 Shunta Akiyama , Mitsuaki Obara , Yasushi Kawase

In binary classification and regression problems, it is well understood that Lipschitz continuity and smoothness of the loss function play key roles in governing generalization error bounds for empirical risk minimization algorithms. In…

机器学习 · 计算机科学 2016-09-14 Ambuj Tewari , Sougata Chaudhuri

Stochastic gradient algorithms are often unstable when applied to functions that do not have Lipschitz-continuous and/or bounded gradients. Gradient clipping is a simple and effective technique to stabilize the training process for problems…

最优化与控制 · 数学 2021-06-11 Vien V. Mai , Mikael Johansson

Shuffling-type gradient methods are favored in practice for their simplicity and rapid empirical performance. Despite extensive development of convergence guarantees under various assumptions in recent years, most require the Lipschitz…

机器学习 · 计算机科学 2025-07-15 Qi He , Peiran Yu , Ziyi Chen , Heng Huang

This paper studies the one-shot behavior of no-regret algorithms for stochastic bandits. Although many algorithms are known to be asymptotically optimal with respect to the expected regret, over a single run, their pseudo-regret seems to…

机器学习 · 计算机科学 2023-12-01 Victor Boone

The takeoff point for this paper is the voluminous body of literature addressing recursive betting games with expected logarithmic growth of wealth being the performance criterion. Whereas almost all existing papers involve use of linear…

最优化与控制 · 数学 2024-01-17 Anton V. Proskurnikov , B. Ross Barmish

Due to the drastic gap in complexity between sequential and batch statistical learning, recent work has studied a smoothed sequential learning setting, where Nature is constrained to select contexts with density bounded by 1/{\sigma} with…

机器学习 · 统计学 2022-05-27 Adam Block , Max Simchowitz

We consider an issue of much current concern: could fairness, an issue that is already difficult to guarantee, worsen when algorithms run much of our lives? We consider this in the context of resource-allocation problems, we show that…

数据结构与算法 · 计算机科学 2017-09-26 David G. Harris , Thomas Pensyl , Aravind Srinivasan , Khoa Trinh

The design of sparse neural networks, i.e., of networks with a reduced number of parameters, has been attracting increasing research attention in the last few years. The use of sparse models may significantly reduce the computational and…

机器学习 · 计算机科学 2025-01-22 Giulia Fracastoro , Sophie M. Fosson , Andrea Migliorati , Giuseppe C. Calafiore

In this paper we consider the unconstrained minimization problem of a smooth function in ${\mathbb{R}}^n$ in a setting where only function evaluations are possible. We design a novel randomized derivative-free algorithm --- the stochastic…

最优化与控制 · 数学 2019-05-08 El Houcine Bergou , Eduard Gorbunov , Peter Richtárik

Randomized smoothing is the current state-of-the-art defense with provable robustness against $\ell_2$ adversarial attacks. Many works have devised new randomized smoothing schemes for other metrics, such as $\ell_1$ or $\ell_\infty$;…

机器学习 · 计算机科学 2020-07-27 Greg Yang , Tony Duan , J. Edward Hu , Hadi Salman , Ilya Razenshteyn , Jerry Li

Stability selection is a widely adopted resampling-based framework for high-dimensional variable selection. This paper seeks to broaden the use of an established stability estimator to evaluate the overall stability of the stability…

统计方法学 · 统计学 2025-06-04 Mahdi Nouraie , Samuel Muller

Motivated by applications where impatience is pervasive and evaluation times are uncertain, we study a selection model where options may expire at an unknown point in time and evaluation times are stochastic. Initially, the decision-maker…

最优化与控制 · 数学 2026-02-05 Yihua Xu , Rohan Ghuge , Sebastian Perez-Salazar

Many decision-making processes involve evaluating and then selecting items; examples include scientific peer review, job hiring, school admissions, and investment decisions. The eventual selection is performed by applying rules or…

计算机科学与博弈论 · 计算机科学 2025-10-23 Alexander Goldberg , Giulia Fanti , Nihar B. Shah

Sparse models require less memory for storage and enable a faster inference by reducing the necessary number of FLOPs. This is relevant both for time-critical and on-device computations using neural networks. The stabilized lottery ticket…

机器学习 · 计算机科学 2020-07-06 Christopher Brix , Parnia Bahar , Hermann Ney

Randomly initialized dense networks contain subnetworks that achieve high accuracy without weight learning--strong lottery tickets (SLTs). Recently, Gadhikar et al. (2023) demonstrated that SLTs could also be found within a randomly pruned…

Randomized smoothing is the current state-of-the-art method for producing provably robust classifiers. While randomized smoothing typically yields robust $\ell_2$-ball certificates, recent research has generalized provable robustness to…

机器学习 · 计算机科学 2023-09-26 Samuel Pfrommer , Brendon G. Anderson , Somayeh Sojoudi

We generalize the notion of average Lipschitz smoothness proposed by Ashlagi et al. (COLT 2021) by extending it to H\"older smoothness. This measure of the "effective smoothness" of a function is sensitive to the underlying distribution and…

机器学习 · 计算机科学 2023-10-31 Steve Hanneke , Aryeh Kontorovich , Guy Kornowski