中文
相关论文

相关论文: A fast algorithm with minimax optimal guarantees f…

200 篇论文

An emerging line of work has shown that machine-learned predictions are useful to warm-start algorithms for discrete optimization problems, such as bipartite matching. Previous studies have shown time complexity bounds proportional to some…

机器学习 · 计算机科学 2023-02-03 Shinsaku Sakaue , Taihei Oki

Thompson sampling is one of the most widely used algorithms for many online decision problems, due to its simplicity in implementation and superior empirical performance over other state-of-the-art methods. Despite its popularity and…

机器学习 · 计算机科学 2020-10-02 Tianyuan Jin , Pan Xu , Jieming Shi , Xiaokui Xiao , Quanquan Gu

We present a new method in problems where estimates are needed for finite population domains with small or even zero sample sizes. In contrast to known estimation methods, an auxiliary information is used to model sizes of population units…

统计理论 · 数学 2014-06-23 Andrius Čiginas , Tomas Rudys

We propose a new fast algorithm to estimate any sparse generalized linear model with convex or non-convex separable penalties. Our algorithm is able to solve problems with millions of samples and features in seconds, by relying on…

In this paper, we explore provable acceleration of diffusion models without any additional retraining. Focusing on the task of approximating a target data distribution in $\mathbb{R}^d$ to within $\varepsilon$ total-variation distance, we…

机器学习 · 计算机科学 2025-08-14 Gen Li , Yuchen Zhou , Yuting Wei , Yuxin Chen

Optimization problems under affine constraints appear in various areas of machine learning. We consider the task of minimizing a smooth strongly convex function F(x) under the affine constraint Kx=b, with an oracle providing evaluations of…

最优化与控制 · 数学 2022-04-12 Adil Salim , Laurent Condat , Dmitry Kovalev , Peter Richtárik

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

机器学习 · 统计学 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

This paper describes a data-driven framework for approximate global optimization in which precomputed solutions to a sample of problems are retrieved and adapted during online use to solve novel problems. This approach has promise for…

机器人学 · 计算机科学 2016-05-17 Kris Hauser

An important aspect of text mining involves information retrieval in form of discovery of semantic themes (topics) from documents using topic modelling. While generative topic models like Latent Dirichlet Allocation (LDA) or Latent Semantic…

机器学习 · 计算机科学 2025-11-04 Satyajeet Sahoo , Jhareswar Maiti

We seek to extract a small number of representative scenarios from large panel data that are consistent with sample moments. Among two novel algorithms, the first identifies scenarios that have not been observed before, and comes with a…

机器学习 · 统计学 2024-11-06 Michael Multerer , Paul Schneider , Rohan Sen

This work proposes an efficient parallel algorithm for non-monotone submodular maximization under a knapsack constraint problem over the ground set of size $n$. Our algorithm improves the best approximation factor of the existing parallel…

人工智能 · 计算机科学 2024-09-09 Tan D. Tran , Canh V. Pham , Dung T. K. Ha , Phuong N. H. Pham

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted…

机器学习 · 统计学 2025-11-20 Gábor Balázs

It is well known that there have been many numerical algorithms for solving nonsmooth minimax problems, numerical algorithms for nonsmooth minimax problems with joint linear constraints are very rare. This paper aims to discuss optimality…

最优化与控制 · 数学 2022-04-21 Yu-Hong Dai , Jiani Wang , Liwei Zhang

We propose a novel algorithm for solving non-convex, nonlinear equality-constrained finite-sum optimization problems. The proposed algorithm incorporates an additional sampling strategy for sample size update into the well-known framework…

最优化与控制 · 数学 2025-08-05 Nataša Krejić , Nataša Krklec Jerinkić , Tijana Ostojić , Nemanja Vučićević

We develop a novel procedure for estimating the optimizer of general convex stochastic optimization problems of the form $\min_{x\in\mathcal{X}} \mathbb{E}[F(x,\xi)]$, when the given data is a finite independent sample selected according to…

统计理论 · 数学 2022-01-26 Daniel Bartl , Shahar Mendelson

This paper is concerned with the sample efficiency of reinforcement learning, assuming access to a generative model (or simulator). We first consider $\gamma$-discounted infinite-horizon Markov decision processes (MDPs) with state space…

机器学习 · 计算机科学 2025-03-18 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

In this paper, we consider asymptotics of the optimal value and the optimal solutions of parametric minimax estimation problems. Specifically, we consider estimators of the optimal value and the optimal solutions in a sample minimax problem…

统计理论 · 数学 2025-04-16 Mika Meitz , Alexander Shapiro

In this paper, we study a new notion of scaled minimaxity for sparse estimation in high-dimensional linear regression model. We present more optimistic lower bounds than the one given by the classical minimax theory and hence improve on…

统计理论 · 数学 2018-10-15 Mohamed Ndaoud

The question of how to determine the number of independent latent factors (topics) in mixture models such as Latent Dirichlet Allocation (LDA) is of great practical importance. In most applications, the exact number of topics is unknown,…

机器学习 · 统计学 2014-01-23 E. D. Gutiérrez

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

机器学习 · 统计学 2018-10-30 Dimitris Bertsimas , Christopher McCord