English
Related papers

Related papers: Theoretical and Practical Advances on Smoothing fo…

200 papers

We propose a new methodology to design first-order methods for unconstrained strongly convex problems. Specifically, instead of tackling the original objective directly, we construct a shifted objective function that has the same minimizer…

Machine Learning · Computer Science 2020-10-22 Kaiwen Zhou , Anthony Man-Cho So , James Cheng

The expectation-maximization (EM) algorithm is a well-known iterative method for computing maximum likelihood estimates from incomplete data. Despite its numerous advantages, a main drawback of the EM algorithm is its frequently observed…

Computation · Statistics 2018-08-14 Nicholas C. Henderson , Ravi Varadhan

First-order methods for minimization and saddle point (min-max) problems are widely used for solving large-scale problems, in particular arising in machine learning. The majority of works obtain favorable complexity guarantees of such…

Last-iterate convergence has received extensive study in two player zero-sum games starting from bilinear, convex-concave up to settings that satisfy the MVI condition. Typical methods that exhibit last-iterate convergence for the…

Computer Science and Game Theory · Computer Science 2023-10-05 Yi Feng , Hu Fu , Qun Hu , Ping Li , Ioannis Panageas , Bo Peng , Xiao Wang

Behavior of the entropy numbers of classes of multivariate functions with mixed smoothness is studied here. This problem has a long history and some fundamental problems in the area are still open. The main goal of this paper is to develop…

Numerical Analysis · Mathematics 2016-03-01 V. Temlyakov

Computational equilibrium finding in large zero-sum extensive-form imperfect-information games has led to significant recent AI breakthroughs. The fastest algorithms for the problem are new forms of counterfactual regret minimization [Brown…

Computer Science and Game Theory · Computer Science 2020-07-01 Brian Hu Zhang , Tuomas Sandholm

We present an accelerated greedy strategy for training of projection-based reduced-order models for parametric steady and unsteady partial differential equations. Our approach exploits hierarchical approximate proper orthogonal…

Numerical Analysis · Mathematics 2024-01-17 Eki Agouzal , Tommaso Taddei

We study the regret of reinforcement learning from offline data generated by a fixed behavior policy in an infinite-horizon discounted Markov decision process (MDP). While existing analyses of common approaches, such as fitted $Q$-iteration…

Machine Learning · Computer Science 2023-07-13 Yichun Hu , Nathan Kallus , Masatoshi Uehara

For the composite multi-objective optimization problem composed of two nonsmooth terms, a smoothing method is used to overcome the nonsmoothness of the objective function, making the objective function contain at most one nonsmooth term.…

Optimization and Control · Mathematics 2025-03-18 Huang Chengzhi

Recent advancements in algorithms for sequential decision-making under imperfect information have shown remarkable success in large games such as limit- and no-limit poker. These algorithms traditionally formalize the games using the…

Computer Science and Game Theory · Computer Science 2023-12-07 Vojtěch Kovařík , David Milec , Michal Šustr , Dominik Seitz , Viliam Lisý

Diffusion policies are expressive yet incur high inference latency. Flow Matching (FM) enables one-step generation, but integrating it into Maximum Entropy Reinforcement Learning (MaxEnt RL) is challenging: the optimal policy is an…

Machine Learning · Computer Science 2026-02-03 Zeqiao Li , Yijing Wang , Haoyu Wang , Zheng Li , Zhiqiang Zuo

We provide a formal definition of depth-limited games together with an accessible and rigorous explanation of the underlying concepts, both of which were previously missing in imperfect-information games. The definition works for an…

Artificial Intelligence · Computer Science 2022-03-25 Vojtěch Kovařík , Dominik Seitz , Viliam Lisý , Jan Rudolf , Shuo Sun , Karel Ha

We study the problem of learning high dimensional regression models regularized by a structured-sparsity-inducing penalty that encodes prior structural information on either input or output sides. We consider two widely adopted types of…

Machine Learning · Computer Science 2012-02-20 Xi Chen , Qihang Lin , Seyoung Kim , Jaime G. Carbonell , Eric P. Xing

Under the uncoupled learning setup, the last-iterate convergence guarantee towards Nash equilibrium is shown to be impossible in many games. This work studies the last-iterate convergence guarantee in general games toward rationalizability,…

Computer Science and Game Theory · Computer Science 2023-12-27 Jibang Wu , Haifeng Xu , Fan Yao

We consider in this paper a class of single-ratio fractional minimization problems, in which the numerator part of the objective is the sum of a nonsmooth nonconvex function and a smooth nonconvex function while the denominator part is a…

Optimization and Control · Mathematics 2020-12-23 Na Zhang , Qia Li

This paper extends the high-order entropy stable (ES) adaptive moving mesh finite difference schemes developed in [14] to the two- and three-dimensional (multi-component) compressible Euler equations with the stiffened equation of state.…

Numerical Analysis · Mathematics 2022-08-10 Shangting Li , Junming Duan , Huazhong Tang

We study the question of obtaining last-iterate convergence rates for no-regret learning algorithms in multi-player games. We show that the optimistic gradient (OG) algorithm with a constant step-size, which is no-regret, achieves a…

Machine Learning · Computer Science 2020-10-27 Noah Golowich , Sarath Pattathil , Constantinos Daskalakis

We revisit the problem of solving two-player zero-sum games in the decentralized setting. We propose a simple algorithmic framework that simultaneously achieves the best rates for honest regret as well as adversarial regret, and in addition…

Computer Science and Game Theory · Computer Science 2018-06-07 Ehsan Asadi Kangarshahi , Ya-Ping Hsieh , Mehmet Fatih Sahin , Volkan Cevher

Direct reciprocity is a well-known mechanism that could explain how cooperation emerges and prevails in an evolving population. Numerous prior researches have studied the emergence of cooperation in multiplayer games. However, most of them…

Populations and Evolution · Quantitative Biology 2021-08-25 Fang Chen , Te Wu , Guocheng Wang , Long Wang

We analyse and improve the volume-penalty method, a simple and versatile way to model objects in fluid flows. The volume-penalty method is a kind of fictitious-domain method that approximates no-slip boundary conditions with rapid linear…

Numerical Analysis · Mathematics 2020-12-09 Eric W. Hester , Geoffrey M. Vasil , Keaton J. Burns