English
Related papers

Related papers: The Power of Second Order Methods for Sequence Pre…

200 papers

Real-world data contains a vast amount of multimodal information, among which vision and language are the two most representative modalities. Moreover, increasingly heavier models, \textit{e}.\textit{g}., Transformers, have attracted the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Dachuan Shi , Chaofan Tao , Ying Jin , Zhendong Yang , Chun Yuan , Jiaqi Wang

In real-world scenarios, speech signals are inevitably corrupted by various types of interference, making speech enhancement (SE) a critical task for robust speech processing. However, most existing SE methods only handle a limited range of…

Sound · Computer Science 2025-12-12 Fei Liu , Yang Ai , Ye-Xin Lu , Rui-Chen Zheng , Hui-Peng Du , Zhen-Hua Ling

Obvious strategyproofness (OSP) is an appealing concept as it allows to maintain incentive compatibility even in the presence of agents that are not fully rational, e.g., those who struggle with contingent reasoning [Li, 2015]. However, it…

Computer Science and Game Theory · Computer Science 2017-02-21 Diodato Ferraioli , Carmine Ventre

This article presents the use of Answer Set Programming (ASP) to mine sequential patterns. ASP is a high-level declarative logic programming paradigm for high level encoding combinatorial and optimization problem solving as well as…

Artificial Intelligence · Computer Science 2017-11-15 Thomas Guyet , Yves Moinard , René Quiniou , Torsten Schaub

In this paper, we propose an adaptive high-order method for hyperbolic systems of conservation laws. The proposed method is based on a dual formulation approach: Two numerical solutions, corresponding to conservative and nonconservative…

Numerical Analysis · Mathematics 2026-01-29 Alina Chertock , Qingcheng Fu , Alexander Kurganov , Lorenzo Micalizzi

Bayesian inference provides a uniquely rigorous approach to obtain principled justification for uncertainty in predictions, yet it is difficult to articulate suitably general prior belief in the machine learning context, where computational…

Machine Learning · Statistics 2021-03-04 Jed A. Duersch , Thomas A. Catanach

In this work, we consider the development of implicit explicit total variation diminishing (TVD) methods (also termed SSP: strong stability preserving) for the compressible isentropic Euler system in the low Mach number regime. The scheme…

Numerical Analysis · Mathematics 2018-08-01 Giacomo Dimarco , Raphaël Loubère , Victor Michel-Dansac , Marie-Hélène Vignal

Unlike common faults, three-phase short-circuit faults in power systems pose significant challenges. These faults can lead to out-of-step (OOS) conditions and jeopardize the system's dynamic security. The rapid dynamics of these faults…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Amin Masoumi , Mert Korkali

This paper proposes a neural stochastic optimization method for efficiently solving the two-stage stochastic unit commitment (2S-SUC) problem under high-dimensional uncertainty scenarios. The proposed method approximates the second-stage…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Zhentong Shao , Jingtao Qin , Nanpeng Yu

The paper considers the problem of global optimization in the setup of stochastic process bandits. We introduce an UCB algorithm which builds a cascade of discretization trees based on generic chaining in order to render possible his…

Machine Learning · Statistics 2016-02-22 Emile Contal , Nicolas Vayatis

Much more attention has been paid to unsupervised feature selection nowadays due to the emergence of massive unlabeled data. The distribution of samples and the latent effect of training a learning method using samples in more effective…

Machine Learning · Computer Science 2021-12-15 Weiyi Li , Hongmei Chen , Tianrui Li , Jihong Wan , Binbin Sang

We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete…

Numerical Analysis · Mathematics 2020-01-27 Peter Richtárik , Martin Takáč

We develop a general theory to optimize the frequentist regret for sequential learning problems, where efficient bandit and reinforcement learning algorithms can be derived from unified Bayesian principles. We propose a novel optimization…

Machine Learning · Computer Science 2024-02-12 Yunbei Xu , Assaf Zeevi

Stochastic variance reduction has proven effective at accelerating first-order algorithms for solving convex finite-sum optimization tasks such as empirical risk minimization. Incorporating second-order information has proven helpful in…

Optimization and Control · Mathematics 2025-04-30 Michał Dereziński

A general, variational approach to derive low-order reduced systems for nonlinear systems subject to an autonomous forcing, is introduced. The approach is based on the concept of optimal parameterizing manifold (PM) that substitutes the…

Dynamical Systems · Mathematics 2020-01-08 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

The problem of variable-rate lossless data compression is considered, for codes with and without prefix constraints. Sharp bounds are derived for the best achievable compression rate of memoryless sources, when the excess-rate probability…

Information Theory · Computer Science 2025-11-13 Andreas Theocharous , Lampros Gavalakis , Ioannis Kontoyiannis

We use the lens of weak signal asymptotics to study a class of sequentially randomized experiments, including those that arise in solving multi-armed bandit problems. In an experiment with $n$ time steps, we let the mean reward gaps between…

Statistics Theory · Mathematics 2023-06-26 Xu Kuang , Stefan Wager

Sequential decisions in volatile, high-stakes settings require more than maximizing expected return; they require principled uncertainty management. This paper presents the Uncertainty-Aware Markov Decision Process (UAMDP), a unified…

Machine Learning · Computer Science 2025-12-19 Michal Koren , Or Peretz , Tai Dinh , Philip S. Yu

Unique Sink Orientations (USOs) are an appealing abstraction of several major optimization problems of applied mathematics such as for instance Linear Programming (LP), Markov Decision Processes (MDPs) or 2-player Turn Based Stochastic…

Discrete Mathematics · Computer Science 2015-01-12 Romain Hollanders , Balázs Gerencsér , Jean-Charles Delvenne , Raphaël M. Jungers

We define "decision swap regret" which generalizes both prediction for downstream swap regret and omniprediction, and give algorithms for obtaining it for arbitrary multi-dimensional Lipschitz loss functions in online adversarial settings.…

Machine Learning · Computer Science 2025-02-19 Jiuyao Lu , Aaron Roth , Mirah Shi