English
Related papers

Related papers: Commutativity in the Algorithmic Lovasz Local Lemm…

200 papers

We study a version of the randomized Kaczmarz algorithm for solving systems of linear equations where the iterates are confined to the solution space of a selected subsystem. We show that the subspace constraint leads to an accelerated…

Numerical Analysis · Mathematics 2024-06-11 Jackie Lok , Elizaveta Rebrova

We study \emph{online episodic Constrained Markov Decision Processes} (CMDPs) under both stochastic and adversarial constraints. We provide a novel algorithm whose guarantees greatly improve those of the state-of-the-art best-of-both-worlds…

In this paper, we use various versions of Lov\'asz extension to systematically derive continuous formulations of problems from discrete mathematics. This will take place in the following context: (1) For combinatorial optimization problems…

Combinatorics · Mathematics 2023-05-16 Jürgen Jost , Dong Zhang

Composite minimization involves a collection of functions which are aggregated in a nonsmooth manner. It covers, as a particular case, smooth approximation of minimax games, minimization of max-type functions, and simple composite…

Optimization and Control · Mathematics 2025-03-04 Yassine Nabou , Ion Necoara

In this work, we study the Lov\'asz local lemma (LLL) problem in the area of distributed quantum computing, which has been the focus of attention of recent advances in quantum computing [STOC'24, STOC'25, STOC'25]. We prove a lower bound of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-20 Sebastian Brandt , Tim Göttlicher

Model selection in supervised learning provides costless guarantees as if the model that best balances bias and variance was known a priori. We study the feasibility of similar guarantees for cumulative regret minimization in the stochastic…

Machine Learning · Computer Science 2023-10-25 Sanath Kumar Krishnamurthy , Adrienne Margaret Propp , Susan Athey

This work provides several new insights on the robustness of Kearns' statistical query framework against challenging label-noise models. First, we build on a recent result by \cite{DBLP:journals/corr/abs-2006-04787} that showed noise…

Machine Learning · Statistics 2020-10-20 Ioannis Anagnostides , Themis Gouleakis , Ali Marashian

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

We study the Proximal Langevin Algorithm (PLA) for sampling from a probability distribution $\nu = e^{-f}$ on $\mathbb{R}^n$ under isoperimetry. We prove a convergence guarantee for PLA in Kullback-Leibler (KL) divergence when $\nu$…

Machine Learning · Statistics 2019-11-06 Andre Wibisono

We show that any randomised Monte Carlo distributed algorithm for the Lov\'asz local lemma requires $\Omega(\log \log n)$ communication rounds, assuming that it finds a correct assignment with high probability. Our result holds even in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-04 Sebastian Brandt , Orr Fischer , Juho Hirvonen , Barbara Keller , Tuomo Lempiäinen , Joel Rybicki , Jukka Suomela , Jara Uitto

We consider a field $f \circ T_1^{i_1} \circ \cdots \circ T_d^{i_d}$ where $T_1, \dots , T_d$ arecommuting transformations, one of them at least being ergodic. Considering the case of commuting filtrations, we are interested by giving…

Probability · Mathematics 2025-03-27 Christophe Cuny , Jérôme Dedecker , Florence Merlevède

An operational probabilistic theory where all systems are classical, and all pure states of composite systems are entangled, is constructed. The theory is endowed with a rule for composing an arbitrary number of systems, and with a…

Quantum Physics · Physics 2022-01-24 Giacomo Mauro D'Ariano , Marco Erba , Paolo Perinotti

We propose a generalized debiased Lasso estimator based on a stability principle. When a single column of the design matrix is perturbed, the estimator admits a simple update formula that can be computed from the original solution. Under…

Statistics Theory · Mathematics 2026-04-14 Jingbo Liu

We propose a novel linesearch variant of the trust region normal map-based semismooth Newton method developed in [Ouyang and Milzarek, Math. Program. 212(1-2), 389--435 (2025)] for solving a class of nonsmooth, nonconvex composite-type…

Optimization and Control · Mathematics 2026-02-16 Hanfeng Zeng , Wenqing Ouyang , Andre Milzarek

We address the problem of incremental sequence classification, where predictions are updated as new elements in the sequence are revealed. Drawing on temporal-difference learning from reinforcement learning, we identify a…

This paper introduces a new regularized version of the robust $\tau$-regression estimator for analyzing high-dimensional datasets subject to gross contamination in the response variables and covariates. The resulting estimator, termed…

Machine Learning · Statistics 2025-04-30 Emadaldin Mozafari-Majd , Visa Koivunen

For general repeated measures designs the Wald-type statistic (WTS) is an asymptotically valid procedure allowing for unequal covariance matrices and possibly non-normal multivariate observations. The drawback of this procedure is the poor…

Methodology · Statistics 2016-06-24 Sarah Friedrich , Edgar Brunner , Markus Pauly

We propose a method to improve the efficiency and accuracy of amortized Bayesian inference by leveraging universal symmetries in the joint probabilistic model of parameters and data. In a nutshell, we invert Bayes' theorem and estimate the…

Machine Learning · Computer Science 2024-07-24 Marvin Schmitt , Desi R. Ivanova , Daniel Habermann , Ullrich Köthe , Paul-Christian Bürkner , Stefan T. Radev

We introduce a tunable loss function called $\alpha$-loss, parameterized by $\alpha \in (0,\infty]$, which interpolates between the exponential loss ($\alpha = 1/2$), the log-loss ($\alpha = 1$), and the 0-1 loss ($\alpha = \infty$), for…

Machine Learning · Computer Science 2022-12-22 Tyler Sypherd , Mario Diaz , John Kevin Cava , Gautam Dasarathy , Peter Kairouz , Lalitha Sankar

In many applications one wants to identify identical subtrees of a program syntax tree. This identification should ideally be robust to alpha-renaming of the program, but no existing technique has been shown to achieve this with good…

Programming Languages · Computer Science 2021-05-07 Krzysztof Maziarz , Tom Ellis , Alan Lawrence , Andrew Fitzgibbon , Simon Peyton Jones