English
Related papers

Related papers: Reheated Gradient-based Discrete Sampling for Comb…

200 papers

Importance sampling has become an indispensable strategy to speed up optimization algorithms for large-scale applications. Improved adaptive variants - using importance values defined by the complete gradient information which changes…

Machine Learning · Computer Science 2017-11-08 Sebastian U. Stich , Anant Raj , Martin Jaggi

While generative models have proved successful in many domains, they may pose a privacy leakage risk in practical deployment. To address this issue, differentially private generative model learning has emerged as a solution to train private…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Bochao Liu , Pengju Wang , Weijia Guo , Yong Li , Liansheng Zhuang , Weiping Wang , Shiming Ge

In atomic, molecular, and nuclear physics, the method of complex coordinate rotation is a widely used theoretical tool for studying resonant states. Here, we propose a novel implementation of this method based on the gradient optimization…

Atomic Physics · Physics 2020-07-24 Zhi-Da Bai , Zhen-Xiang Zhong , Zong-Chao Yan , Ting-Yun Shi

Stochastic coordinate descent algorithms are efficient methods in which each iterate is obtained by fixing most coordinates at their values from the current iteration, and approximately minimizing the objective with respect to the remaining…

Machine Learning · Statistics 2025-04-02 Eméric Gbaguidi

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

Gradient methods are experiencing a growth in methodological and theoretical developments owing to the challenges posed by optimization problems arising in data science. However, such gradient methods face diverging optimality gaps or…

Optimization and Control · Mathematics 2024-04-17 Christian Varner , Vivak Patel

In this work, we design and analyze a novel, provably conditionally stable, weakly coupled partitioned scheme to solve the conjugate heat transfer (CHT) problem. We consider a model CHT problem consisting of linear advection-diffusion and…

Numerical Analysis · Mathematics 2026-02-23 Sarah Nataj , David C. Del Rey Fernández , David Brown , Rajeev Jaiman

We consider chance-constrained problems with discrete random distribution. We aim for problems with a large number of scenarios. We propose a novel method based on the stochastic gradient descent method which performs updates of the…

Optimization and Control · Mathematics 2019-05-28 Lukáš Adam , Martin Branda

This paper studies a class of distributed optimization problems with coupled equality constraints in networked systems. Many existing distributed algorithms rely on solving local subproblems via the $\operatorname{argmin}$ operator in each…

Optimization and Control · Mathematics 2025-11-26 Chenyang Qiu , Zongli Lin

In this paper we consider bound-constrained mixed-integer optimization problems where the objective function is differentiable w.r.t.\ the continuous variables for every configuration of the integer variables. We mainly suggest to exploit…

Optimization and Control · Mathematics 2026-01-19 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Pierluigi Mansueto

Self-Supervised Learning (SSL) for Combinatorial Optimization (CO) is an emerging paradigm for solving combinatorial problems using neural networks. In this paper, we address a central challenge of SSL for CO: solving problems with discrete…

Machine Learning · Computer Science 2026-01-16 Nikolaos Karalias , Akbar Rafiey , Yifei Xu , Zhishang Luo , Behrooz Tahmasebi , Connie Jiang , Stefanie Jegelka

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

Methodology · Statistics 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou

A wide variety of optimization techniques, both exact and heuristic, tend to be biased samplers. This means that when attempting to find multiple uncorrelated solutions of a degenerate Boolean optimization problem a subset of the solution…

Disordered Systems and Neural Networks · Physics 2019-05-14 Andrew J. Ochoa , Darryl C. Jacob , Salvatore Mandrà , Helmut G. Katzgraber

There are many approaches for training decision trees. This work introduces a novel gradient-based method for constructing decision trees that optimize arbitrary differentiable loss functions, overcoming the limitations of heuristic…

Machine Learning · Computer Science 2025-03-25 Andrei V. Konstantinov , Lev V. Utkin

Combinatorial optimization problems (COPs) are an important research topic in various fields. In recent times, there have been many attempts to solve COPs using deep learning-based approaches. We propose a novel neural network model that…

Computational Geometry · Computer Science 2023-04-17 Jaeseung Lee , Woojin Choi , Jibum Kim

We propose a gradient descent method for solving optimization problems arising in settings of tropical geometry - a variant of algebraic geometry that has attracted growing interest in applications such as computational biology, economics,…

Optimization and Control · Mathematics 2025-11-17 Roan Talbut , Anthea Monod

Discrete gradient methods are geometric integration techniques that can preserve the dissipative structure of gradient flows. Due to the monotonic decay of the function values, they are well suited for general convex and nonconvex…

Optimization and Control · Mathematics 2024-07-17 Matthias J. Ehrhardt , Erlend S. Riis , Torbjørn Ringholm , Carola-Bibiane Schönlieb

Long simulation times in climate sciences typically require coarse grids due to computational constraints. Nonetheless, unresolved subscale information significantly influences the prognostic variables and can not be neglected for reliable…

Numerical Analysis · Mathematics 2018-02-22 Konrad Simon , Jörn Behrens

Recently proposed gradient estimators enable gradient descent over stochastic programs with discrete jumps in the response surface, which are not covered by automatic differentiation (AD) alone. Although these estimators' capability to…

Machine Learning · Computer Science 2024-04-09 Philipp Andelfinger , Justin N. Kreikemeyer

In this paper, we consider gradient methods for minimizing smooth convex functions, which employ the information obtained at the previous iterations in order to accelerate the convergence towards the optimal solution. This information is…

Optimization and Control · Mathematics 2021-06-02 Yurii Nesterov , Mihai I. Florea