English
Related papers

Related papers: Scheduled Relaxation Jacobi method: improvements a…

200 papers

Differential equations are pivotal in modeling and understanding the dynamics of various systems, offering insights into their future states through parameter estimation fitted to time series data. In fields such as economy, politics, and…

Machine Learning · Statistics 2024-04-24 Hyeontae Jo , Sung Woong Cho , Hyung Ju Hwang

Semidefinite programming (SDP) is widely acknowledged as one of the most effective methods for deriving the tightest lower bounds of the optimal power flow (OPF) problems. In this paper, an enhanced semidefinite relaxation model that…

Systems and Control · Electrical Eng. & Systems 2024-10-01 Zhaojun Ruan , Libao Shi

We introduce fast randomized algorithms for solving semidefinite programming (SDP) relaxations of the partial permutation synchronization (PPS) problem, a core task in multi-image matching with significant relevance to 3D reconstruction.…

Optimization and Control · Mathematics 2025-06-26 Michael Lindsey , Yunpeng Shi

In this work, we conduct a systematic study of stochastic saddle point problems (SSP) and stochastic variational inequalities (SVI) under the constraint of $(\epsilon,\delta)$-differential privacy (DP) in both Euclidean and non-Euclidean…

Machine Learning · Computer Science 2024-11-11 Raef Bassily , Cristóbal Guzmán , Michael Menart

Parameter-specific adaptive learning rate methods are computationally efficient ways to reduce the ill-conditioning problems encountered when training large deep networks. Following recent work that strongly suggests that most of the…

Machine Learning · Computer Science 2015-09-01 Yann N. Dauphin , Harm de Vries , Yoshua Bengio

We propose Score-based Relaxation-guided Generation (SRG), a generative framework based on an approximate formulation of relaxation-guided stochastic differential equations (SDEs) for mixed-integer linear programming. SRG employs a…

Machine Learning · Computer Science 2026-05-13 Ruobing Wang , Xin Li , Yujie Fang , Mingzhong Wang

Given polynomials f(x), g_i(x), h_j(x), we study how to minimize f on the semialgebraic set S = { x \in R^n: h_1(x)=...=h_{m_1}(x) =0, g_1(x) >= 0, ..., g_{m_2}(x) >= 0}. Let f_{min} be the minimum of f on S. Suppose S is nonsingular and…

Optimization and Control · Mathematics 2010-06-15 Jiawang Nie

In [1] is proposed a simplified DeC method, that, when combined with the residual distribution (RD) framework, allows to construct a high order, explicit FE scheme with continuous approximation avoiding the inversion of the mass matrix for…

Numerical Analysis · Mathematics 2022-11-17 Rémi Abgrall , Elise Le Mélédo , Philipp Öffner , Davide Torlo

This paper analyzes the SParareal algorithm for stochastic differential equations (SDEs). Compared to the classical Parareal algorithm, the SParareal algorithm accelerates convergence by introducing stochastic perturbations, achieving…

Numerical Analysis · Mathematics 2025-02-19 Huanxin Wang , Junhan Lyu , Zicheng Peng , Min Li

This work proposes and analyzes a generalized acceleration technique for decreasing the computational complexity of using stochastic collocation (SC) methods to solve partial differential equations (PDEs) with random input data. The SC…

Numerical Analysis · Mathematics 2015-05-05 Diego Galindo , Peter Jantsch , Clayton G. Webster , Guannan Zhang

Multistage stochastic programming deals with operational and planning problems that involve a sequence of decisions over time while responding to realizations that are uncertain. Algorithms designed to address multistage stochastic linear…

Optimization and Control · Mathematics 2020-10-26 Harsha Gangammanavar , Suvrajeet Sen

This paper develops new semidefinite programming (SDP) relaxation techniques for two classes of mixed binary quadratically constrained quadratic programs (MBQCQP) and analyzes their approximation performance. The first class of problem…

Optimization and Control · Mathematics 2014-03-18 Zi Xu , Mingyi Hong

This paper studies a low-communication algorithm for solving elliptic partial differential equations (PDE's) on high-performance machines, the nested iteration with range decomposition algorithm (NIRD). Previous work has shown that NIRD…

Numerical Analysis · Mathematics 2019-06-26 Wayne Mitchell , Tom Manteuffel

Statistical inference problems arising within signal processing, data mining, and machine learning naturally give rise to hard combinatorial optimization problems. These problems become intractable when the dimensionality of the data is…

Statistical Mechanics · Physics 2017-04-27 Adel Javanmard , Andrea Montanari , Federico Ricci-Tersenghi

A hierarchy of semidefinite programming (SDP) relaxations approximates the global optimum of polynomial optimization problems of noncommuting variables. Generating the relaxation, however, is a computationally demanding task, and only…

Mathematical Software · Computer Science 2015-06-15 Peter Wittek

In a recent work, we presented the reduced Jacobian method (RJM) as an extension of Wolfe's reduced gradient method to multicriteria (multiobjective) optimization problems dealing with linear constraints. This approach reveals that using a…

Optimization and Control · Mathematics 2025-10-17 M. El Maghri , Y. Elboulqe

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

Machine Learning · Computer Science 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

We propose and analyse a fully adaptive strategy for solving elliptic PDEs with random data in this work. A hierarchical sequence of adaptive mesh refinements for the spatial approximation is combined with adaptive anisotropic sparse…

Numerical Analysis · Mathematics 2020-08-26 Jens Lang , Robert Scheichl , David Silvester

Hamilton-Jacobi (HJ) partial differential equations (PDEs) have diverse applications spanning physics, optimal control, game theory, and imaging sciences. This research introduces a first-order optimization-based technique for HJ PDEs,…

Numerical Analysis · Mathematics 2023-10-04 Tingwei Meng , Wenbo Hao , Siting Liu , Stanley J. Osher , Wuchen Li

We develop a new least squares method for solving the second-order elliptic equations in non-divergence form. Two least-squares-type functionals are proposed for solving the equations in two steps. We first obtain a numerical approximation…

Numerical Analysis · Mathematics 2020-04-02 Ruo Li , Fanyi Yang