English
Related papers

Related papers: A randomized operator splitting scheme inspired by…

200 papers

In this paper we consider distributed optimization problems in which the cost function is separable, i.e., a sum of possibly non-smooth functions all sharing a common variable, and can be split into a strongly convex term and a convex one.…

Systems and Control · Computer Science 2016-06-27 Ivano Notarnicola , Giuseppe Notarstefano

We consider a random interval splitting process, in which the splitting rule depends on the empirical distribution of interval lengths. We show that this empirical distribution converges to a limit almost surely as the number of intervals…

Probability · Mathematics 2018-06-20 Pascal Maillard , Elliot Paquette

In this paper, we study temporal splitting algorithms for multiscale problems. The exact fine-grid spatial problems typically require some reduction in degrees of freedom. Multiscale algorithms are designed to represent the fine-scale…

Numerical Analysis · Mathematics 2021-06-02 Yalchin Efendiev , Sai-Mang Pun , Petr N. Vabishchevich

The Proportional-Integral-Derivative Controller is widely used in industries for process control applications. Fractional-order PID controllers are known to outperform their integer-order counterparts. In this paper, we propose a new…

Other Computer Science · Computer Science 2008-11-04 Mithun Chakraborty , Deepyaman Maiti , Amit Konar

Many applied time-dependent problems are characterized by an additive representation of the problem operator. Additive schemes are constructed using such a splitting and associated with the transition to a new time level on the basis of the…

Numerical Analysis · Computer Science 2010-05-13 Petr N. Vabishchevich

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

In this work, we study time-splitting strategies for the numerical approximation of evolutionary reaction-diffusion problems. In particular, we formulate a family of domain decomposition splitting methods that overcomes some typical…

Numerical Analysis · Mathematics 2016-09-01 Andrés Arrarás , Laura Portero

In this paper we show a simplified optimisation approach for free boundary problems in arbitrary space dimensions. This approach is mainly based on an extended operator splitting which allows a decoupling of the domain deformation and…

Optimization and Control · Mathematics 2013-10-01 Jan Marburger

Symplectic integration methods based on operator splitting are well established in many branches of science. For Hamiltonian systems which split in more than two parts, symplectic methods of higher order have been studied in detail only for…

A numerical framework based on network partition and operator splitting is developed to solve nonlinear differential equations of large-scale dynamic processes encountered in physics, chemistry and biology. Under the assumption that those…

Computational Physics · Physics 2018-01-22 Shucheng Pan , Jianhang Wang , Xiangyu Hu , Nikolaus A. Adams

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…

Optimization and Control · Mathematics 2012-04-10 John C. Duchi , Peter L. Bartlett , Martin J. Wainwright

We present a new algorithm to optimize distributions defined implicitly by parameterized stochastic diffusions. Doing so allows us to modify the outcome distribution of sampling processes by optimizing over their parameters. We introduce a…

This work introduces and rigorously analyzes a novel operator-splitting finite element scheme for approximating viscosity solutions of a broad class of constrained second-order partial differential equations. By decoupling the primary PDE…

Numerical Analysis · Mathematics 2025-07-01 Po-Yi Wu

Continuing earlier investigations, we analyze the convergence of operator splitting procedures combined with spatial discretization and rational approximations.

Functional Analysis · Mathematics 2011-03-03 András Bátkai , Petra Csomós , Bálint Farkas , Gregor Nickel

Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Frank Neumann , Carsten Witt

Inspired by the successes of stochastic algorithms in the training of deep neural networks and the simulation of interacting particle systems, we propose and analyze a framework for randomized time-splitting in linear-quadratic optimal…

Optimization and Control · Mathematics 2022-06-02 Daniel Veldman , Enrique Zuazua

We provide a novel computer-assisted technique for systematically analyzing first-order methods for optimization. In contrast with previous works, the approach is particularly suited for handling sublinear convergence rates and stochastic…

Optimization and Control · Mathematics 2021-12-22 Adrien Taylor , Francis Bach

We employ an evolutionary algorithm to automatically optimize different stages of a cold atom experiment without human intervention. This approach closes the loop between computer based experimental control systems and automatic real time…

We aim to solve a structured convex optimization problem, where a nonsmooth function is composed with a linear operator. When opting for full splitting schemes, usually, primal-dual type methods are employed as they are effective and also…

Optimization and Control · Mathematics 2019-05-17 Radu Ioan Bot , Axel Böhm

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang