English
Related papers

Related papers: An iterative aggregation and disaggregation approa…

200 papers

We give a new proof of local convergence of a multigrid method called iterative aggregation/disaggregation (IAD) for computing steady-states of Markov chains. Our proof leads naturally to a precise and interpretable estimate of the…

Numerical Analysis · Mathematics 2022-09-23 Gabriel Earle , Brian Van Koten

Many engineering problems involve learning hidden dynamics from indirect observations, where the physical processes are described by systems of partial differential equations (PDE). Gradient-based optimization methods are considered…

Numerical Analysis · Mathematics 2019-12-17 Kailai Xu , Dongzhuo Li , Eric Darve , Jerry M. Harris

This paper considers a type of incremental aggregated gradient (IAG) method for large-scale distributed optimization. The IAG method is well suited for the parameter server architecture as the latter can easily aggregate potentially staled…

Optimization and Control · Mathematics 2023-09-12 Xiaolu Wang , Cheng Jin , Hoi-To Wai , Yuantao Gu

The aim of this paper is to present a first evaluation of the potential of an asynchronous distributed computation associated to the recently proposed approach, D-iteration: the D-iteration is a fluid diffusion based iterative method, which…

Numerical Analysis · Mathematics 2012-02-29 Dohy Hong

The aim of this paper is to present a first evaluation of a dynamic partition strategy associated to the recently proposed asynchronous distributed computation scheme based on the D-iteration approach. The D-iteration is a fluid diffusion…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-13 Dohy Hong

We propose an analytic approach for the steady-state dynamics of Markov processes on locally tree-like graphs. It is based on time-translation invariant probability distributions for edge trajectories, which we encode in terms of infinite…

Statistical Mechanics · Physics 2025-09-08 Stefano Crotti , Thomas Barthel , Alfredo Braunstein

Iterative procedures for parameter estimation based on stochastic gradient descent allow the estimation to scale to massive data sets. However, in both theory and practice, they suffer from numerical instability. Moreover, they are…

Methodology · Statistics 2016-06-08 Panos Toulis , Dustin Tran , Edoardo M. Airoldi

Optimally operating an integrated electricity-gas system (IEGS) is significant for the energy sector. However, the IEGS operation model's nonconvexity makes it challenging to solve the optimal dispatch problem in the IEGS. This letter…

Optimization and Control · Mathematics 2020-12-08 Han Gao , Zhengshuo Li

State aggregation is a popular model reduction method rooted in optimal control. It reduces the complexity of engineering systems by mapping the system's states into a small number of meta-states. The choice of aggregation map often depends…

Machine Learning · Computer Science 2019-10-17 Yaqi Duan , Zheng Tracy Ke , Mengdi Wang

We present a novel acceleration technique for improving the convergence of source iteration for discrete ordinates transport calculations. Our approach uses the idea of the dynamic mode decomposition (DMD) to estimate the slowly decaying…

Computational Physics · Physics 2018-12-14 Ryan G. McClarren , Terry S. Haut

We analyse and explain the increased generalisation performance of iterate averaging using a Gaussian process perturbation model between the true and batch risk surface on the high dimensional quadratic. We derive three phenomena…

Machine Learning · Statistics 2021-11-02 Diego Granziol , Xingchen Wan , Samuel Albanie , Stephen Roberts

Data assimilation has become a key technique for combining physical models with observational data to estimate state variables. However, classical assimilation algorithms often struggle with the high nonlinearity present in both physical…

Machine Learning · Computer Science 2025-07-22 Zhuoyuan Li , Bin Dong , Pingwen Zhang

We introduce Adversarial Diffusion Distillation (ADD), a novel training approach that efficiently samples large-scale foundational image diffusion models in just 1-4 steps while maintaining high image quality. We use score distillation to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Axel Sauer , Dominik Lorenz , Andreas Blattmann , Robin Rombach

Accurate and efficient prediction of multicomponent adsorption equilibria across pressures, temperatures, and compositions remain a central challenge for designing energy-efficient adsorption-based separation processes. Traditional…

Statistical Mechanics · Physics 2026-03-31 Sunghyun Yoon , Jui Tu , Li-Chiang Lin , Yongchul G. Chung

We present two algorithms by which a set of short, unbiased trajectories can be iteratively reweighted to obtain various observables. The first algorithm estimates the stationary (steady state) distribution of a system by iteratively…

Computational Physics · Physics 2020-06-18 John D. Russo , Jeremy Copperman , Daniel M. Zuckerman

The emergence of diffusion models has significantly advanced generative AI, improving the quality, realism, and creativity of image and video generation. Among them, Stable Diffusion (StableDiff) stands out as a key model for text-to-image…

Hardware Architecture · Computer Science 2025-07-03 Zhican Wang , Guanghui He , Hongxiang Fan

In this paper, we consider the composition of two independent processes : one process corresponds to position and the other one to time. Such processes will be called iterated processes. We first propose an algorithm based on the Euler…

Probability · Mathematics 2017-05-03 Michèle Thieullen , Alexis Vigot

With the development of machine learning and Big Data, the concepts of linear and non-linear optimization techniques are becoming increasingly valuable for many quantitative disciplines. Problems of that nature are typically solved using…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-21 Wiktor Maj

We proposed a new technique to accelerate sampling methods for solving difficult optimization problems. Our method investigates the intrinsic connection between posterior distribution sampling and optimization with Langevin dynamics, and…

Machine Learning · Computer Science 2023-01-31 Junlong Lyu , Zhitang Chen , Wenlong Lyu , Jianye Hao

We propose a distributed algorithm to solve a dynamic programming problem with multiple agents, where each agent has only partial knowledge of the state transition probabilities and costs. We provide consensus proofs for the presented…

Optimization and Control · Mathematics 2023-06-19 Nikolaus Vertovec , Kostas Margellos
‹ Prev 1 2 3 10 Next ›