English
Related papers

Related papers: ARock: an Algorithmic Framework for Asynchronous P…

200 papers

Composition optimization has drawn a lot of attention in a wide variety of machine learning domains from risk management to reinforcement learning. Existing methods solving the composition optimization problem often work in a sequential and…

Optimization and Control · Mathematics 2018-11-16 Shuheng Shen , Linli Xu , Jingchang Liu , Junliang Guo , Qing Ling

Efficient parallelization of Large Language Models (LLMs) with long sequences is essential but challenging due to their significant computational and memory demands, particularly stemming from communication bottlenecks in attention…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Zongwu Wang , Fangxin Liu , Mingshuai Li , Li Jiang

Asynchronous Federated Learning (AFL) confronts inherent challenges arising from the heterogeneity of devices (e.g., their computation capacities) and low-bandwidth environments, both potentially causing stale model updates (e.g., local…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Jiajun Song , Jiajun Luo , Rongwei Lu , Shuzhao Xie , Bin Chen , Zhi Wang

This paper proposes a reinforcement learning (RL)-based backstepping control strategy to achieve fixed time consensus in nonlinear multi-agent systems with strict feedback dynamics. Agents exchange only output information with their…

Systems and Control · Electrical Eng. & Systems 2025-07-23 Aria Delshad , Maryam Babazadeh

Adaptive Risk Control (ARC) is an online calibration strategy based on set prediction that offers worst-case deterministic long-term risk control, as well as statistical marginal coverage guarantees. ARC adjusts the size of the prediction…

Machine Learning · Statistics 2024-10-11 Matteo Zecchin , Osvaldo Simeone

Many challenging tasks in sensor networks, including sensor calibration, ranking of nodes, monitoring, event region detection, collaborative filtering, collaborative signal processing, {\em etc.}, can be formulated as a problem of solving a…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-11-21 Ezra N. Hoch , Danny Bickson , Danny Dolev

Fast and efficient path generation is critical for robots operating in complex environments. This motion planning problem is often performed in a robot's actuation or configuration space, where popular pathfinding methods such as A*, RRT*,…

Robotics · Computer Science 2019-04-26 Mayur J. Bency , Ahmed H. Qureshi , Michael C. Yip

This paper presents an acceleration framework for packing linear programming problems where the amount of data available is limited, i.e., where the number of constraints m is small compared to the variable dimension n. The framework can be…

Optimization and Control · Mathematics 2017-11-20 Palma London , Shai Vardi , Adam Wierman , Hanling Yi

The alternating direction method of multipliers (ADMM) has been popular for solving many signal processing problems, convex or nonconvex. In this paper, we study an asynchronous implementation of the ADMM for solving a nonconvex nonsmooth…

Information Theory · Computer Science 2014-12-19 Mingyi Hong

In this paper, we consider the output synchronization problem for a network of heterogeneous diffusively-coupled nonlinear agents. Specifically, we show how the (non-identical) agents can be controlled in such a way that their outputs…

Optimization and Control · Mathematics 2013-03-13 A. Isidori , L. Marconi , G. Casadei

Classical mathematical models of information sharing and updating in multi-agent networks use linear operators. In the paradigmatic DeGroot model, agents update their states with linear combinations of their neighbors' current states. In…

Systems and Control · Electrical Eng. & Systems 2022-04-26 Aditya Bhaskar , Shriya Rangarajan , Vikram Shree , Mark Campbell , Francesca Parise

The challenge of mastering computational tasks of enormous size tends to frequently override questioning the quality of the numerical outcome in terms of accuracy. By this we do not mean the accuracy within the discrete setting, which…

Numerical Analysis · Mathematics 2019-10-17 Markus Bachmayr , Wolfgang Dahmen

We propose a parallel algorithm for local, on the fly, model checking of a fragment of CTL that is well-suited for modern, multi-core architectures. This model-checking algorithm takes bene t from a parallel state space construction…

Logic in Computer Science · Computer Science 2013-02-01 Rodrigo Tacla Saad , Silvano Dal Zilio , Bernard Berthomieu

In the stabilizing consensus problem, each agent of a networked system has an input value and is repeatedly writing an output value; it is required that eventually all the output values stabilize to the same value which, moreover, must be…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-24 Bernadette Charron-Bost , Shlomo Moran

Recent strides in nonlinear model predictive control (NMPC) underscore a dependence on numerical advancements to efficiently and accurately solve large-scale problems. Given the substantial number of variables characterizing typical…

Robotics · Computer Science 2024-06-04 Wilson Jallet , Ewen Dantec , Etienne Arlaud , Justin Carpentier , Nicolas Mansard

Reproducing kernel (RK) approximations are meshfree methods that construct shape functions from sets of scattered data. We present an asymptotically compatible (AC) RK collocation method for nonlocal diffusion models with Dirichlet boundary…

Numerical Analysis · Mathematics 2020-08-26 Yu Leng , Xiaochuan Tian , Nathaniel Trask , John T. Foster

This paper investigates an expected average error for distributed averaging problems under asynchronous updates. The asynchronism in this context implies no existence of a global clock as well as random characteristics in communication…

Systems and Control · Electrical Eng. & Systems 2020-06-04 Kooktae Lee

This paper introduces the multiplicative variant of the recently proposed asynchronous additive coarse-space correction method. Definition of an asynchronous extension of multiplicative correction is not straightforward, however, our…

Numerical Analysis · Mathematics 2023-12-20 Guillaume Gbikpi-Benissan , Frédéric Magoulès

This paper presents a Nonlinear Model Predictive Control (NMPC) scheme targeted at motion planning for mechatronic motion systems, such as drones and mobile platforms. NMPC-based motion planning typically requires low computation times to…

Robotics · Computer Science 2024-10-28 Dries Dirckx , Mathias Bos , Bastiaan Vandewal , Lander Vanroye , Wilm Decré , Jan Swevers

In this work, we develop a convergence framework for iterative algorithms whose updates can be described by a one-parameter family of nonexpansive operators. Within the framework, each step involving one of the main algorithmic operators is…

Optimization and Control · Mathematics 2025-12-01 Felipe Atenas , Heinz H. Bauschke , Minh N. Dao , Matthew K. Tam