English
Related papers

Related papers: How-to Augmented Lagrangian on Factor Graphs

200 papers

Data augmentation helps neural networks generalize better by enlarging the training set, but it remains an open question how to effectively augment graph data to enhance the performance of GNNs (Graph Neural Networks). While most existing…

Machine Learning · Computer Science 2022-03-30 Kezhi Kong , Guohao Li , Mucong Ding , Zuxuan Wu , Chen Zhu , Bernard Ghanem , Gavin Taylor , Tom Goldstein

Many problems in modern robotics can be addressed by modeling them as bilevel optimization problems. In this work, we leverage augmented Lagrangian methods and recent advances in automatic differentiation to develop a general-purpose…

Robotics · Computer Science 2019-07-03 Benoit Landry , Zachary Manchester , Marco Pavone

The Augmented Lagrangian Method (ALM) is an iterative method for the solution of equality-constrained non-linear programming problems. In contrast to the quadratic penalty method, the ALM can satisfy equality constraints in an exact way.…

Numerical Analysis · Mathematics 2018-04-24 Martin Neuenhofen

To construct a parallel approach for solving optimization problems with orthogonality constraints is usually regarded as an extremely difficult mission, due to the low scalability of the orthonormalization procedure. However, such demand is…

Optimization and Control · Mathematics 2021-11-16 Bin Gao , Xin Liu , Ya-xiang Yuan

Factor graph represents the factorization of a probability distribution function and serves as an effective abstraction in various autonomous machine computing tasks. Control is one of the core applications in autonomous machine computing…

Hardware Architecture · Computer Science 2023-08-08 Yuhui Hao , Bo Yu , Qiang Liu , Shao-Shan Liu

Inference by means of mathematical modeling from a collection of observations remains a crucial tool for scientific discovery and is ubiquitous in application areas such as signal compression, imaging restoration, and supervised machine…

Numerical Analysis · Mathematics 2022-07-19 Matthias Chung , Rosemary Renaut

Modern robotics often involves multiple embodied agents operating within a shared environment. Path planning in these cases is considerably more challenging than in single-agent scenarios. Although standard Sampling-based Algorithms (SBAs)…

Robotics · Computer Science 2023-04-04 Alessandro Zanardi , Pietro Zullo , Andrea Censi , Emilio Frazzoli

Automated optimization modeling (AOM) has evoked considerable interest with the rapid evolution of large language models (LLMs). Existing approaches predominantly rely on prompt engineering, utilizing meticulously designed expert response…

Artificial Intelligence · Computer Science 2025-01-31 Tianpeng Pan , Wenqiang Pu , Licheng Zhao , Rui Zhou

We introduce \underline{F}actor-\underline{A}ugmented \underline{Ma}trix \underline{R}egression (FAMAR) to address the growing applications of matrix-variate data and their associated challenges, particularly with high-dimensionality and…

Methodology · Statistics 2024-05-29 Elynn Chen , Jianqing Fan , Xiaonan Zhu

The Augmented Lagragian Method (ALM) and Alternating Direction Method of Multiplier (ADMM) have been powerful optimization methods for general convex programming subject to linear constraint. We consider the convex problem whose objective…

Optimization and Control · Mathematics 2015-11-18 Canyi Lu , Huan Li , Zhouchen Lin , Shuicheng Yan

In this paper, we propose the primal-dual method of multipliers (PDMM) for distributed optimization over a graph. In particular, we optimize a sum of convex functions defined over a graph, where every edge in the graph carries a linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-06 G. Zhang , R. Heusdens

In this paper, we consider large-scale linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose a scalable \textbf{F}rank-\textbf{W}olfe based…

Optimization and Control · Mathematics 2015-10-13 Ya-Feng Liu , Xiangfeng Wang , Xin Liu , Shiqian Ma

This work presents an adaptive superfast proximal augmented Lagrangian (AS-PAL) method for solving linearly-constrained smooth nonconvex composite optimization problems. Each iteration of AS-PAL inexactly solves a possibly nonconvex…

Optimization and Control · Mathematics 2022-10-07 Arnesh Sujanani , Renato D. C. Monteiro

In this paper, we present a novel general framework grounded in the factor graph theory to solve kinematic and dynamic problems for multi-body systems. Although the motion of multi-body systems is considered to be a well-studied problem and…

Robotics · Computer Science 2021-07-27 José-Luis Blanco-Claraco , Antonio Leanza , Giulio Reina

This paper addresses the challenge of object-centric layout generation under spatial constraints, seen in multiple domains including floorplan design process. The design process typically involves specifying a set of spatial constraints…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mohammed Haroon Dupty , Yanfei Dong , Sicong Leng , Guoji Fu , Yong Liang Goh , Wei Lu , Wee Sun Lee

Laplacian matrices of graphs arise in large-scale computational applications such as machine learning; spectral clustering of images, genetic data and web pages; transportation network flows; electrical resistor circuits; and elliptic…

Numerical Analysis · Mathematics 2011-08-02 Oren E. Livne , Achi Brandt

Mathematical optimization is the workhorse behind several aspects of modern robotics and control. In these applications, the focus is on constrained optimization, and the ability to work on manifolds (such as the classical matrix Lie…

Robotics · Computer Science 2022-10-06 Wilson Jallet , Antoine Bambade , Nicolas Mansard , Justin Carpentier

We consider the convex minimization model with both linear equality and inequality constraints, and reshape the classic augmented Lagrangian method (ALM) by balancing its subproblems. As a result, one of its subproblems decouples the…

Optimization and Control · Mathematics 2021-08-20 Bingsheng He , Xiaoming Yuan

Most recently, He and Yuan [arXiv:2108.08554, 2021] have proposed a balanced augmented Lagrangian method (ALM) for the canonical convex programming problem with linear constraints, which advances the original ALM by balancing its…

Optimization and Control · Mathematics 2021-12-30 Shengjie Xu

In this paper we investigate how standard nonlinear programming algorithms can be used to solve constrained optimization problems in a distributed manner. The optimization setup consists of a set of agents interacting through a…

Optimization and Control · Mathematics 2017-07-18 Ion Matei , John S. Baras