English
Related papers

Related papers: Disjoint optimizers and the directed landscape

200 papers

We present a link-by-link rule-based method for constructing all members of the ensemble of spanning trees for any recursively generated, finitely articulated graph, such as the DGM net. The recursions allow for many large-scale properties…

Physics and Society · Physics 2022-03-14 C. Tyler Diggans , Erik M. Bollt , Daniel ben-Avraham

In this paper we study the problem of learning a shallow artificial neural network that best fits a training data set. We study this problem in the over-parameterized regime where the number of observations are fewer than the number of…

Machine Learning · Computer Science 2022-08-25 Mahdi Soltanolkotabi , Adel Javanmard , Jason D. Lee

One of the most common problem-solving heuristics is by analogy. For a given problem, a solver can be viewed as a strategic walk on its fitness landscape. Thus if a solver works for one problem instance, we expect it will also be effective…

Machine Learning · Computer Science 2023-12-06 Mingyu Huang , Ke Li

Directed paths have been used by several authors to describe concurrent executions of a program. Spaces of directed paths in an appropriate state space contain executions with all possible legal schedulings. It is interesting to investigate…

Algebraic Topology · Mathematics 2023-06-22 Martin Raussen

There are many surprising and perhaps counter-intuitive properties of optimization of deep neural networks. We propose and experimentally verify a unified phenomenological model of the loss landscape that incorporates many of them. High…

Machine Learning · Computer Science 2019-06-12 Stanislav Fort , Stanislaw Jastrzebski

In last passage percolation models lying in the Kardar-Parisi-Zhang universality class, maximizing paths that travel over distances of order $n$ accrue energy that fluctuates on scale $n^{1/3}$; and these paths deviate from the linear…

Probability · Mathematics 2019-05-30 Riddhipratim Basu , Shirshendu Ganguly , Alan Hammond

We introduce a cutting-plane framework for nonconvex quadratic programs (QPs) that progressively tightens convex relaxations. Our approach leverages the doubly nonnegative (DNN) relaxation to compute strong lower bounds and generate…

Optimization and Control · Mathematics 2025-10-06 Zheng Qu , Defeng Sun , Jintao Xu

Probabilistic message-passing algorithms are developed for routing transmissions in multi-wavelength optical communication networks, under node and edge-disjoint routing constraints and for various objective functions. Global routing…

Physics and Society · Physics 2022-04-25 Yi-Zhi Xu , Ho Fai Po , Chi Ho Yeung , David Saad

Optimization under structural constraints is typically analyzed through projection or penalty methods, obscuring the geometric mechanism by which constraints shape admissible dynamics. We propose an operator-theoretic formulation in which…

Optimization and Control · Mathematics 2026-03-10 Changkai Li

Persistence diagrams (PDs) are now routinely used to summarize the underlying topology of complex data. Despite several appealing properties, incorporating PDs in learning pipelines can be challenging because their natural geometry is not…

Machine Learning · Statistics 2018-11-14 Théo Lacombe , Marco Cuturi , Steve Oudot

In this paper, we propose a distributed algorithm, called Directed-Distributed Gradient Descent (D-DGD), to solve multi-agent optimization problems over directed graphs. Existing algorithms mostly deal with similar problems under the…

Optimization and Control · Mathematics 2016-02-02 Chenguang Xi , Qiong Wu , Usman A. Khan

Problem of finding 2D paths of special shape, e.g. paths comprised of line segments having the property that the angle between any two consecutive segments does not exceed the predefined threshold, is considered in the paper. This problem…

Artificial Intelligence · Computer Science 2018-11-05 Anton Andreychuk , Natalia Soboleva , Konstantin Yakovlev

In the directed landscape, the Martin boundary coincides with the horofunction boundary. We show that functions in this boundary are precisely the eternal solutions possessing a spatial growth rate, and that the minimal Martin boundary is…

Probability · Mathematics 2026-05-21 Firas Rassoul-Agha , Mikhail Sweeney

Long-horizon planning is crucial in complex environments, but diffusion-based planners like Diffuser are limited by the trajectory lengths observed during training. This creates a dilemma: long trajectories are needed for effective…

Machine Learning · Computer Science 2025-11-18 Chang Chen , Hany Hamed , Doojin Baek , Taegu Kang , Samyeul Noh , Yoshua Bengio , Sungjin Ahn

We propose a fast and scalable algorithm to project a given density on a set of structured measures defined over a compact 2D domain. The measures can be discrete or supported on curves for instance. The proposed principle and algorithm are…

Numerical Analysis · Mathematics 2019-02-05 Frédéric de Gournay , Jonas Kahn , Léo Lebrat , Pierre Weiss

Given a set of sources and a set of sinks as points in the Euclidean plane, a directed network is a directed graph drawn in the plane with a directed path from each source to each sink. Such a network may contain nodes other than the given…

Metric Geometry · Mathematics 2020-05-20 Alastair Maxwell , Konrad J. Swanepoel

We consider two problems for a directed graph $G$, which we show to be closely related. The first one is to find $k$ edge-disjoint forests in $G$ of maximal size such that the indegree of each vertex in these forests is at most $k$. We…

Data Structures and Algorithms · Computer Science 2025-10-16 Pavel Arkhipov , Vladimir Kolmogorov

Last passage percolation (LPP) is a model of a directed metric and a zero-temperature polymer where the main observable is a directed path evolving in a random environment accruing as energy the sum of the random weights along itself. When…

Probability · Mathematics 2025-01-07 Shirshendu Ganguly , Victor Ginsburg , Kyeongsik Nam

The sequence of random probability measures $\nu_n$ that gives a path of length $n$, $\unsur{n}$ times the sum of the random weights collected along the paths, is shown to satisfy a large deviations principle with good rate function the…

Probability · Mathematics 2008-08-29 Philippe Carmona

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are…

Optimization and Control · Mathematics 2018-06-08 Ran Xin , Usman A. Khan