English
Related papers

Related papers: From Symmetry to Geometry: Tractable Nonconvex Pro…

200 papers

Convex optimization encompasses a wide range of optimization problems that contain many efficiently solvable subclasses. Interior point methods are currently the state-of-the-art approach for solving such problems, particularly effective…

Optimization and Control · Mathematics 2025-03-28 Andreas Klingler , Tim Netzer

The understanding of the mechanisms driving vascular development is still limited. Techniques to generate vascular trees synthetically have been developed to tackle this problem. However, most algorithms are limited to single trees inside…

Biological Physics · Physics 2024-10-10 Etienne Jessen , Marc C. Steinbach , Dominik Schillinger

This survey reviews a clustering method based on solving a convex optimization problem. Despite the plethora of existing clustering methods, convex clustering has several uncommon features that distinguish it from prior art. The…

Methodology · Statistics 2025-09-19 Eric C. Chi , Aaron J. Molstad , Zheming Gao , Jocelyn T. Chi

Polytopes are the basic finite data structures for convex sets: they appear as feasible regions in linear optimization, as geometric summaries in algorithms, and as random objects in stochastic geometry. A natural geometric question is…

Metric Geometry · Mathematics 2026-03-10 Steven Hoehner

Machine Learning models incorporating multiple layered learning networks have been seen to provide effective models for various classification problems. The resulting optimization problem to solve for the optimal vector minimizing the…

Optimization and Control · Mathematics 2018-07-03 Vyacheslav Kungurtsev , Tomas Pevny

Trajectory optimization offers mature tools for motion planning in high-dimensional spaces under dynamic constraints. However, when facing complex configuration spaces, cluttered with obstacles, roboticists typically fall back to…

Robotics · Computer Science 2022-05-10 Tobia Marcucci , Mark Petersen , David von Wrangel , Russ Tedrake

The geometrical features of the (non-convex) loss landscape of neural network models are crucial in ensuring successful optimization and, most importantly, the capability to generalize well. While minimizers' flatness consistently…

Disordered Systems and Neural Networks · Physics 2020-07-28 Carlo Baldassi , Riccardo Della Vecchia , Carlo Lucibello , Riccardo Zecchina

Non-smooth optimization is a core ingredient of many imaging or machine learning pipelines. Non-smoothness encodes structural constraints on the solutions, such as sparsity, group sparsity, low-rank and sharp edges. It is also the basis for…

Optimization and Control · Mathematics 2022-05-04 Clarice Poon , Gabriel Peyré

Composite minimization involves a collection of smooth functions which are aggregated in a nonsmooth manner. In the convex setting, we design an algorithm by linearizing each smooth component in accordance with its main curvature. The…

Optimization and Control · Mathematics 2019-03-26 Jérôme Bolte , Zheng Chen , Edouard Pauwels

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of…

Machine Learning · Statistics 2016-03-22 John P. Cunningham , Zoubin Ghahramani

A common representation of a three dimensional object in computer applications, such as graphics and design, is in the form of a triangular mesh. In many instances, individual or groups of triangles in such representation need to satisfy…

Optimization and Control · Mathematics 2019-04-08 Valentin R. Koch , Hung M. Phan

We present a geometrical analysis on the completely positive programming reformulation of quadratic optimization problems and its extension to polynomial optimization problems with a class of geometrically defined nonconvex conic programs…

Optimization and Control · Mathematics 2019-01-09 Sunyoung Kim , Masakazu Kojima , Kim-Chuan Toh

Non-convex optimization problems often arise from probabilistic modeling, such as estimation of posterior distributions. Non-convexity makes the problems intractable, and poses various obstacles for us to design efficient algorithms. In…

Machine Learning · Computer Science 2013-12-18 Khoat Than , Tu Bao Ho

Statistical models that possess symmetry arise in diverse settings such as random fields associated to geophysical phenomena, exchangeable processes in Bayesian statistics, and cyclostationary processes in engineering. We formalize the…

Statistics Theory · Mathematics 2011-12-01 Parikshit Shah , Venkat Chandrasekaran

The clear understanding of the non-convex landscape of neural network is a complex incomplete problem. This paper studies the landscape of linear (residual) network, the simplified version of the nonlinear network. By treating the gradient…

Algebraic Geometry · Mathematics 2021-02-09 Xiuyi Yang

Numerous interesting properties in nonlinear systems analysis can be written as polynomial optimization problems with nonconvex sum-of-squares problems. To solve those problems efficiently, we propose a sequential approach of local…

Optimization and Control · Mathematics 2023-10-03 Torbjørn Cunis , Benoît Legat

Symmetries have proven to be important ingredients in the analysis of neural networks. So far their use has mostly been implicit or seemingly coincidental. We undertake a systematic study of the role that symmetry plays. In particular, we…

Machine Learning · Computer Science 2021-04-13 Grzegorz Głuch , Rüdiger Urbanke

Non-convex optimization with local search heuristics has been widely used in machine learning, achieving many state-of-art results. It becomes increasingly important to understand why they can work for these NP-hard problems on typical…

Machine Learning · Computer Science 2017-06-20 Rong Ge , Tengyu Ma

A class of algorithms for the solution of discrete material optimization problems in electromagnetic applications is discussed. The idea behind the algorithm is similar to that of the sequential programming. However, in each major iteration…

Optimization and Control · Mathematics 2017-07-14 Johannes Semmler , Lukas Pflug , Michael Stingl

Cooperative geolocation has attracted significant research interests in recent years. A large number of localization algorithms rely on the availability of statistical knowledge of measurement errors, which is often difficult to obtain in…

Applications · Statistics 2017-01-05 Xiufang Shi , Guoqiang Mao , Brian. D. O. Anderson , Zaiyue Yang , Jiming Chen