English
Related papers

Related papers: Pymanopt: A Python Toolbox for Optimization on Man…

200 papers

Scientific and engineering processes deliver massive high-dimensional data sets that are generated as non-linear transformations of an initial state and few process parameters. Mapping such data to a low-dimensional manifold facilitates…

Machine Learning · Statistics 2018-08-07 Frank Schoeneman , Varun Chandola , Nils Napp , Olga Wodo , Jaroslaw Zola

With the demand for machine learning increasing, so does the demand for tools which make it easier to use. Automated machine learning (AutoML) tools have been developed to address this need, such as the Tree-Based Pipeline Optimization Tool…

Neural and Evolutionary Computing · Computer Science 2018-03-13 Pieter Gijsbers , Joaquin Vanschoren , Randal S. Olson

We present a homotopic approach to solving challenging, optimization-based motion planning problems. The approach uses Homotopy Optimization, which, unlike standard continuation methods for solving homotopy problems, solves a sequence of…

Robotics · Computer Science 2024-08-23 Shayan Pardis , Matthew Chignoli , Sangbae Kim

The optimization and machine learning toolkit (OMLT) is an open-source software package incorporating neural network and gradient-boosted tree surrogate models, which have been trained using machine learning, into larger optimization…

Convex optimization is an essential tool for machine learning, as many of its problems can be formulated as minimization problems of specific objective functions. While there is a large variety of algorithms available to solve convex…

Machine Learning · Computer Science 2016-12-28 Nathanael Perraudin , Vassilis Kalofolias , David Shuman , Pierre Vandergheynst

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

Machine Learning · Computer Science 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

There is an increasing need for algorithms that can accurately detect changepoints in long time-series, or equivalent, data. Many common approaches to detecting changepoints, for example based on penalised likelihood or minimum description…

Methodology · Statistics 2014-09-08 Robert Maidstone , Toby Hocking , Guillem Rigaill , Paul Fearnhead

We present Rieoptax, an open source Python library for Riemannian optimization in JAX. We show that many differential geometric primitives, such as Riemannian exponential and logarithm maps, are usually faster in Rieoptax than existing…

Optimization and Control · Mathematics 2022-10-11 Saiteja Utpala , Andi Han , Pratik Jawanpuria , Bamdev Mishra

Manifold learning builds on the "manifold hypothesis," which posits that data in high-dimensional datasets are drawn from lower-dimensional manifolds. Current tools generate global embeddings of data, rather than the local maps used to…

Machine Learning · Computer Science 2025-08-28 Serena Hughes , Timothy Hamilton , Tom Kolokotrones , Eric J. Deeds

PYROBOCOP is a lightweight Python-based package for control and optimization of robotic systems described by nonlinear Differential Algebraic Equations (DAEs). In particular, the package can handle systems with contacts that are described…

Robotics · Computer Science 2021-06-08 Arvind U. Raghunathan , Devesh K. Jha , Diego Romeres

In this paper we compare several Python tools for automatic differentiation. In order to assess the difference in performance and precision, the problem of finding the optimal geometrical structure of the cluster with identical atoms is…

Mathematical Software · Computer Science 2016-06-22 Andrei Turkin , Aung Thu

Constrained Optimization solution algorithms are restricted to point based solutions. In practice, single or multiple objectives must be satisfied, wherein both the objective function and constraints can be non-convex resulting in multiple…

Neural and Evolutionary Computing · Computer Science 2021-01-05 Gurpreet Singh , Soumyajit Gupta , Matthew Lease

We introduce a manifold-based framework for addressing optimization problems with equality and inequality constraints found in robotics. Our approach transforms the original problem into an unconstrained optimization problem directly on the…

Robotics · Computer Science 2026-05-21 Yetong Zhang , Frank Dellaert

Mathematical models allow us to gain a deeper understanding of real-world dynamical systems. One of the most powerful mathematical frameworks for modeling real-world phenomena are systems of differential equations. In the majority of fields…

Disordered Systems and Neural Networks · Physics 2023-05-02 Richard Gast , Thomas R. Knösche , Ann Kennedy

This paper explores a method for solving constrained optimization problems when the derivatives of the objective function are unavailable, while the derivatives of the constraints are known. We allow the objective and constraint function to…

Optimization and Control · Mathematics 2024-02-20 Melody Qiming Xuan , Jorge Nocedal

Quantum parameter estimation promises a high-precision measurement in theory, however, how to design the optimal scheme in a specific scenario, especially under a practical condition, is still a serious problem that needs to be solved case…

Real-world optimization problems are often constrained by complex physical laws that limit computational scalability. These constraints are inherently tied to complex regions, and thus learning models that incorporate physical and geometric…

Machine Learning · Computer Science 2026-03-10 Yilin Wen , Yi Guo , Bo Zhao , Wei Qi , Zechun Hu , Colin Jones , Jian Sun

Significant effort has been made to solve computationally expensive optimization problems in the past two decades, and various optimization methods incorporating surrogates into optimization have been proposed. However, most optimization…

Neural and Evolutionary Computing · Computer Science 2022-04-13 Julian Blank , Kalyanmoy Deb

Spaces where each element describes a shape, so-called shape spaces, are of particular interest in shape optimization and its applications. Theory and algorithms in shape optimization are often based on techniques from differential…

Optimization and Control · Mathematics 2025-04-01 Lidiya Pryymak , Tim Suchan , Kathrin Welker

We propose a fully differentiable architecture for simultaneous semantic and instance segmentation (a.k.a. panoptic segmentation) consisting of a convolutional neural network and an asymmetric multiway cut problem solver. The latter solves…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Ahmed Abbas , Paul Swoboda