English
Related papers

Related papers: Neural Predictor-Corrector: Solving Homotopy Probl…

200 papers

Learning from many real-world datasets is limited by a problem called the class imbalance problem. A dataset is imbalanced when one class (the majority class) has significantly more samples than the other class (the minority class). Such…

Machine Learning · Computer Science 2017-11-30 Soroush Saryazdi , Bahareh Nikpour , Hossein Nezamabadi-pour

We present a learning-based approach to computing solutions for certain NP-hard problems. Our approach combines deep learning techniques with useful algorithmic elements from classic heuristics. The central component is a graph…

Machine Learning · Computer Science 2018-10-26 Zhuwen Li , Qifeng Chen , Vladlen Koltun

A large amount of recent research has the far-reaching goal of finding training methods for deep neural networks that can serve as alternatives to backpropagation (BP). A prominent example is predictive coding (PC), which is a…

Machine Learning · Computer Science 2022-11-08 Luca Pinchetti , Tommaso Salvatori , Yordan Yordanov , Beren Millidge , Yuhang Song , Thomas Lukasiewicz

Input constrained Model predictive control (MPC) includes an optimization problem which should iteratively be solved at each time-instance. The well-known drawback of model predictive control is the computational cost of the optimization…

Optimization and Control · Mathematics 2019-04-17 Saman Cyrus , Ali Khaki Sedigh

We contribute NeuralSolver, a novel recurrent solver that can efficiently and consistently extrapolate, i.e., learn algorithms from smaller problems (in terms of observation size) and execute those algorithms in large problems. Contrary to…

Machine Learning · Computer Science 2024-11-01 Bernardo Esteves , Miguel Vasco , Francisco S. Melo

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

Background: The huge quantity of data produced in Biomedical research needs sophisticated algorithmic methodologies for its storage, analysis, and processing. High Performance Computing (HPC) appears as a magic bullet in this challenge.…

Quantitative Methods · Quantitative Biology 2016-10-19 Gianni D'Angelo , Salvatore Rampone

In this work, we propose a parameter continuation method for the optimization of neural networks. There is a close connection between parameter continuation, homotopies, and curriculum learning. The methods we propose here are theoretically…

Machine Learning · Computer Science 2025-07-31 Harsh Nilesh Pathak , Randy Paffenroth

Achieving safe and coordinated behavior in dynamic, constraint-rich environments remains a major challenge for learning-based control. Pure end-to-end learning often suffers from poor sample efficiency and limited reliability, while…

Systems and Control · Electrical Eng. & Systems 2025-10-10 Max Studt , Georg Schildbach

This work introduces a formulation of model predictive control (MPC) which adaptively reasons about the complexity of the model based on the task while maintaining feasibility and stability guarantees. Existing MPC implementations often…

Robotics · Computer Science 2024-11-07 Joseph Norby , Ardalan Tajbakhsh , Yanhao Yang , Aaron M. Johnson

We develop a homotopy-based framework for computing Karush-Kuhn-Tucker (KKT) points of multiobjective optimization problems. The proposed homotopy map continuously deforms an easily solvable system into the KKT conditions associated with…

Optimization and Control · Mathematics 2026-05-04 Olaoluwa Ogunleye , Guangming Yao , Jianhua Zhang

Collaboration requires agents to align their goals on the fly. Underlying the human ability to align goals with other agents is their ability to predict the intentions of others and actively update their own plans. We propose hierarchical…

Multiagent Systems · Computer Science 2020-11-10 Rose E. Wang , J. Chase Kew , Dennis Lee , Tsang-Wei Edward Lee , Tingnan Zhang , Brian Ichter , Jie Tan , Aleksandra Faust

Combinatorial optimization is widely applied in a number of areas nowadays. Unfortunately, many combinatorial optimization problems are NP-hard which usually means that they are unsolvable in practice. However, it is often unnecessary to…

Data Structures and Algorithms · Computer Science 2012-07-10 Daniel Karapetyan

The current dominant paradigm in sensorimotor control, whether imitation or reinforcement learning, is to train policies directly in raw action spaces such as torque, joint angle, or end-effector position. This forces the agent to make…

Machine Learning · Computer Science 2020-12-07 Shikhar Bahl , Mustafa Mukadam , Abhinav Gupta , Deepak Pathak

Combinatorial optimization problems like the Traveling Salesman Problem are critical in industry yet NP-hard. Neural Combinatorial Optimization has shown promise, but its reliance on online reinforcement learning (RL) hampers deployment and…

Machine Learning · Computer Science 2026-03-27 Hironori Ohigashi , Shinichiro Hamada

The field of neural combinatorial optimization (NCO) trains neural policies to solve NP-hard problems such as the traveling salesperson problem (TSP). We ask whether, beyond producing good tours, a trained TSP solver learns internal…

Machine Learning · Computer Science 2026-02-10 Reuben Narad , Léonard Boussioux , Michael Wagner

The Homotopy Analysis Method (HAM) is a widely used analytical approach for solving nonlinear problems, yet its theoretical foundation lacks rigorous justification, and its intrinsic correlation with perturbation theory remains ambiguous,…

General Mathematics · Mathematics 2026-04-16 Hang Xu

Hyperparameter optimization (HPO) is generally treated as a bi-level optimization problem that involves fitting a (probabilistic) surrogate model to a set of observed hyperparameter responses, e.g. validation loss, and consequently…

Machine Learning · Computer Science 2021-10-18 Hadi S. Jomaa , Jonas Falkner , Lars Schmidt-Thieme

Robust optimal or min-max model predictive control (MPC) approaches aim to guarantee constraint satisfaction over a known, bounded uncertainty set while minimizing a worst-case performance bound. Traditionally, these methods compute a…

Systems and Control · Electrical Eng. & Systems 2025-09-04 J. Wehbeh , E. C. Kerrigan

Robust Model Predictive Control (MPC) for nonlinear systems is a problem that poses significant challenges as highlighted by the diversity of approaches proposed in the last decades. Often compromises with respect to computational load,…

Systems and Control · Electrical Eng. & Systems 2024-02-21 Daniel D. Leister , Justin P. Koeln