English
Related papers

Related papers: A New Result on the Complexity of Heuristic Estima…

200 papers

The Lasserre hierarchy is a systematic procedure for constructing a sequence of increasingly tight relaxations that capture the convex formulations used in the best available approximation algorithms for a wide variety of optimization…

Data Structures and Algorithms · Computer Science 2014-04-03 Monaldo Mastrolilli

Minimizing the rank of a matrix subject to constraints is a challenging problem that arises in many applications in control theory, machine learning, and discrete geometry. This class of optimization problems, known as rank minimization, is…

Optimization and Control · Mathematics 2016-11-17 Benjamin Recht , Weiyu Xu , Babak Hassibi

We study the Sparse Plus Low-Rank decomposition problem (SLR), which is the problem of decomposing a corrupted data matrix into a sparse matrix of perturbations plus a low-rank matrix containing the ground truth. SLR is a fundamental…

Machine Learning · Statistics 2023-11-15 Dimitris Bertsimas , Ryan Cory-Wright , Nicholas A. G. Johnson

This work presents a hybrid approach to solve the maximum stable set problem, using constraint and semidefinite programming. The approach consists of two steps: subproblem generation and subproblem solution. First we rank the variable…

Combinatorics · Mathematics 2007-05-23 W. J. van Hoeve

Real-time heuristic search is a popular model of acting and learning in intelligent autonomous agents. Learning real-time search agents improve their performance over time by acquiring and refining a value function guiding the application…

Artificial Intelligence · Computer Science 2007-05-23 Vadim Bulitko

It has been observed in practical applications and in theoretical analysis that over-parametrization helps to find good minima in neural network training. Similarly, in this article we study widening and deepening neural networks by a…

Numerical Analysis · Mathematics 2020-02-06 G. Welper

Designing optimization approaches, whether heuristic or meta-heuristic, usually demands extensive manual intervention and has difficulty generalizing across diverse problem domains. The combination of Large Language Models (LLMs) and…

Neural and Evolutionary Computing · Computer Science 2024-10-29 He Yu , Jing Liu

Compressing neural nets is an active research problem, given the large size of state-of-the-art nets for tasks such as object recognition, and the computational limits imposed by mobile devices. We give a general formulation of model…

Machine Learning · Computer Science 2017-07-06 Miguel Á. Carreira-Perpiñán

We introduce a general framework for analyzing learning algorithms based on the notion of self-regularization, which captures implicit complexity control without requiring explicit regularization. This is motivated by previous observations…

Machine Learning · Statistics 2026-03-19 Max Schölpple , Liu Fanghui , Ingo Steinwart

The continuous computational power growth in the last decades has made solving several optimization problems significant to humankind a tractable task; however, tackling some of them remains a challenge due to the overwhelming amount of…

Machine Learning · Computer Science 2023-02-01 Luiz C. F. Ribeiro , Mateus Roder , Gustavo H. de Rosa , Leandro A. Passos , João P. Papa

Hierarchical reasoning model (HRM) achieves extraordinary performance on various reasoning tasks, significantly outperforming large language model-based reasoners. To understand the strengths and potential failure modes of HRM, we conduct a…

Artificial Intelligence · Computer Science 2026-03-24 Zirui Ren , Ziming Liu

In recent years, semidefinite relaxations of common optimization problems in robotics have attracted growing attention due to their ability to provide globally optimal solutions. In many cases, it was shown that specific handcrafted…

Robotics · Computer Science 2024-10-03 Frederike Dümbgen , Connor Holmes , Ben Agro , Timothy D. Barfoot

Heuristic search algorithms, e.g. A*, are the commonly used tools for pathfinding on grids, i.e. graphs of regular structure that are widely employed to represent environments in robotics, video games etc. Instance-independent heuristics…

Artificial Intelligence · Computer Science 2022-12-23 Daniil Kirilenko , Anton Andreychuk , Aleksandr Panov , Konstantin Yakovlev

Path finding in graphs is one of the most studied classes of problems in computer science. In this context, search algorithms are often extended with heuristics for a more efficient search of target nodes. In this work we combine recent…

Artificial Intelligence · Computer Science 2022-04-20 Danilo Numeroso , Davide Bacciu , Petar Veličković

The linear programming (LP) approach has a long history in the theory of approximate dynamic programming. When it comes to computation, however, the LP approach often suffers from poor scalability. In this work, we introduce a relaxed…

Systems and Control · Electrical Eng. & Systems 2020-12-01 Andrea Martinelli , Matilde Gargiani , John Lygeros

Inverse problems are ubiquitous in science and engineering. Many of these are naturally formulated as a PDE-constrained optimization problem. These non-linear, large-scale, constrained optimization problems know many challenges, of which…

Optimization and Control · Mathematics 2024-12-03 Tristan van Leeuwen , Yunan Yang

Planning as heuristic search is one of the most successful approaches to classical planning but unfortunately, it does not extend trivially to Generalized Planning (GP). GP aims to compute algorithmic solutions that are valid for a set of…

Artificial Intelligence · Computer Science 2023-01-27 Javier Segovia-Aguas , Sergio Jiménez , Anders Jonsson

Optimization problems with rank constraints appear in many diverse fields such as control, machine learning and image analysis. Since the rank constraint is non-convex, these problems are often approximately solved via convex relaxations.…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Pontus Giselsson

Heuristic search is a powerful approach that has successfully been applied to a broad class of planning problems, including classical planning, multi-objective planning, and probabilistic planning modelled as a stochastic shortest path…

Artificial Intelligence · Computer Science 2024-10-29 Dillon Chen , Felipe Trevizan , Sylvie Thiébaux

Enumeration algorithms have been one of recent hot topics in theoretical computer science. Different from other problems, enumeration has many interesting aspects, such as the computation time can be shorter than the total output size, by…

Data Structures and Algorithms · Computer Science 2014-07-16 Takeaki Uno