English
Related papers

Related papers: Cost Optimal Planning as Satisfiability

200 papers

Optimal transport (OT) based data analysis is often faced with the issue that the underlying cost function is (partially) unknown. This paper is concerned with the derivation of distributional limits for the empirical OT value when the cost…

Statistics Theory · Mathematics 2023-01-05 Shayan Hundrieser , Gilles Mordant , Christoph Alexander Weitkamp , Axel Munk

We study the sample complexity of learning an $\epsilon$-optimal policy in the Stochastic Shortest Path (SSP) problem. We first derive sample complexity bounds when the learner has access to a generative model. We show that there exists a…

Machine Learning · Computer Science 2022-10-12 Liyu Chen , Andrea Tirinzoni , Matteo Pirotta , Alessandro Lazaric

This paper formalizes the optimal base problem, presents an algorithm to solve it, and describes its application to the encoding of Pseudo-Boolean constraints to SAT. We demonstrate the impact of integrating our algorithm within the…

Discrete Mathematics · Computer Science 2011-01-04 Michael Codish , Yoav Fekete , Carsten Fuhs , Peter Schneider-Kamp

Conformant planning is the problem of finding a sequence of actions for achieving a goal in the presence of uncertainty in the initial state or action effects. The problem has been approached as a path-finding problem in belief space where…

Artificial Intelligence · Computer Science 2014-01-16 Hector Palacios , Hector Geffner

The boolean satisfiability (SAT) problem asks whether there exists an assignment of boolean values to the variables of an arbitrary boolean formula making the formula evaluate to True. It is well-known that all NP-problems can be coded as…

Machine Learning · Computer Science 2024-10-22 Christopher R. Serrano , Jonathan Gallagher , Kenji Yamada , Alexei Kopylov , Michael A. Warren

Recent work has shown that temporally extended actions (options) can be learned fully end-to-end as opposed to being specified in advance. While the problem of "how" to learn options is increasingly well understood, the question of "what"…

Artificial Intelligence · Computer Science 2017-09-15 Jean Harb , Pierre-Luc Bacon , Martin Klissarov , Doina Precup

We exhibit optimal control strategies for a simple toy problem in which the underlying dynamics depend on a parameter that is initially unknown and must be learned. We consider a cost function posed over a finite time interval, in contrast…

Optimization and Control · Mathematics 2020-02-27 Charles L. Fefferman , Bernat Guillen Pegueroles , Clarence W. Rowley , Melanie Weber

In this work, new theoretical results on functional type a posteriori estimates for elliptic optimal control problems with control constraints are presented. More precisely, we derive new, sharp, guaranteed and fully computable lower bounds…

Optimization and Control · Mathematics 2015-06-02 Monika Wolfmayr

We consider a general problem of finding a strategy that minimizes the exponential moment of a given cost function, with an emphasis on its relation to the more common criterion of minimization the expectation of the first moment of the…

Information Theory · Computer Science 2011-03-16 Neri Merhav

We consider the problem of sequential sampling from a finite number of independent statistical populations to maximize the expected infinite horizon average outcome per period, under a constraint that the expected average sampling cost does…

Machine Learning · Statistics 2012-01-20 Apostolos Burnetas , Odysseas Kanavetas

We build on a recently proposed method for stepwise explaining solutions of Constraint Satisfaction Problems (CSP) in a human-understandable way. An explanation here is a sequence of simple inference steps where simplicity is quantified…

Artificial Intelligence · Computer Science 2023-11-29 Emilio Gamba , Bart Bogaerts , Tias Guns

Information about action costs is critical for real-world AI planning applications. Rather than rely solely on declarative action models, recent approaches also use black-box external action cost estimators, often learned from data, that…

Artificial Intelligence · Computer Science 2023-07-20 Eyal Weiss , Gal A. Kaminka

We provide a tight bound on the amount of experimentation under the optimal strategy in sequential decision problems. We show the applicability of the result by providing a bound on the cut-off in a one-arm bandit problem.

Probability · Mathematics 2009-07-14 Dinah Rosenberg , Eilon Solan , Nicolas Vieille

We present the theoretical analysis and proofs of a recently developed algorithm that allows for optimal planning over long and infinite horizons for achieving multiple independent tasks that are partially observable and evolve over time.

Robotics · Computer Science 2021-02-26 Anahita Mohseni-Kabir , Manuela Veloso , Maxim Likhachev

The problem of estimating the proportion of satisfiable instances of a given CSP (constraint satisfaction problem) can be tackled through weighting. It consists in putting onto each solution a non-negative real value based on its…

Discrete Mathematics · Computer Science 2015-03-17 Yacine Boufkhad , Thomas Hugel

Optimal control is an essential tool for stabilizing complex nonlinear systems. However, despite the extensive impacts of methods such as receding horizon control, dynamic programming and reinforcement learning, the design of cost functions…

Systems and Control · Electrical Eng. & Systems 2022-11-21 Tyler Westenbroek , Anand Siththaranjan , Mohsin Sarwari , Claire J. Tomlin , Shankar S. Sastry

We consider the problem of the optimal trading strategy in the presence of linear costs, and with a strict cap on the allowed position in the market. Using Bellman's backward recursion method, we show that the optimal strategy is to switch…

Portfolio Management · Quantitative Finance 2012-03-28 Joachim de Lataillade , Cyril Deremble , Marc Potters , Jean-Philippe Bouchaud

We revisit the optimal control problem with maximum cost with the objective to provide different equivalent reformulations suitable to numerical methods. We propose two reformulations in terms of extended Mayer problems with constraint, and…

Optimization and Control · Mathematics 2022-02-28 Emilio Molina , Alain Rapaport , Hector Ramirez

Satellite mission planning for Earth observation satellites is a combinatorial optimization problem that consists of selecting the optimal subset of imaging requests, subject to constraints, to be fulfilled during an orbit pass of a…

Standard algorithms for finding the shortest path in a graph require that the cost of a path be additive in edge costs, and typically assume that costs are deterministic. We consider the problem of uncertain edge costs, with potential…

Artificial Intelligence · Computer Science 2013-02-21 Michael P. Wellman , Matthew Ford , Kenneth Larson