English
Related papers

Related papers: State-space models through the lens of ensemble co…

200 papers

This paper applies the Method of Successive Approximations (MSA) based on Pontryagin's principle to solve optimal control problems with state constraints for semilinear parabolic equations. Error estimates for the first and second…

Optimization and Control · Mathematics 2025-01-23 Weilong You , Fu Zhang

Stochastic Optimal Control Problems (SOCPs) plays a major role in the sequential decision-making challenges. There exist various iterative algorithms, under framework of stochastic maximum principle, that sequentially find the optimal…

Optimization and Control · Mathematics 2026-03-17 Mohsen Amidzadeh

In this paper the optimal control of alignment models composed by a large number of agents is investigated in presence of a selective action of a controller, acting in order to enhance consensus. Two types of selective controls have been…

Optimization and Control · Mathematics 2016-10-06 Giacomo Albi , Lorenzo Pareschi

The principle of optimality is a fundamental aspect of dynamic programming, which states that the optimal solution to a dynamic optimization problem can be found by combining the optimal solutions to its sub-problems. While this principle…

Optimization and Control · Mathematics 2024-08-14 Bar Light

Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In…

Machine Learning · Computer Science 2019-10-24 Aditya Modi , Nan Jiang , Ambuj Tewari , Satinder Singh

This work establishes two versions of the Pontryagin-type maximum principles for partially observed optimal control of coupled forward stochastic partial differential equations (FSPDEs) and backward stochastic differential equations (BSDEs)…

Optimization and Control · Mathematics 2026-03-03 Hongjiang Qian , George Yin , Yanzhao Cao , Guannan Zhang

This work explores the in-context learning capabilities of State Space Models (SSMs) and presents, to the best of our knowledge, the first theoretical explanation of a possible underlying mechanism. We introduce a novel weight construction…

Machine Learning · Computer Science 2025-08-05 Federico Arangath Joseph , Kilian Konstantin Haefeli , Noah Liniger , Caglar Gulcehre

To analyze high-dimensional systems, many fields in science and engineering rely on high-level descriptions, sometimes called "macrostates," "coarse-grainings," or "effective theories". Examples of such descriptions include the…

Information Theory · Computer Science 2015-06-19 David H. Wolpert , Joshua A. Grochow , Eric Libby , Simon DeDeo

We develop a general theoretical framework for optimal probability density control on standard measure spaces, aimed at addressing large-scale multi-agent control problems. In particular, we establish a maximum principle (MP) for control…

Optimization and Control · Mathematics 2026-03-10 Nathan Gaby , Xiaojing Ye

Stochastic maximum principle (SMP) specifies a necessary condition for the solution of a stochastic optimal control problem. The condition involves a coupled system of forward and backward stochastic differential equations (FBSDE) for the…

Systems and Control · Electrical Eng. & Systems 2024-03-05 Amirhossein Taghvaei

We derive first-order Pontryagin optimality conditions for stochastic optimal control with deterministic controls for systems modeled by rough differential equations (RDE) driven by Gaussian rough paths. This Pontryagin Maximum Principle…

Optimization and Control · Mathematics 2025-10-07 Thomas Lew

A high-performance image compression algorithm is crucial for real-time information transmission across numerous fields. Despite rapid progress in image compression, computational inefficiency and poor redundancy modeling still pose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Fanhu Zeng , Hao Tang , Yihua Shao , Siyu Chen , Ling Shao , Yan Wang

In this work, we study the stochastic optimal control problem (SOC) mainly from the probabilistic view point, i.e. via the Stochastic Maximum principle (SMP) \cite{Peng4}. We adopt the sample-wise backpropagation scheme proposed in…

Optimization and Control · Mathematics 2025-06-17 Hui Sun , Feng Bao

We consider a class of sequential decision-making problems under uncertainty that can encompass various types of supervised learning concepts. These problems have a completely observed state process and a partially observed modulation…

Optimization and Control · Mathematics 2021-08-24 R. Reid Bishop , Chelsea C. White

Modeling how a robot interacts with the environment around it is an important prerequisite for designing control and planning algorithms. In fact, the performance of controllers and planners is highly dependent on the quality of the model.…

Machine Learning · Computer Science 2020-03-03 Clark Zhang , Arbaaz Khan , Santiago Paternain , Alejandro Ribeiro

State-space models (SSMs) have recently emerged as a compelling alternative to Transformers for sequence modeling tasks. This paper presents a theoretical generalization analysis of selective SSMs, the core architectural component behind…

Machine Learning · Computer Science 2025-11-05 Arya Honarpisheh , Mustafa Bozdag , Octavia Camps , Mario Sznaier

In this paper we discuss optimality conditions for abstract optimization problems over complex spaces. We then apply these results to optimal control problems with a semigroup structure. As an application we detail the case when the state…

Optimization and Control · Mathematics 2019-01-15 M. Soledad Aronna , Frédéric Bonnans , Axel Kröner

In this paper, we investigate a mean-field singular stochastic optimal control problem for systems governed by mean-field regime-switching singular stochastic differential equations. The state process is assumed to depend on both a regular…

Optimization and Control · Mathematics 2025-12-01 Maalvladédon Ganet Somé , Edward Korveh

State space models (SSMs) have shown remarkable empirical performance on many long sequence modeling tasks, but a theoretical understanding of these models is still lacking. In this work, we study the learning dynamics of linear SSMs to…

Machine Learning · Computer Science 2024-07-11 Jakub Smékal , Jimmy T. H. Smith , Michael Kleinman , Dan Biderman , Scott W. Linderman

Here we derive a nonsmooth maximum principle for optimal control problems with both state and mixed constraints. Crucial to our development is a convexity assumption on the "velocity set". The approach consists of applying known…

Optimization and Control · Mathematics 2013-03-12 Md. Haider Ali Biswas , Maria do Rosario de Pinho