English
Related papers

Related papers: Language Generation as Optimal Control: Closed-Loo…

200 papers

This paper mainly establishes the finite-horizon stochastic bounded real lemma, and then solves the $H_{\infty}$ control problem for discrete-time stochastic linear systems defined on the separable Hilbert spaces, thereby unifying the…

Optimization and Control · Mathematics 2026-01-12 Cheng'ao Li , Ting Hou , Weihai Zhang , Feiqi Deng

Despite the remarkable advances in language modeling, current mainstream decoding methods still struggle to generate texts that align with human texts across different aspects. In particular, sampling-based methods produce less-repetitive…

Computation and Language · Computer Science 2024-06-06 Haozhe Ji , Pei Ke , Hongning Wang , Minlie Huang

In this paper, we study representation formulas for finite-horizon optimal control problems with or without state constraints, unifying two different viewpoints: the Lagrangian and dynamic programming (DP) frameworks. In a recent work [1],…

Optimization and Control · Mathematics 2022-11-04 Yeoneung Kim , Insoon Yang

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

Environmental management optimizing a long-run objective is an ergodic control problem whose resolution can be achieved by solving an associated non-local Hamilton-Jacobi-Bellman (HJB) equation having an effective Hamiltonian. Focusing on…

Optimization and Control · Mathematics 2022-05-11 Hidekazu Yoshioka , Motoh Tsujimura , Yuta Yaegashi

This paper is concerned with a stochastic recursive optimal control problem with time delay, where the controlled system is described by a stochastic differential delayed equation (SDDE) and the cost functional is formulated as the solution…

Optimization and Control · Mathematics 2014-08-26 Jingtao Shi , Huanshui Zhang

Controlling the stochastic dynamics of biological populations is a challenge that arises across various biological contexts. However, these dynamics are inherently nonlinear and involve a discrete state space, i.e., the number of molecules,…

Populations and Evolution · Quantitative Biology 2025-10-21 Shuhei A. Horiguchi , Tetsuya J. Kobayashi

We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…

Optimization and Control · Mathematics 2024-04-23 Namkyeong Cho , Yeoneung Kim

Autoregressive models for text sometimes generate repetitive and low-quality output because errors accumulate during the steps of generation. This issue is often attributed to exposure bias - the difference between how a model is trained,…

Computation and Language · Computer Science 2024-03-26 Yizhe Zhang , Jiatao Gu , Zhuofeng Wu , Shuangfei Zhai , Josh Susskind , Navdeep Jaitly

Generating human motion that satisfies customized zero-shot goal functions, enabling applications such as controllable character animation and behavior synthesis for virtual agents, is a critical capability. While current approaches handle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hanchao Liu , Fang-Lue Zhang , Shining Zhang , Tai-Jiang Mu , Shi-Min Hu

This paper investigates the distributed optimal output consensus problem of heterogeneous linear multi-agent systems over weight-unbalanced directed networks. A novel distributed continuous-time state feedback controller is proposed to…

Optimization and Control · Mathematics 2022-09-02 Jin Zhang , Lu Liu , Haibo Ji , Xinghu Wang

This paper investigates the convergence properties of the upwind difference scheme for the Hamilton--Jacobi--Bellman (HJB) equation, a central partial differential equation in optimal control theory. First, assuming the existence of a…

Numerical Analysis · Mathematics 2026-02-05 Daisuke Inoue , Yuji Ito , Takahito Kashiwabara , Norikazu Saito , Hiroaki Yoshida

While large language models (LLMs) have made significant strides in generating coherent and contextually relevant text, they often function as opaque black boxes, trained on vast unlabeled datasets with statistical objectives, lacking an…

Computation and Language · Computer Science 2025-03-03 Yingbing Huang , Deming Chen , Abhishek K. Umrawal

The paper focuses on mean-field type multi-agent control problems with finite state and action spaces where the dynamics and cost structures are symmetric and homogeneous, and are affected by the distribution of the agents. A standard…

Optimization and Control · Mathematics 2025-07-03 Erhan Bayraktar , Ali D. Kara

This paper provides an in-depth examination of the concept of semantic diffusion as a complementary instrument to large language models (LLMs) for design applications. Conventional LLMs and diffusion models fail to induce a convergent,…

Human-Computer Interaction · Computer Science 2025-05-15 Alexander P. Ryjov , Alina A. Egorova

In this manuscript we consider optimal control problems of stochastic differential equations with delays in the state and in the control. First, we prove an equivalent Markovian reformulation on Hilbert spaces of the state equation. Then,…

Optimization and Control · Mathematics 2024-05-20 Filippo de Feo

Optimal control and the associated second-order path-dependent Hamilton-Jacobi-Bellman (PHJB) equation are studied for unbounded functional stochastic evolution systems in Hilbert spaces. The notion of viscosity solution without…

Optimization and Control · Mathematics 2024-02-27 Shanjian Tang , Jianjun Zhou

Large Language Models (LLMs) excel at generating fluent text but struggle to enforce external constraints because they generate tokens sequentially without explicit control mechanisms. GenCP addresses this limitation by combining LLM…

Computation and Language · Computer Science 2025-06-02 Alexandre Bonlarron , Florian Régin , Elisabetta De Maria , Jean-Charles Régin

Controlling the evolution of a many-body stochastic system from a disordered reference state to a structured target ensemble, characterized empirically through samples, arises naturally in non-equilibrium statistical mechanics and…

Statistical Mechanics · Physics 2026-04-10 Haiqian Yang , Vishaal Krishnan , Sumit Sinha , L. Mahadevan

We propose a new framework for generative modeling based on a discrete-time stochastic control formulation of measure transport. Adapting classic results from control theory, we formulate our problem as a linear program whose dual variables…

Machine Learning · Computer Science 2026-05-22 Pablo Moreno-Muñoz , Adrian Müller , Gergely Neu