English
Related papers

Related papers: On Persistently Resetting Learning Integrators: A …

200 papers

We introduce SIRI, Scaling Iterative Reinforcement Learning with Interleaved Compression, a simple yet effective RL approach for Large Reasoning Models (LRMs) that enables more efficient and accurate reasoning. Existing studies have…

Machine Learning · Computer Science 2025-09-30 Haoming Wen , Yushi Bai , Juanzi Li , Jie Tang

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

This paper introduces an interactive continual learning paradigm where AI models dynamically learn new skills from real-time human feedback while retaining prior knowledge. This paradigm distinctively addresses two major limitations of…

Machine Learning · Computer Science 2025-05-16 Yutao Yang , Jie Zhou , Junsong Li , Qianjun Pan , Bihao Zhan , Qin Chen , Xipeng Qiu , Liang He

Large language models (LLMs) have become increasingly capable of following instructions and complex reasoning, making prompting a flexible interface for adapting models without parameter updates. Yet prompt design remains labor-intensive…

Computation and Language · Computer Science 2026-05-22 Farima Fatahi Bayat , Moin Aminnaseri , Pouya Pezeshkpour , Estevam Hruschka

We study the potential of using large language models (LLMs) as an interactive optimizer for solving maximization problems in a text space using natural language and numerical feedback. Inspired by the classical optimization literature, we…

Artificial Intelligence · Computer Science 2024-06-21 Allen Nie , Ching-An Cheng , Andrey Kolobov , Adith Swaminathan

Training large language models (LLMs) typically involves pre-training on massive corpora, only to restart the process entirely when new data becomes available. A more efficient and resource-conserving approach would be continual…

Recent advancements in LLM post-training, particularly through reinforcement learning and preference optimization, are key to boosting their reasoning capabilities. However, these methods often suffer from low sample efficiency and a…

Machine Learning · Computer Science 2026-05-08 Zichuan Liu , Jinyu Wang , Lei Song , Jiang Bian

We propose HIN-LRI, a hybrid framework that augments a classical numerical solver with a neural operator trained to correct the solver's structured truncation error. A base low-regularity integrator provides a consistent first-order…

Machine Learning · Computer Science 2026-05-07 Zhangyong Liang

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the…

Machine Learning · Computer Science 2020-06-11 Quentin Berthet , Mathieu Blondel , Olivier Teboul , Marco Cuturi , Jean-Philippe Vert , Francis Bach

Rule-based models, e.g., decision trees, are widely used in scenarios demanding high model interpretability for their transparent inner structures and good model expressivity. However, rule-based models are hard to optimize, especially on…

Machine Learning · Computer Science 2024-01-31 Zhuo Wang , Wei Zhang , Ning Liu , Jianyong Wang

Incremental processing allows interactive systems to respond based on partial inputs, which is a desirable property e.g. in dialogue agents. The currently popular Transformer architecture inherently processes sequences as a whole,…

Computation and Language · Computer Science 2024-05-03 Patrick Kahardipraja , Brielen Madureira , David Schlangen

This paper develops a sequential-linearization feedback optimization framework for driving nonlinear dynamical systems to an optimal steady state. A fundamental challenge in feedback optimization is the requirement of accurate first-order…

Optimization and Control · Mathematics 2025-07-22 Shijie Huang , Sergio Grammatico

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

This paper develops a persistently exciting input generating Online Feedback Optimization (OFO) controller that estimates the sensitivity of a process ensuring minimal deviations from the descent direction while converging. This eliminates…

Systems and Control · Electrical Eng. & Systems 2025-05-27 Tore Gude , Marta Anna Zagorowska , Lars Struen Imsland

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

Artificial Intelligence · Computer Science 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram

Visual coverage path planning with unmanned aerial vehicles (UAVs) requires agents to strategically coordinate UAV motion and camera control to maximize coverage, minimize redundancy, and maintain battery efficiency. Traditional…

Robotics · Computer Science 2025-07-15 Venkat Margapuri

By absorbing the merits of both the model- and data-driven methods, deep physics-engaged learning scheme achieves high-accuracy and interpretable image reconstruction. It has attracted growing attention and become the mainstream for inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Bin Chen , Jiechong Song , Jingfen Xie , Jian Zhang

Planar pushing remains a challenging research topic, where building the dynamic model of the interaction is the core issue. Even an accurate analytical dynamic model is inherently unstable because physics parameters such as inertia and…

Robotics · Computer Science 2020-07-28 Lin Cong , Michael Görner , Philipp Ruppel , Hongzhuo Liang , Norman Hendrich , Jianwei Zhang

We study the use of large language models (LLMs) for physics instrument design and compare their performance to reinforcement learning (RL). Using only prompting, LLMs are given task constraints and summaries of prior high-scoring designs…

Instrumentation and Detectors · Physics 2026-01-13 Sara Zoccheddu , Shah Rukh Qasim , Patrick Owen , Nicola Serra

The current technology landscape lacks a foundational AI model for solving process engineering calculations. In this work, we introduce a novel autonomous agent framework leveraging Retrieval-Augmented Instruction-Tuning (RAIT) to enhance…

Software Engineering · Computer Science 2024-08-29 Sagar Srinivas Sakhinana , Geethan Sannidhi , Venkataramana Runkana