English
Related papers

Related papers: On Persistently Resetting Learning Integrators: A …

200 papers

Sequence prediction models can be learned from example sequences with a variety of training algorithms. Maximum likelihood learning is simple and efficient, yet can suffer from compounding error at test time. Reinforcement learning such as…

Machine Learning · Computer Science 2019-07-02 Bowen Tan , Zhiting Hu , Zichao Yang , Ruslan Salakhutdinov , Eric Xing

With the excellent representation capabilities of Pre-Trained Models (PTMs), remarkable progress has been made in non-rehearsal Class-Incremental Learning (CIL) research. However, it remains an extremely challenging task due to three…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jiawei Zhan , Jun Liu , Jinlong Peng , Xiaochen Chen , Bin-Bin Gao , Yong Liu , Chengjie Wang

Federated Learning is a powerful machine learning paradigm to cooperatively train a global model with highly distributed data. A major bottleneck on the performance of distributed Stochastic Gradient Descent (SGD) algorithm for large-scale…

Machine Learning · Computer Science 2020-01-24 Haozhao Wang , Zhihao Qu , Song Guo , Xin Gao , Ruixuan Li , Baoliu Ye

We consider the problem of discounted optimal state-feedback regulation for general unknown deterministic discrete-time systems. It is well known that open-loop instability of systems, non-quadratic cost functions and complex nonlinear…

Systems and Control · Electrical Eng. & Systems 2020-03-31 Alexandros Tanzanakis , John Lygeros

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

This paper deals with the problem of robust dynamic output feedback stabilization of interval fractional-order linear time invariant (FO-LTI) systems with the fractional order $1\le\alpha<2$. In this study, a new formulation based on the…

Systems and Control · Electrical Eng. & Systems 2020-04-02 Pouya Badri , Mahdi Sojoodi

We formulate the predicted-updates dynamic model, one of the first beyond-worst-case models for dynamic algorithms, which generalizes a large set of well-studied dynamic models including the offline dynamic, incremental, and decremental…

Data Structures and Algorithms · Computer Science 2023-11-29 Quanquan C. Liu , Vaidehi Srinivas

Sequential learning systems are used in a wide variety of problems from decision making to optimization, where they provide a 'belief' (opinion) to nature, and then update this belief based on the feedback (result) to minimize (or maximize)…

Machine Learning · Computer Science 2020-09-22 Kaan Gokcesu , Hakan Gokcesu

Optimal tracking of continuous time nonlinear systems has been extensively studied in literature. However, in several applications, absence of knowledge about system dynamics poses a severe challenge to solving the optimal tracking problem.…

Systems and Control · Electrical Eng. & Systems 2020-01-22 Amardeep Mishra , Satadal Ghosh

Reinforcement learning has been applied in operation research and has shown promise in solving large combinatorial optimization problems. However, existing works focus on developing neural network architectures for certain problems. These…

Optimization and Control · Mathematics 2023-03-24 Ching Pui Wan , Tung Li , Jason Min Wang

AI alignment in the shape of Reinforcement Learning from Human Feedback (RLHF) is increasingly treated as a crucial ingredient for high performance large language models. Proximal Policy Optimization (PPO) has been positioned by recent…

Post-training for large language models (LLMs) is constrained by the high cost of acquiring new knowledge or correcting errors and by the unintended side effects that frequently arise from retraining. To address these issues, we introduce…

Computation and Language · Computer Science 2026-02-11 Yisu Wang , Ming Wang , Haoyuan Song , Wenjie Huang , Chaozheng Wang , Yi Xie , Xuming Ran

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

This paper develops an algorithmic framework for real-time optimization of distribution-level distributed energy resources (DERs). The proposed framework optimizes the operation of both DERs that are individually controllable and groups of…

Optimization and Control · Mathematics 2019-02-28 Andrey Bernstein , Emiliano Dall'Anese

Reinforcement Learning (RL) for training Large Language Models is notoriously unstable. While recent studies attribute this to "training inference mismatch stemming" from inconsistent hybrid engines, standard remedies, such as Importance…

Machine Learning · Computer Science 2026-02-03 Yaxiang Zhang , Yingru Li , Jiacai Liu , Jiawei Xu , Ziniu Li , Qian Liu , Haoyuan Li

Offline inverse reinforcement learning (Offline IRL) aims to recover the structure of rewards and environment dynamics that underlie observed actions in a fixed, finite set of demonstrations from an expert agent. Accurate models of…

Machine Learning · Computer Science 2024-03-01 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

Modern retrieval pipelines increasingly rely on query reformulation and neural reranking to improve effectiveness, but this comes at a significant computational cost and introduces a fundamental tradeoff between recall and query drift.…

Information Retrieval · Computer Science 2026-05-04 V Venktesh , Mandeep Rathee , Avishek Anand

In this article, we employ physics-informed residual learning (PIRL) and propose a pricing method for European options under a regime-switching framework, where closed-form solutions are not available. We demonstrate that the proposed…

Computational Finance · Quantitative Finance 2024-10-15 Naman Krishna Pande , Puneet Pasricha , Arun Kumar , Arvind Kumar Gupta

In this paper, the inverse reinforcement learning (IRL) problem is addressed to reconstruct the unknown cost function underlying an observed optimal policy in a model-free manner, whose online adaptation with completely off-policy system…

Optimization and Control · Mathematics 2025-11-20 Yibei Li , Yuexin Cao , Zhixin Liu , Lihua Xie

We propose a technique for reformulation of state and parameter estimation problems as that of matching explicitly computable definite integrals with known kernels to data. The technique applies for a class of systems of nonlinear ordinary…

Optimization and Control · Mathematics 2013-09-11 I. Yu. Tyukin , A. N. Gorban