English
Related papers

Related papers: Manifold-Constrained Energy-Based Transition Model…

200 papers

Reinforcement learning (RL) has shown significant promise for sequential portfolio optimization tasks, such as stock trading, where the objective is to maximize cumulative returns while minimizing risks using historical data. However,…

Machine Learning · Computer Science 2025-05-20 Haochen Yuan , Minting Pan , Yunbo Wang , Siyu Gao , Philip S. Yu , Xiaokang Yang

Energy-based models (EBMs) are known in the Machine Learning community for decades. Since the seminal works devoted to EBMs dating back to the noughties, there have been a lot of efficient methods which solve the generative modelling…

Machine Learning · Computer Science 2024-03-19 Petr Mokrov , Alexander Korotin , Alexander Kolesov , Nikita Gushchin , Evgeny Burnaev

In this paper, we propose a learning-based Model Predictive Control (MPC) approach for the polytopic Linear Parameter-Varying (LPV) systems with inexact scheduling parameters (as exogenous signals with inexact bounds), where the Linear Time…

Systems and Control · Electrical Eng. & Systems 2022-06-13 Hossein Nejatbakhsh Esfahani , Sebastien Gros

This work, based on Random Matrix Theory (RMT), introduces a novel early-stopping strategy for Transformer training dynamics. Utilizing the Power Law (PL) fit to tansformer attention matrices as a probe, we demarcate training into three…

Machine Learning · Computer Science 2025-12-30 Jing He , Hua Jiang , Cheng Li , Siqian Xin , Shuzhen Yang

We build a profitable electronic trading agent with Reinforcement Learning that places buy and sell orders in the stock market. An environment model is built only with historical observational data, and the RL agent learns the trading…

Artificial Intelligence · Computer Science 2019-10-10 Haoran Wei , Yuanbo Wang , Lidia Mangu , Keith Decker

Most offline reinforcement learning (RL) algorithms return a target policy maximizing a trade-off between (1) the expected performance gain over the behavior policy that collected the dataset, and (2) the risk stemming from the…

Machine Learning · Computer Science 2023-06-23 Zhang-Wei Hong , Pulkit Agrawal , Rémi Tachet des Combes , Romain Laroche

Reinforcement learning-based (RL-based) energy management strategy (EMS) is considered a promising solution for the energy management of electric vehicles with multiple power sources. It has been shown to outperform conventional methods in…

Artificial Intelligence · Computer Science 2022-12-20 Jincheng Hu , Yang Lin , Jihao Li , Zhuoran Hou , Dezong Zhao , Quan Zhou , Jingjing Jiang , Yuanjian Zhang

Natural data observed in $\mathbb{R}^n$ is often constrained to an $m$-dimensional manifold $\mathcal{M}$, where $m < n$. This work focuses on the task of building theoretically principled generative models for such data. Current generative…

Machine Learning · Statistics 2023-12-25 Brendan Leigh Ross , Gabriel Loaiza-Ganem , Anthony L. Caterini , Jesse C. Cresswell

MDPs with low-rank transitions -- that is, the transition matrix can be factored into the product of two matrices, left and right -- is a highly representative structure that enables tractable learning. The left matrix enables expressive…

Machine Learning · Computer Science 2023-02-07 Audrey Huang , Jinglin Chen , Nan Jiang

In recent years, multi-access edge computing (MEC) is a key enabler for handling the massive expansion of Internet of Things (IoT) applications and services. However, energy consumption of a MEC network depends on volatile tasks that…

Physics and Society · Physics 2021-01-07 Md. Shirajum Munir , Sarder Fakhrul Abedin , Nguyen H. Tran , Zhu Han , Eui-Nam Huh , Choong Seon Hong

Model Predictive Control (MPC) is a state-of-the-art (SOTA) control technique which requires solving hard constrained optimization problems iteratively. For uncertain dynamics, analytical model based robust MPC imposes additional…

Robotics · Computer Science 2023-02-27 Sourav Sanyal , Kaushik Roy

Many existing studies have achieved significant improvements in the reasoning capabilities of large language models (LLMs) through reinforcement learning with verifiable rewards (RLVR), while the enhancement of reasoning abilities in small…

Machine Learning · Computer Science 2025-08-26 Zhong Guan , Likang Wu , Hongke Zhao , Jiahui Wang , Le Wu

A long-standing goal in AI is to develop agents capable of solving diverse tasks across a range of environments, including those never seen during training. Two dominant paradigms address this challenge: (i) reinforcement learning (RL),…

Machine Learning · Computer Science 2025-10-30 Vlad Sobal , Wancong Zhang , Kyunghyun Cho , Randall Balestriero , Tim G. J. Rudner , Yann LeCun

Latent-variable energy-based models (LVEBMs) assign a single normalized energy to joint pairs of observed data and latent variables, offering expressive generative modeling while capturing hidden structure. We recast maximum-likelihood…

Machine Learning · Computer Science 2025-10-20 Shiqin Tang , Shuxin Zhuang , Rong Feng , Runsheng Yu , Hongzong Li , Youzhi Zhang

We study model-based reinforcement learning (RL) for episodic Markov decision processes (MDP) whose transition probability is parametrized by an unknown transition core with features of state and action. Despite much recent progress in…

Machine Learning · Statistics 2024-11-19 Taehyun Hwang , Min-hwan Oh

We propose learning via retracing, a novel self-supervised approach for learning the state representation (and the associated dynamics model) for reinforcement learning tasks. In addition to the predictive (reconstruction) supervision in…

Machine Learning · Computer Science 2022-09-26 Changmin Yu , Dong Li , Jianye Hao , Jun Wang , Neil Burgess

Event-triggered model predictive control (eMPC) is a popular optimal control method with an aim to alleviate the computation and/or communication burden of MPC. However, it generally requires priori knowledge of the closed-loop system…

Robotics · Computer Science 2022-08-23 Fengying Dang , Dong Chen , Jun Chen , Zhaojian Li

Reinforcement learning usually assumes a given or sometimes even fixed environment in which an agent seeks an optimal policy to maximize its long-term discounted reward. In contrast, we consider agents that are not limited to passive…

Machine Learning · Computer Science 2025-10-20 Ziqing Lu , Babak Hassibi , Lifeng Lai , Weiyu Xu

Deep latent variable models have achieved significant empirical successes in model-based reinforcement learning (RL) due to their expressiveness in modeling complex transition dynamics. On the other hand, it remains unclear theoretically…

Machine Learning · Computer Science 2023-03-08 Tongzheng Ren , Chenjun Xiao , Tianjun Zhang , Na Li , Zhaoran Wang , Sujay Sanghavi , Dale Schuurmans , Bo Dai

Simulations of laser-induced electron dynamics in a molecular system are performed using time-dependent (TD) equation-of-motion (EOM) coupled-cluster (CC) theory. The target system has been chosen to highlight potential shortcomings of…

Chemical Physics · Physics 2023-08-09 Stephen H. Yuwono , Brandon C. Cooper , Tianyuan Zhang , Xiaosong Li , A. Eugene DePrince