中文
相关论文

相关论文: Massively Scaling Explicit Policy-conditioned Valu…

200 篇论文

We study the problem of learning optimal policies in finite-horizon Markov Decision Processes (MDPs) using low-rank reinforcement learning (RL) methods. In finite-horizon MDPs, the policies, and therefore the value functions (VFs) are not…

机器学习 · 计算机科学 2026-05-14 Sergio Rozada , Jose Luis Orejuela , Antonio G. Marques

Current advanced policy learning methodologies have demonstrated the ability to develop expert-level strategies when provided enough information. However, their requirements, including task-specific rewards, action-labeled expert…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Xin Liu , Yaran Chen , Haoran Li

Value functions are central to Dynamic Programming and Reinforcement Learning but their exact estimation suffers from the curse of dimensionality, challenging the development of practical value-function (VF) estimation algorithms. Several…

人工智能 · 计算机科学 2021-04-20 Sergio Rozada , Victor Tenorio , Antonio G. Marques

Vision-Language-Action models have recently emerged as a powerful paradigm for general-purpose robot learning, enabling agents to map visual observations and natural-language instructions into executable robotic actions. Though popular,…

Parameter adaptation, that is the capability to automatically adjust an algorithm's hyperparameters depending on the problem being faced, is one of the main trends in evolutionary computation applied to numerical optimization. While several…

神经与进化计算 · 计算机科学 2022-06-30 Michele Tessari , Giovanni Iacca

The ability to efficiently and reliably learn new tasks has been a foundational challenge in robotics. Vision-Language-Action (VLA) models have demonstrated strong generalization across diverse manipulation tasks, yet pretrained policies…

机器人学 · 计算机科学 2026-05-26 Perry Dong , Kuo-Han Hung , Tian Gao , Dorsa Sadigh , Chelsea Finn

We propose a method for designing policies for convex stochastic control problems characterized by random linear dynamics and convex stage cost. We consider policies that employ quadratic approximate value functions as a substitute for the…

最优化与控制 · 数学 2023-11-10 Alan Yang , Stephen Boyd

The entry of large language models (LLMs) into research and commercial spaces has led to a trend of ever-larger models, with initial promises of generalisability, followed by a widespread desire to downsize and create specialised models…

Deploying deep reinforcement learning in safety-critical settings requires developing algorithms that obey hard constraints during exploration. This paper contributes a first approach toward enforcing formal safety constraints on end-to-end…

人工智能 · 计算机科学 2020-07-03 Nathan Hunt , Nathan Fulton , Sara Magliacane , Nghia Hoang , Subhro Das , Armando Solar-Lezama

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective…

机器学习 · 计算机科学 2025-10-24 Jacob L. Block , Sundararajan Srinivasan , Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

While Reinforcement Learning (RL) agents can successfully learn to handle complex tasks, effectively generalizing acquired skills to unfamiliar settings remains a challenge. One of the reasons behind this is the visual encoders used are…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Yuhan Zhang , Guoqing Ma , Guangfu Hao , Liangxuan Guo , Yang Chen , Shan Yu

In reinforcement learning, two objective functions have been developed extensively in the literature: discounted and averaged rewards. The generalization to an entropy-regularized setting has led to improved robustness and exploration for…

机器学习 · 计算机科学 2025-01-20 Jacob Adamczyk , Volodymyr Makarenko , Stas Tiomkin , Rahul V. Kulkarni

We propose a new sample-efficient methodology, called Supervised Policy Update (SPU), for deep reinforcement learning. Starting with data generated by the current policy, SPU formulates and solves a constrained optimization problem in the…

机器学习 · 计算机科学 2018-12-27 Quan Vuong , Yiming Zhang , Keith W. Ross

Data scaling has revolutionized research fields like natural language processing, computer vision, and robotics control, providing foundation models with remarkable multi-task and generalization capabilities. In this paper, we investigate…

系统与控制 · 电气工程与系统科学 2025-03-27 Shaohuai Liu , Lin Dong , Chao Tian , Le Xie

Recently, foundation models such as OpenAI's O1 and O3, along with DeepSeek's R1, have demonstrated strong reasoning capacities and problem-solving skills acquired through large-scale reinforcement learning (RL), with wide applications in…

机器学习 · 计算机科学 2025-04-29 Tianbing Xu

Deep Reinforcement Learning (DRL) algorithms have been successfully applied to a range of challenging control tasks. However, these methods typically suffer from three core difficulties: temporal credit assignment with sparse rewards, lack…

机器学习 · 计算机科学 2018-10-30 Shauharda Khadka , Kagan Tumer

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

机器人学 · 计算机科学 2024-04-03 Dong Wang , Giovanni Beltrame

The past decade has seen a rapid penetration of electric vehicles (EV) in the market, more and more logistics and transportation companies start to deploy EVs for service provision. In order to model the operations of a commercial EV fleet,…

机器学习 · 计算机科学 2021-08-24 Bo Lin , Bissan Ghaddar , Jatin Nathwani

Despite extreme sample inefficiency, on-policy reinforcement learning, aka policy gradients, has become a fundamental tool in decision-making problems. With the recent advances in GPU-driven simulation, the ability to collect large amounts…

机器学习 · 计算机科学 2024-07-30 Jayesh Singla , Ananye Agarwal , Deepak Pathak

In the forthcoming era of 6G networks, characterized by unprecedented data rates, ultra-low latency, and ubiquitous connectivity, effective management of Virtualized Network Functions (VNFs) is essential. VNFs are software-based…

网络与互联网体系结构 · 计算机科学 2026-05-01 Cyril Shih-Huan Hsu , Anestis Dalgkitsis , Chrysa Papagianni , Paola Grosso