中文
相关论文

相关论文: Compress to Focus: Efficient Coordinate Compressio…

200 篇论文

Proximal policy optimization (PPO) approximates the trust region update using multiple epochs of clipped SGD. Each epoch may drift further from the natural gradient direction, creating path-dependent noise. To understand this drift, we can…

机器学习 · 计算机科学 2026-03-16 Zelal Su , Mustafaoglu , Sungyoung Lee , Eshan Balachandar , Risto Miikkulainen , Keshav Pingali

Proficient game agents with diverse play styles enrich the gaming experience and enhance the replay value of games. However, recent advancements in game AI based on reinforcement learning have predominantly focused on improving proficiency,…

人工智能 · 计算机科学 2025-09-23 Lingfeng Li , Yunlong Lu , Yongyi Wang , Wenxin Li

Understanding visual scenes requires not only recognizing objects but also reasoning about their spatial relationships. Unlike general vision-language tasks, spatial reasoning requires integrating multiple inductive biases, such as 2D…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Chan Yeong Hwang , Miso Choi , Sunghyun On , Jinkyu Kim , Jungbeom Lee

Proximal policy optimization (PPO) is one of the most successful deep reinforcement-learning methods, achieving state-of-the-art performance across a wide range of challenging tasks. However, its optimization behavior is still far from…

机器学习 · 计算机科学 2020-01-15 Yuhui Wang , Hao He , Chao Wen , Xiaoyang Tan

Deep reinforcement learning (RL) uses model-free techniques to optimize task-specific control policies. Despite having emerged as a promising approach for complex problems, RL is still hard to use reliably for real-world applications. Apart…

机器人学 · 计算机科学 2020-02-25 Siddhant Gangapurwala , Alexander Mitchell , Ioannis Havoutis

Using effective generalization capabilities of vision language models (VLMs) in context-specific dynamic tasks for embodied artificial intelligence remains a significant challenge. Although supervised fine-tuned models can better align with…

人工智能 · 计算机科学 2025-09-11 Kechen Jiao , Zhirui Fang , Jiahao Liu , Bei Li , Qifan Wang , Xinyu Liu , Junhao Ruan , Zhongjian Qiao , Yifan Zhu , Yaxin Xu , Jingang Wang , Xiu Li

Lifelong embodied navigation requires agents to accumulate, retain, and exploit spatial-semantic experience across tasks, enabling efficient exploration in novel environments and rapid goal reaching in familiar ones. While object-centric…

机器人学 · 计算机科学 2025-12-29 Botao Ren , Junjun Hu , Xinda Xue , Minghua Luo , Jintao Chen , Haochen Bai , Liangliang You , Mu Xu

This paper presents a novel algorithm for the continuous control of dynamical systems that combines Trajectory Optimization (TO) and Reinforcement Learning (RL) in a single framework. The motivations behind this algorithm are the two main…

Intelligent task placement and management of tasks in large-scale fog platforms is challenging due to the highly volatile nature of modern workload applications and sensitive user requirements of low energy consumption and response time.…

分布式、并行与集群计算 · 计算机科学 2021-07-12 Shreshth Tuli , Shivananda Poojara , Satish N. Srirama , Giuliano Casale , Nicholas R. Jennings

Chain-of-Thought (CoT) prompting has recently shown significant promise across various NLP and computer vision tasks by explicitly generating intermediate reasoning steps. However, we find that reinforcement learning (RL)-based fine-tuned…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Qingyang Yan , Guangyao Chen , Yixiong Zou

Climate-controlled cabins have for decades been standard in vehicles. Model Predictive Controllers (MPCs) have shown promising results in achieving temperature tracking in vehicle cabins and may improve upon model-free control performance.…

系统与控制 · 电气工程与系统科学 2023-10-06 David Stenger , Tim Reuscher , Heike Vallery , Dirk Abel

We propose an optimization-based framework for robust contact-rich manipulation. Recent contact-implicit methods enable online hybrid planning across contact modes, allowing closed-loop manipulation for a given target state and contact…

机器人学 · 计算机科学 2026-05-28 Zhe Zhang , Xingrong Diao , Haoxiang Liang , Han Yang , Bi-Ke Zhu , Dandan Zhang , Jiankun Wang

This paper addresses the challenge of edge caching in dynamic environments, where rising traffic loads strain backhaul links and core networks. We propose a Proximal Policy Optimization (PPO)-based caching strategy that fully incorporates…

网络与互联网体系结构 · 计算机科学 2024-11-18 Farnaz Niknia , Ping Wang

In this work, we show that discretizing action space for continuous control is a simple yet powerful technique for on-policy optimization. The explosion in the number of discrete actions can be efficiently addressed by a policy with…

机器学习 · 计算机科学 2020-03-23 Yunhao Tang , Shipra Agrawal

Enhancing the reasoning capabilities of large language models effectively using reinforcement learning (RL) remains a crucial challenge. Existing approaches primarily adopt two contrasting advantage estimation granularities: token-level…

机器学习 · 计算机科学 2025-10-22 Yiran Guo , Lijie Xu , Jie Liu , Dan Ye , Shuang Qiu

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

机器学习 · 计算机科学 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Multimodal Large Language Models have demonstrated remarkable capabilities in video understanding, yet face prohibitive computational costs and performance degradation from ''context rot'' due to massive visual token redundancy. Existing…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Shida Wang , YongXiang Hua , Zhou Tao , Haoyu Cao , Linli Xu

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

机器学习 · 计算机科学 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

Connected vehicles will change the modes of future transportation management and organization, especially at an intersection without traffic light. Centralized coordination methods globally coordinate vehicles approaching the intersection…

机器人学 · 计算机科学 2021-03-12 Yang Guan , Yangang Ren , Shengbo Eben Li , Qi Sun , Laiquan Luo , Keqiang Li

Graphical user interface (GUI) agents built on vision-language models have emerged as a promising approach to automate human-computer workflows. However, they also face the inefficiency challenge as they process long sequences of…

计算与语言 · 计算机科学 2025-10-02 Kung-Hsiang Huang , Haoyi Qiu , Yutong Dai , Caiming Xiong , Chien-Sheng Wu