中文
相关论文

相关论文: Efficient Morphology-Control Co-Design via Stackel…

200 篇论文

Soft robots have gained significant attention due to their flexibility and safety, particularly in human-centric applications. The co-design of structure and controller in soft robotics has presented a longstanding challenge owing to the…

计算工程、金融与科学 · 计算机科学 2024-07-15 Yuki Sato , Changyoung Yuhn , Hiroki Kobayashi , Atsushi Kawamoto , Tsuyoshi Nomura

Reaching tasks with random targets and obstacles is a challenging task for robotic manipulators. In this study, we propose a novel model-free reinforcement learning approach based on proximal policy optimization (PPO) for training a deep…

机器人学 · 计算机科学 2023-02-10 Yongliang Wang , Hamidreza Kasaei

Model-based reinforcement learning approaches carry the promise of being data efficient. However, due to challenges in learning dynamics models that sufficiently match the real-world dynamics, they struggle to achieve the same asymptotic…

机器学习 · 计算机科学 2018-09-17 Ignasi Clavera , Jonas Rothfuss , John Schulman , Yasuhiro Fujita , Tamim Asfour , Pieter Abbeel

This paper presents Post-Decision Proximal Policy Optimization (PDPPO), a novel variation of the leading deep reinforcement learning method, Proximal Policy Optimization (PPO). The PDPPO state transition process is divided into two steps: a…

This study proposes a delay-compensated feedback controller based on proximal policy optimization (PPO) reinforcement learning to stabilize traffic flow in the congested regime by manipulating the time-gap of adaptive cruise…

人工智能 · 计算机科学 2023-01-18 Shurong Mo , Nailong Wu , Jie Qi , Anqi Pan , Zhiguang Feng , Huaicheng Yan , Yueying Wang

Large Language Models (LLMs) can acquire extensive world knowledge through pre-training on large corpora. However, due to exposure to low-quality data, LLMs may exhibit harmful behavior without aligning with human values. The dominant…

机器学习 · 计算机科学 2023-10-11 Tianhao Wu , Banghua Zhu , Ruoyu Zhang , Zhaojin Wen , Kannan Ramchandran , Jiantao Jiao

This paper addresses the challenge of edge caching in dynamic environments, where rising traffic loads strain backhaul links and core networks. We propose a Proximal Policy Optimization (PPO)-based caching strategy that fully incorporates…

网络与互联网体系结构 · 计算机科学 2024-11-18 Farnaz Niknia , Ping Wang

Reinforcement Learning (RL) has made significant strides in various domains, and policy gradient methods like Proximal Policy Optimization (PPO) have gained popularity due to their balance in performance, training stability, and…

机器学习 · 计算机科学 2025-05-21 Andrei Cozma , Landon Harris , Hairong Qi

We investigate a co-design problem, encompassing simultaneous design of system infrastructure and control, through a game-theoretical framework. To this end, we propose the co-design problem as a two-layer hierarchical strategic…

系统与控制 · 电气工程与系统科学 2025-08-18 Julian Barreiro-Gomez , Ye Wang

Policy optimization methods with function approximation are widely used in multi-agent reinforcement learning. However, it remains elusive how to design such algorithms with statistical guarantees. Leveraging a multi-agent performance…

机器学习 · 计算机科学 2023-05-09 Yulai Zhao , Zhuoran Yang , Zhaoran Wang , Jason D. Lee

For many applications of reinforcement learning it can be more convenient to specify both a reward function and constraints, rather than trying to design behavior through the reward function. For example, systems that physically interact…

机器学习 · 计算机科学 2017-05-31 Joshua Achiam , David Held , Aviv Tamar , Pieter Abbeel

Robots operating in the real world will experience a range of different environments and tasks. It is essential for the robot to have the ability to adapt to its surroundings to work efficiently in changing conditions. Evolutionary robotics…

机器人学 · 计算机科学 2020-10-21 Tønnes F. Nygaard , Charles P. Martin , David Howard , Jim Torresen , Kyrre Glette

Design requirements for moving parts in mechanical assemblies are typically specified in terms of interactions with other parts. Some are purely kinematic (e.g., pairwise collision avoidance) while others depend on physics and material…

机器人学 · 计算机科学 2025-04-02 Amir M. Mirzendehdel , Morad Behandish

Model-free reinforcement learning algorithms have seen remarkable progress, but key challenges remain. Trust Region Policy Optimization (TRPO) is known for ensuring monotonic policy improvement through conservative updates within a trust…

机器学习 · 计算机科学 2025-07-29 Zhengpeng Xie , Qiang Zhang , Fan Yang , Marco Hutter , Renjing Xu

In multi-agent problems requiring a high degree of cooperation, success often depends on the ability of the agents to adapt to each other's behavior. A natural solution concept in such settings is the Stackelberg equilibrium, in which the…

机器学习 · 计算机科学 2024-06-14 Robert Loftin , Mustafa Mert Çelikok , Herke van Hoof , Samuel Kaski , Frans A. Oliehoek

The collective performance or capacity of collaborative autonomous systems such as a swarm of robots is jointly influenced by the morphology and the behavior of individual systems in that collective. In that context, this paper explores how…

机器人学 · 计算机科学 2024-06-25 Prajit KrisshnaKumar , Steve Paul , Hemanth Manjunatha , Mary Corra , Ehsan Esfahani , Souma Chowdhury

Optical proximity correction (OPC) is a vital step to ensure printability in modern VLSI manufacturing. Various OPC approaches based on machine learning have been proposed to pursue performance and efficiency, which are typically…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Xiaoxiao Liang , Haoyu Yang , Kang Liu , Bei Yu , Yuzhe Ma

Synthesizing planning and control policies in robotics is a fundamental task, further complicated by factors such as complex logic specifications and high-dimensional robot dynamics. This paper presents a novel reinforcement learning…

机器人学 · 计算机科学 2023-10-03 Zikang Xiong , Daniel Lawson , Joe Eappen , Ahmed H. Qureshi , Suresh Jagannathan

Numerically computing global policies to optimal control problems for complex dynamical systems is mostly intractable. In consequence, a number of approximation methods have been developed. However, none of the current methods can quantify…

机器人学 · 计算机科学 2021-03-05 Ashwin Khadke , Hartmut Geyer

Deep Reinforcement Learning (DRL) algorithms often require a large amount of data and struggle in sparse-reward domains with long planning horizons and multiple sub-goals. In this paper, we propose a neuro-symbolic extension of Proximal…

人工智能 · 计算机科学 2026-04-29 Simone Murari , Celeste Veronese , Daniele Meli