English
Related papers

Related papers: Speculative Policy Orchestration: A Latency-Resili…

200 papers

Model-free reinforcement learning algorithms have seen remarkable progress, but key challenges remain. Trust Region Policy Optimization (TRPO) is known for ensuring monotonic policy improvement through conservative updates within a trust…

Machine Learning · Computer Science 2025-07-29 Zhengpeng Xie , Qiang Zhang , Fan Yang , Marco Hutter , Renjing Xu

Long-horizon planning for robot manipulation is a challenging problem that requires reasoning about the effects of a sequence of actions on a physical 3D scene. While traditional task planning methods are shown to be effective for…

Robotics · Computer Science 2025-09-08 Kallol Saha , Amber Li , Angela Rodriguez-Izquierdo , Lifan Yu , Ben Eisner , Maxim Likhachev , David Held

Terahertz communication networks and intelligent reflecting surfaces exhibit significant potential in advancing wireless networks, particularly within the domain of aerial-based multi-access edge computing systems. These technologies enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-20 Jianqiu Wu , Zhongyi Yu , Jianxiong Guo , Zhiqing Tang , Tian Wang , Weijia Jia

AI agents are increasingly deployed in complex, interactive environments, yet their runtime remains a major bottleneck for training, evaluation, and real-world use. Typical agent behavior unfolds sequentially, with each action requiring an…

Artificial Intelligence · Computer Science 2026-04-24 Naimeng Ye , Arnav Ahuja , Georgios Liargkovas , Yunan Lu , Kostis Kaffes , Tianyi Peng

Large Language Models (LLMs), as the foundational architecture for next-generation interactive AI applications, not only power intelligent dialogue systems but also drive the evolution of embodied intelligence on edge devices, including…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-19 Will Chow

Agentic AI systems capable of autonomous planning and extended environmental interaction pose a fundamental control problem: how can humans maintain meaningful oversight of systems that may exceed their own capabilities? Existing approaches…

Artificial Intelligence · Computer Science 2026-05-28 William Overman , Mohsen Bayati

Constrained devices in IoT networks often require to outsource resource-heavy computations or data processing tasks. Currently, most of those jobs are done in the centralised cloud. However, with rapidly increasing number of devices and…

Cryptography and Security · Computer Science 2018-07-18 Michał Król , Ioannis Psaras

RL-based post-training of language models is almost exclusively done using on-policy methods such as PPO. These methods cannot learn from arbitrary sequences such as those produced earlier in training, in earlier runs, by human experts or…

Machine Learning · Computer Science 2025-03-10 Taco Cohen , David W. Zhang , Kunhao Zheng , Yunhao Tang , Remi Munos , Gabriel Synnaeve

Safe exploration is a key to applying reinforcement learning (RL) in safety-critical systems. Existing safe exploration methods guaranteed safety under the assumption of regularity, and it has been difficult to apply them to large-scale…

Machine Learning · Computer Science 2021-11-10 Akifumi Wachi , Yunyue Wei , Yanan Sui

We study an extension of contextual stochastic linear optimization (CSLO) that, in contrast to most of the existing literature, involves inequality constraints that depend on uncertain parameters predicted by a machine learning model. To…

Machine Learning · Computer Science 2025-05-30 Hyungki Im , Wyame Benslimane , Paul Grigas

In this paper we analyze the effect of two modelling approaches for supply planning problems under uncertainty: two-stage stochastic programming (SP) and robust optimization (RO). The comparison between the two approaches is performed…

Optimization and Control · Mathematics 2016-11-22 Francesca Maggioni , Florian Potra , Marida Bertocchi

Vision-centric hierarchical embodied models have demonstrated strong potential. However, existing methods lack spatial awareness capabilities, limiting their effectiveness in bridging visual plans to actionable control in complex…

Robotics · Computer Science 2025-11-19 Yijun Liu , Yuwei Liu , Yuan Meng , Jieheng Zhang , Yuwei Zhou , Ye Li , Jiacheng Jiang , Kangye Ji , Shijia Ge , Zhi Wang , Wenwu Zhu

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

Machine Learning · Computer Science 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

Robot manipulators operating in uncertain and non-convex environments present significant challenges for safe and optimal motion planning. Existing methods often struggle to provide efficient and formally certified collision risk…

Robotics · Computer Science 2026-03-11 Fei Meng , Zijiang Yang , Xinyu Mao , Haobo Liang , Max Q. -H. Meng

In this paper, a sampling-based Stochastic Model Predictive Control algorithm is proposed for discrete-time linear systems subject to both parametric uncertainties and additive disturbances. One of the main drivers for the development of…

Edge computing decentralizes computing resources, allowing for novel applications in domains such as the Internet of Things (IoT) in healthcare and agriculture by reducing latency and improving performance. This decentralization is achieved…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-17 Suhrid Gupta , Muhammed Tawfiqul Islam , Rajkumar Buyya

This paper introduces SmartBSP, an advanced self-supervised learning framework for real-time path planning and obstacle avoidance in autonomous robotics navigating through complex environments. The proposed system integrates Proximal Policy…

Robotics · Computer Science 2025-09-03 Shahab Shokouhi , Oguzhan Oruc , May-Win Thein

Safe reinforcement learning (safe RL) aims to respect safety requirements while optimizing long-term performance. In many practical applications, however, the problem involves an infinite number of constraints, known as semi-infinite safe…

Machine Learning · Computer Science 2025-11-07 Jiaming Zhang , Yujie Yang , Haoning Wang , Liping Zhang , Shengbo Eben Li

Mixture-of-Experts (MoE) models enable scalable performance but face severe memory constraints on edge devices. Existing offloading strategies struggle with I/O bottlenecks due to the dynamic, low-information nature of autoregressive expert…

Machine Learning · Computer Science 2026-03-12 Shuhuai Li , Jianghao Lin , Dongdong Ge , Yinyu Ye

For autonomous driving in highly dynamic environments, it is anticipated to predict the future behaviors of surrounding vehicles (SVs) and make safe and effective decisions. However, modeling the inherent coupling effect between the…

Robotics · Computer Science 2024-08-07 Xiao Zhou , Chengzhen Meng , Wenru Liu , Zengqi Peng , Ming Liu , Jun Ma