English
Related papers

Related papers: Speculative Policy Orchestration: A Latency-Resili…

200 papers

Leveraging planning during learning and decision-making is central to the long-term development of intelligent agents. Recent works have successfully combined tree-based search methods and self-play learning mechanisms to this end. However,…

Artificial Intelligence · Computer Science 2024-11-01 Matthew V Macfarlane , Edan Toledo , Donal Byrne , Paul Duckworth , Alexandre Laterre

We present a lightweight and interpretable decision framework for dynamic edge server selection in latency-critical applications that explicitly accounts for tail risk and switching stability. Each candidate server is characterised by…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-24 Mohan Liyanage , Arnova Abdullah , Eldiyar Zhantileuov , Rolf Schuster

Combinatorial optimization assumes that all parameters of the optimization problem, e.g. the weights in the objective function is fixed. Often, these weights are mere estimates and increasingly machine learning techniques are used to for…

Machine Learning · Computer Science 2019-11-25 Jaynta Mandi , Emir Demirović , Peter. J Stuckey , Tias Guns

In this paper, we examine cloud-edge-terminal IoT networks, where edges undertake a range of typical dynamic scheduling tasks. In these IoT networks, a central policy for each task can be constructed at a cloud server. The central policy…

Machine Learning · Computer Science 2023-07-04 Do-Yup Kim , Da-Eun Lee , Ji-Wan Kim , Hyun-Suk Lee

Existing methods for vision-language task planning excel in short-horizon tasks but often fall short in complex, long-horizon planning within dynamic environments. These challenges primarily arise from the difficulty of effectively training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xiwen Liang , Min Lin , Weiqi Ruan , Rongtao Xu , Yuecheng Liu , Jiaqi Chen , Bingqian Lin , Yuzheng Zhuang , Xiaodan Liang

Many real-world analytics problems involve two significant challenges: prediction and optimization. Due to the typically complex nature of each challenge, the standard paradigm is predict-then-optimize. By and large, machine learning tools…

Optimization and Control · Mathematics 2020-11-23 Adam N. Elmachtoub , Paul Grigas

Ubiquitous mobile devices have catalyzed the development of vehicle crowd sensing (VCS). In particular, vehicle sensing systems show great potential in the flexible acquisition of spatio-temporal urban data through built-in sensors under…

Machine Learning · Computer Science 2025-12-01 Xinyu Wang , Yiyang Peng , Wei Ma

Modern edge AI applications increasingly rely on microservice architectures that integrate both AI services and conventional microservices into complex request chains with stringent latency requirements. Effectively orchestrating these…

Networking and Internet Architecture · Computer Science 2026-03-10 Chen Yang , Jin Zheng , Yang Zhuolin , Lai Pan , Zhang Xiao , Hu Menglan , Yin Haiyan

Data-driven approaches to predict-then-optimize decision-making problems seek to mitigate the risk of uncertainty region misspecification in safety-critical settings. Current approaches, however, suffer from considering overly conservative…

Methodology · Statistics 2023-10-17 Yash Patel , Sahana Rayan , Ambuj Tewari

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

Machine Learning · Computer Science 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria

Reinforcement learning (RL) plays an increasingly important role in enhancing the reasoning capabilities of large language models (LLMs), yet stable and performant policy optimization remains challenging. Token-level importance ratios often…

Machine Learning · Computer Science 2025-12-02 Chang Gao , Chujie Zheng , Xiong-Hui Chen , Kai Dang , Shixuan Liu , Bowen Yu , An Yang , Shuai Bai , Jingren Zhou , Junyang Lin

Recently significant progress has been made in vehicle prediction and planning algorithms for autonomous driving. However, it remains quite challenging for an autonomous vehicle to plan its trajectory in complex scenarios when it is…

Robotics · Computer Science 2023-07-25 Xiangguo Liu , Ruochen Jiao , Yixuan Wang , Yimin Han , Bowen Zheng , Qi Zhu

Safety-critical learning requires policies that improve performance without leaving the safe operating regime. We study constrained policy learning where model parameters must satisfy rollout-based safety constraints that can be evaluated…

Machine Learning · Computer Science 2026-05-21 Shengfan Cao , Francesco Borrelli , Eunhyek Joa

Expressive generative models have advanced robotic manipulation by capturing complex, multi-modal action distributions over temporally extended trajectories. However, fine-tuning these policies via RL remains challenging due to instability…

Robotics · Computer Science 2026-04-03 Yuhui Chen , Haoran Li , Zhennan Jiang , Yuxing Qin , Yuxuan Wan , Weiheng Liu , Dongbin Zhao

The predict-then-optimize (PTO) framework is indispensable for addressing practical stochastic decision-making tasks. It consists of two crucial steps: initially predicting unknown parameters of an optimization model and subsequently…

Systems and Control · Electrical Eng. & Systems 2024-11-20 Jixian Liu , Tao Xu , Jianping He , Chongrong Fang

Model-based algorithms, which learn a dynamics model from logged experience and perform some sort of pessimistic planning under the learned model, have emerged as a promising paradigm for offline reinforcement learning (offline RL).…

Machine Learning · Computer Science 2022-01-28 Tianhe Yu , Aviral Kumar , Rafael Rafailov , Aravind Rajeswaran , Sergey Levine , Chelsea Finn

Reinforcement Learning (RL) algorithms have shown tremendous success in simulation environments, but their application to real-world problems faces significant challenges, with safety being a major concern. In particular, enforcing…

Machine Learning · Computer Science 2024-06-19 Weiye Zhao , Rui Chen , Yifan Sun , Tianhao Wei , Changliu Liu

The paradigm of robot-assisted surgery is shifting toward data-driven autonomy, where policies learned via Reinforcement Learning (RL) or Imitation Learning (IL) enable the execution of complex tasks. However, these ``black-box" policies…

Robotics · Computer Science 2026-03-10 Jianshu Hu , ZhiYuan Guan , Lei Song , Kantaphat Leelakunwet , Hesheng Wang , Wei Xiao , Qi Dou , Yutong Ban

Deep reinforcement learning algorithms can perform poorly in real-world tasks due to the discrepancy between source and target environments. This discrepancy is commonly viewed as the disturbance in transition dynamics. Many existing…

Machine Learning · Computer Science 2021-12-21 Yufei Kuang , Miao Lu , Jie Wang , Qi Zhou , Bin Li , Houqiang Li

Enhancing the reasoning capabilities of large language models effectively using reinforcement learning (RL) remains a crucial challenge. Existing approaches primarily adopt two contrasting advantage estimation granularities: token-level…

Machine Learning · Computer Science 2025-10-22 Yiran Guo , Lijie Xu , Jie Liu , Dan Ye , Shuang Qiu
‹ Prev 1 2 3 10 Next ›