English
Related papers

Related papers: Hera: Learning Long-Horizon Coordination for Devic…

200 papers

Reinforcement learning (RL) has become a critical paradigm for LLM post-training, yet the rollout phase -- accounting for 50--80% of total step time -- is bottlenecked by skewed generation: long-tailed trajectories indispensable for model…

Training large language models (LLMs) to reason via reinforcement learning (RL) significantly improves their problem-solving capabilities. In agentic settings, existing methods like ReAct prompt LLMs to explicitly plan before every action;…

This paper investigates integrating large language models (LLMs) with advanced hardware, focusing on developing a general-purpose device designed for enhanced interaction with LLMs. Initially, we analyze the current landscape, where virtual…

Hardware Architecture · Computer Science 2024-08-21 Jiajun Xu , Qun Wang , Yuhang Cao , Baitao Zeng , Sicheng Liu

In disaster scenarios, establishing robust emergency communication networks is critical, and unmanned aerial vehicles (UAVs) offer a promising solution to rapidly restore connectivity. However, organizing UAVs to form multi-hop networks in…

Multiagent Systems · Computer Science 2026-03-19 Yanggang Xu , Jirong Zha , Weijie Hong , Xiangmin Yi , Geng Chen , Jianfeng Zheng , Chen-Chun Hsia , Xinlei Chen

Pervasive mobile AI applications primarily employ one of the two learning paradigms: cloud-based learning (with powerful large models) or on-device learning (with lightweight small models). Despite their own advantages, neither paradigm can…

Machine Learning · Computer Science 2023-11-21 Yan Zhuang , Zhenzhe Zheng , Yunfeng Shao , Bingshuai Li , Fan Wu , Guihai Chen

We propose a federated learning (FL) in stratosphere (FLSTRA) system, where a high altitude platform station (HAPS) facilitates a large number of terrestrial clients to collaboratively learn a global model without sharing the training data.…

Networking and Internet Architecture · Computer Science 2023-06-12 Amin Farajzadeh , Animesh Yadav , Omid Abbasi , Wael Jaafar , Halim Yanikomeroglu

AI agents powered by large language models (LLMs) have shown strong capabilities in problem solving. Through combining many intelligent agents, multi-agent collaboration has emerged as a promising approach to tackle complex, multi-faceted…

Computation and Language · Computer Science 2024-12-10 Raphael Shu , Nilaksh Das , Michelle Yuan , Monica Sunkara , Yi Zhang

Large language model (LLM) agents are increasingly tested on complex tasks, but their ability to allocate scarce resources over long horizons remains unclear. Unlike reactive tasks with immediate feedback, this setting requires agents to…

Fine-tuning large language models (LLMs) on private, on-device data can empower tailored personalized AI agents. However, fine-tuning LLMs on resource-constrained edge devices faces significant challenges, including excessive computation…

Machine Learning · Computer Science 2025-03-26 Jian Ma , Xinchen Lyu , Jun Jiang , Qimei Cui , Haipeng Yao , Xiaofeng Tao

Reinforcement Learning (RL) has proven highly effective at enhancing the complex reasoning abilities of Large Language Models (LLMs), yet underlying mechanisms driving this success remain largely opaque. Our analysis reveals that puzzling…

Artificial Intelligence · Computer Science 2025-09-30 Haozhe Wang , Qixin Xu , Che Liu , Junhong Wu , Fangzhen Lin , Wenhu Chen

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Effective modeling of how human travelers learn and adjust their travel behavior from interacting with transportation systems is critical for system assessment and planning. However, this task is also difficult due to the complex cognition…

Artificial Intelligence · Computer Science 2025-11-04 Tianming Liu , Jirong Yang , Yafeng Yin , Manzi Li , Linghao Wang , Zheng Zhu

Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Collaborative end-edge-cloud computing for deep learning provides a range of performance and efficiency…

Machine Learning · Computer Science 2022-02-24 Sina Shahhosseini , Tianyi Hu , Dongjoo Seo , Anil Kanduri , Bryan Donyanavard , Amir M. Rahmani , Nikil Dutt

Despite significant progress on multi-agent reinforcement learning (MARL) in recent years, coordination in complex domains remains a challenge. Work in MARL often focuses on solving tasks where agents interact with all other agents and…

Machine Learning · Computer Science 2022-09-27 Shariq Iqbal , Robby Costales , Fei Sha

Online ride-hailing platforms aim to deliver efficient mobility-on-demand services, often facing challenges in balancing dynamic and spatially heterogeneous supply and demand. Existing methods typically fall into two categories:…

Artificial Intelligence · Computer Science 2025-10-28 Yi Zhang , Yushen Long , Yun Ni , Liping Huang , Xiaohong Wang , Jun Liu

This paper presents a cloud-based learning model predictive controller that integrates three interacting components: a set of agents, which must learn to perform a finite set of tasks with the minimum possible local cost; a coordinator,…

Systems and Control · Electrical Eng. & Systems 2022-12-01 Paula Chanfreut , José María Maestre , Eduardo F. Camacho , Francesco Borrelli

Existing Vision-Language Navigation (VLN) methods primarily focus on single-stage navigation, limiting their effectiveness in multi-stage and long-horizon tasks within complex and dynamic environments. To address these limitations, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Xinshuai Song , Weixing Chen , Yang Liu , Weikai Chen , Guanbin Li , Liang Lin

Large Language Models (LLMs) have significantly advanced tool-augmented agents, enabling autonomous reasoning via API interactions. However, executing multi-step tasks within massive tool libraries remains challenging due to two critical…

Artificial Intelligence · Computer Science 2026-04-15 Rongzhe Wei , Ge Shi , Min Cheng , Na Zhang , Pan Li , Sarthak Ghosh , Vaibhav Gorde , Leman Akoglu

As deep learning becomes more expensive, both in terms of time and compute, inefficiencies in machine learning (ML) training prevent practical usage of state-of-the-art models for most users. The newest model architectures are simply too…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-15 Kabir Nagrecha

Compared with the widely investigated homogeneous multi-robot collaboration, heterogeneous robots with different capabilities can provide a more efficient and flexible collaboration for more complex tasks. In this paper, we consider a more…

Robotics · Computer Science 2024-06-19 Xinzhu Liu , Peiyan Li , Wenju Yang , Di Guo , Huaping Liu