English
Related papers

Related papers: Leveraging Large Language Model for Heterogeneous …

200 papers

We propose Heterogeneous Swarms, an algorithm to design multi-LLM systems by jointly optimizing model roles and weights. We represent multi-LLM systems as directed acyclic graphs (DAGs) of LLMs with topological message passing for…

Computation and Language · Computer Science 2025-10-24 Shangbin Feng , Zifeng Wang , Palash Goyal , Yike Wang , Weijia Shi , Huang Xia , Hamid Palangi , Luke Zettlemoyer , Yulia Tsvetkov , Chen-Yu Lee , Tomas Pfister

Cooperative multi-robot tasks can benefit from heterogeneity in the robots' physical and behavioral traits. In spite of this, traditional Multi-Agent Reinforcement Learning (MARL) frameworks lack the ability to explicitly accommodate policy…

Robotics · Computer Science 2023-01-19 Matteo Bettini , Ajay Shankar , Amanda Prorok

The analysis and mining of user heterogeneous behavior are of paramount importance in recommendation systems. However, the conventional approach of incorporating various types of heterogeneous behavior into recommendation models leads to…

Information Retrieval · Computer Science 2023-08-21 Bin Yin , Junjie Xie , Yu Qin , Zixiang Ding , Zhichao Feng , Xiang Li , Wei Lin

This paper considers an optimal task allocation problem for human robot collaboration in human robot systems with persistent tasks. Such human robot systems consist of human operators and intelligent robots collaborating with each other to…

Robotics · Computer Science 2017-06-02 Bo Wu , Bin Hu , Hai Lin

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

Robotics · Computer Science 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

We present a large language model (LLM) based system to empower quadrupedal robots with problem-solving abilities for long-horizon tasks beyond short-term motions. Long-horizon tasks for quadrupeds are challenging since they require both a…

Robotics · Computer Science 2025-03-20 Yutao Ouyang , Jinhan Li , Yunfei Li , Zhongyu Li , Chao Yu , Koushil Sreenath , Yi Wu

In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynamic and diverse environments. These systems have a wide range…

Robotics · Computer Science 2024-11-25 Simone Colombani , Dimitri Ognibene , Giuseppe Boccignone

Ad hoc teamwork is the challenging problem of designing an autonomous agent which can adapt quickly to collaborate with teammates without prior coordination mechanisms, including joint training. Prior work in this area has focused on closed…

Machine Learning · Computer Science 2021-06-10 Arrasy Rahman , Niklas Höpner , Filippos Christianos , Stefano V. Albrecht

Multi-human multi-robot teams are increasingly recognized for their efficiency in executing large-scale, complex tasks by integrating heterogeneous yet potentially synergistic humans and robots. However, this inherent heterogeneity presents…

Recently, model merging methods have demonstrated powerful strengths in combining abilities on various tasks from multiple Large Language Models (LLMs). While previous model merging methods mainly focus on merging homogeneous models with…

Computation and Language · Computer Science 2026-04-23 Yiyang Du , Xiaochen Wang , Chi Chen , Jiabo Ye , Yiru Wang , Peng Li , Ming Yan , Ji Zhang , Fei Huang , Zhifang Sui , Maosong Sun , Yang Liu

Artificial intelligence is transforming precision agriculture, offering farmers new tools to streamline their daily operations. While these technological advances promise increased efficiency, they often introduce additional complexity and…

Robotics · Computer Science 2025-09-15 Marcos Abel Zuzuárregui , Mustafa Melih Toslak , Stefano Carpin

The rapid development of large language models (LLMs) has significantly transformed the field of artificial intelligence, demonstrating remarkable capabilities in natural language processing and moving towards multi-modal functionality.…

Heterogeneous multi-robot systems (HMRS) have emerged as a powerful approach for tackling complex tasks that single robots cannot manage alone. Current large-language-model-based multi-agent systems (LLM-based MAS) have shown success in…

Robotics · Computer Science 2025-02-18 Junting Chen , Checheng Yu , Xunzhe Zhou , Tianqi Xu , Yao Mu , Mengkang Hu , Wenqi Shao , Yikai Wang , Guohao Li , Lin Shao

It is crucial that robots' performance can be improved after deployment, as they are inherently likely to encounter novel scenarios never seen before. This paper presents an innovative solution: an interactive learning-based robot system…

Human-Computer Interaction · Computer Science 2025-08-01 Kohou Wang , ZhaoXiang Liu , Lin Bai , Kun Fan , Xiang Liu , Huan Hu , Kai Wang , Shiguo Lian

Recent advances in large language models (LLMs) have demonstrated their potential as planners in human-robot collaboration (HRC) scenarios, offering a promising alternative to traditional planning methods. LLMs, which can generate…

Robotics · Computer Science 2025-03-04 Afagh Mehri Shervedani , Matthew R. Walter , Milos Zefran

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively. Large Language Models (LLMs) promise to streamline this process by synthesizing…

In various work contexts, such as meeting scheduling, collaborating, and project planning, collective decision-making is essential but often challenging due to diverse individual preferences, varying work focuses, and power dynamics among…

Computation and Language · Computer Science 2025-08-13 Marios Papachristou , Longqi Yang , Chin-Chia Hsu

As legged robots take on roles in industrial and autonomous construction, collaborative loco-manipulation is crucial for handling large and heavy objects that exceed the capabilities of a single robot. However, ensuring the safety of these…

Robotics · Computer Science 2024-11-19 Mohsen Sombolestan , Quan Nguyen

In high-stake environments like emergency response or elder care, the integration of large language model (LLM), revolutionize risk assessment, resource allocation, and emergency responses in Human Activity Recognition (HAR) systems by…

Human-Computer Interaction · Computer Science 2024-10-07 Syed Mhamudul Hasan

In autonomous exploration tasks, robots are required to explore and map unknown environments while efficiently planning in dynamic and uncertain conditions. Given the significant variability of environments, human operators often have…

Robotics · Computer Science 2025-03-11 Shuhao Liao , Xuxin Lv , Yuhong Cao , Jeric Lew , Wenjun Wu , Guillaume Sartoretti