English
Related papers

Related papers: LLMind: Orchestrating AI and IoT with LLM for Comp…

200 papers

In recent years, reinforcement learning and imitation learning have shown great potential for controlling humanoid robots' motion. However, these methods typically create simulation environments and rewards for specific tasks, resulting in…

Robotics · Computer Science 2024-08-01 Jingkai Sun , Qiang Zhang , Yiqun Duan , Xiaoyang Jiang , Chong Cheng , Renjing Xu

Recent advancements in large language models (LLMs) have led to the creation of intelligent agents capable of performing complex tasks. This paper introduces a novel LLM-based multimodal agent framework designed to operate smartphone…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Chi Zhang , Zhao Yang , Jiaxuan Liu , Yucheng Han , Xin Chen , Zebiao Huang , Bin Fu , Gang Yu

Robot swarms promise scalable assistance in complex and hazardous environments. Task planning lies at the core of human-swarm collaboration, translating the operator's intent into coordinated swarm actions and helping determine when…

Robotics · Computer Science 2026-05-11 Junfeng Chen , Yuxiao Zhu , An Zhuo , Xintong Zhang , Shuo Zhang , Guanghui Wen , Xiwang Dong , Meng Guo , Zhongkui Li

Large Language Models (LLMs) have gained popularity in task planning for long-horizon manipulation tasks. To enhance the validity of LLM-generated plans, visual demonstrations and online videos have been widely employed to guide the…

Robotics · Computer Science 2025-03-12 Kejia Chen , Zheng Shen , Yue Zhang , Lingyun Chen , Fan Wu , Zhenshan Bing , Sami Haddadin , Alois Knoll

Large Language Models (LLMs) are increasingly integrated into critical decision-making pipelines, a trend that raises the demand for robust and automated data analysis. Current approaches to dataset risk analysis are limited to manual…

Artificial Intelligence · Computer Science 2026-05-28 Panteleimon Rodis

Designing a 6G-oriented universal model capable of processing multi-modal data and executing diverse air interface tasks has emerged as a common goal in future wireless systems. Building on our prior work in communication multi-modal…

Machine Learning · Computer Science 2025-05-16 Tianyu Jiao , Zhuoran Xiao , Yihang Huang , Chenhui Ye , Yijia Feng , Liyu Cai , Jiang Chang , Fangkun Liu , Yin Xu , Dazhi He , Yunfeng Guan , Wenjun Zhang

In the realm of data-driven AI technology, the application of open-source large language models (LLMs) in robotic task planning represents a significant milestone. Recent robotic task planning methods based on open-source LLMs typically…

Robotics · Computer Science 2024-04-03 Yike Wu , Jiatao Zhang , Nan Hu , LanLing Tang , Guilin Qi , Jun Shao , Jie Ren , Wei Song

In this paper, we present a novel framework that combines large language models (LLMs), digital twins and industrial automation system to enable intelligent planning and control of production processes. We retrofit the automation system for…

Robotics · Computer Science 2023-12-08 Yuchen Xia , Manthan Shenoy , Nasser Jazdi , Michael Weyrich

In order to flexibly act in an everyday environment, a robotic agent needs a variety of cognitive capabilities that enable it to reason about plans and perform execution recovery. Large language models (LLMs) have been shown to demonstrate…

Robotics · Computer Science 2026-03-04 Shinas Shaji , Fabian Huppertz , Alex Mitrevski , Sebastian Houben

IoT systems face significant challenges in adapting to user needs, which are often under-specified and evolve with changing environmental contexts. To address these complexities, users should be able to explore possibilities, while IoT…

Software Engineering · Computer Science 2025-02-04 Bassam Adnan , Sathvika Miryala , Aneesh Sambu , Karthik Vaidhyanathan , Martina De Sanctis , Romina Spalazzese

Solving complicated AI tasks with different domains and modalities is a key step toward artificial general intelligence. While there are numerous AI models available for various domains and modalities, they cannot handle complicated AI…

Computation and Language · Computer Science 2023-12-05 Yongliang Shen , Kaitao Song , Xu Tan , Dongsheng Li , Weiming Lu , Yueting Zhuang

A significant application of Large Language Models (LLMs), like ChatGPT, is their deployment as chat agents, which respond to human inquiries across a variety of domains. While current LLMs proficiently answer general questions, they often…

Computation and Language · Computer Science 2024-04-16 Lang Cao

Robot swarms are composed of many simple robots that communicate and collaborate to fulfill complex tasks. Robot controllers usually need to be specified by experts on a case-by-case basis via programming code. This process is…

Robotics · Computer Science 2024-10-31 Volker Strobel , Marco Dorigo , Mario Fritz

Iterative human engagement is a common and effective means of leveraging the advanced language processing power of large language models (LLMs). Using well-structured prompts in a conversational manner, human users can effectively influence…

Computation and Language · Computer Science 2024-10-02 Santosh Kumar Radha , Yasamin Nouri Jelyani , Ara Ghukasyan , Oktay Goktas

Large language models (LLMs) have demonstrated remarkable capacities on various tasks, and integrating the capacities of LLMs into the Internet of Things (IoT) applications has drawn much research attention recently. Due to security…

Artificial Intelligence · Computer Science 2024-10-08 Bin Xiao , Burak Kantarci , Jiawen Kang , Dusit Niyato , Mohsen Guizani

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

Computation and Language · Computer Science 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

Autonomous control systems face significant challenges in performing complex tasks in the presence of latent risks. To address this, we propose an integrated framework that combines Large Language Models (LLMs), numerical optimization, and…

Systems and Control · Electrical Eng. & Systems 2025-05-08 Xiyu Deng , Quan Khanh Luu , Anh Van Ho , Yorie Nakahira

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

Computation and Language · Computer Science 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua

Large Language Models (LLMs) exhibit a notable performance ceiling on complex, multi-faceted tasks, as they often fail to integrate diverse information or adhere to multiple constraints. We posit that such limitation arises when the demands…

Artificial Intelligence · Computer Science 2025-09-26 HaoYang Shang , Xuan Liu , Zi Liang , Jie Zhang , Haibo Hu , Song Guo

Modern signal processing (SP) pipelines, whether model-based or data-driven, often constrained by complex and fragmented workflow, rely heavily on expert knowledge and manual engineering, and struggle with adaptability and generalization…

Machine Learning · Computer Science 2025-10-31 Junlong Ke , Qiying Hu , Shenghai Yuan , Yuecong Xu , Jianfei Yang