English
Related papers

Related papers: Ain't Misbehavin' -- Using LLMs to Generate Expres…

200 papers

Recent advancements in Large Audio Language Models (LALMs) have demonstrated exceptional performance in speech recognition and translation. However, existing models often suffer from a disconnect between perception and expression, resulting…

Sound · Computer Science 2026-03-02 Yueran Hou , Peilei Jia , Zihan Sun , Qihang Lu , Wenbing Yang , Yingming Gao , Ya Li , Jun Gao

The rapid advancement of Large Language Models (LLMs) has opened new possibilities in Multi-Robot Systems (MRS), enabling enhanced communication, task allocation and planning, and human-robot interaction. Unlike traditional single-robot and…

Robotics · Computer Science 2026-05-05 Peihan Li , Zijian An , Shams Abrar , Lifeng Zhou

Large Language Models (LLMs) are gaining popularity in the field of robotics. However, LLM-based robots are limited to simple, repetitive motions due to the poor integration between language models, robots, and the environment. This paper…

Large language models (LLMs) and their variants have shown extraordinary efficacy across numerous downstream natural language processing (NLP) tasks, which has presented a new vision for the development of NLP. Despite their remarkable…

Computation and Language · Computer Science 2024-01-18 Yazhou Zhang , Mengyao Wang , Youxi Wu , Prayag Tiwari , Qiuchi Li , Benyou Wang , Jing Qin

This paper explores the advancements in making large language models (LLMs) more human-like. We focus on techniques that enhance natural language understanding, conversational coherence, and emotional intelligence in AI systems. The study…

Computation and Language · Computer Science 2026-02-03 Ethem Yağız Çalık , Talha Rüzgar Akkuş

Conversational agents have made significant progress since ELIZA, expanding their role across various domains, including healthcare, education, and customer service. As these agents become increasingly integrated into daily human…

Human-Computer Interaction · Computer Science 2025-07-04 Paulo Ricardo Knob , Leonardo Scholler , Juliano Rigatti , Soraia Raupp Musse

Human-robot collaboration in industrial settings requires precise and reliable communication to enhance operational efficiency. While Large Language Models (LLMs) understand general language, they often lack the domain-specific rigidity…

Robotics · Computer Science 2026-04-07 Xinyun Huo , Raghav Gnanasambandam , Xinyao Zhang

Mobile manipulators are increasingly deployed in human-centered environments to perform tasks. While completing such tasks, they should also be able to communicate their intent to the people around them using expressive robot behaviors.…

Robotics · Computer Science 2026-04-24 Souren Pashangpour , Haitong Wang , Matthew Lisondra , Goldie Nejat

This paper presents a novel approach in autonomous robot control, named LLM-BRAIn, that makes possible robot behavior generation, based on operator's commands. LLM-BRAIn is a transformer-based Large Language Model (LLM) fine-tuned from…

Robotics · Computer Science 2023-06-01 Artem Lykov , Dzmitry Tsetserukou

With the recent development of natural language generation models - termed as large language models (LLMs) - a potential use case has opened up to improve the way that humans interact with robot assistants. These LLMs should be able to…

Multiagent Systems · Computer Science 2024-11-27 Mitchell Rosser , Marc. G Carmichael

Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living (ADLs).…

Recent large language models (LLMs) have demonstrated promising capabilities in modeling real-world knowledge and enhancing knowledge-based generation tasks. In this paper, we further explore the potential of using LLMs to aid in the design…

Robotics · Computer Science 2024-11-04 Weicheng Ma , Luyang Zhao , Chun-Yi She , Yitao Jiang , Alan Sun , Bo Zhu , Devin Balkcom , Soroush Vosoughi

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

Artificial Intelligence · Computer Science 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

Effective human-robot collaboration requires robot to adopt their roles and levels of support based on human needs, task requirements, and complexity. Traditional human-robot teaming often relies on a pre-determined robot communication…

Human-Computer Interaction · Computer Science 2025-02-12 Shipeng Liu , FNU Shrutika , Boshen Zhang , Zhehui Huang , Gaurav Sukhatme , Feifei Qian

This paper explores the potential of constructing an AI spoken dialogue system that "thinks how to respond" and "thinks how to speak" simultaneously, which more closely aligns with the human speech production process compared to the current…

Computation and Language · Computer Science 2023-09-21 Xinyu Zhou , Delong Chen , Yudong Chen

This paper explores the integration of human-like emotions and ethical considerations into Large Language Models (LLMs). We first model eight fundamental human emotions, presented as opposing pairs, and employ collaborative LLMs to…

Computation and Language · Computer Science 2024-06-26 Edward Y. Chang

Large Language Models (LLMs) have been widely utilized to perform complex robotic tasks. However, handling external disturbances during tasks is still an open challenge. This paper proposes a novel method to achieve robotic adaptive tasks…

Robotics · Computer Science 2024-08-20 Haotian Zhou , Yunhan Lin , Longwu Yan , Jihong Zhu , Huasong Min

This paper presents a system for diversity-aware autonomous conversation leveraging the capabilities of large language models (LLMs). The system adapts to diverse populations and individuals, considering factors like background,…

Robotics · Computer Science 2024-06-26 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

In recent years, the integration of large language models (LLMs) has revolutionized the field of robotics, enabling robots to communicate, understand, and reason with human-like proficiency. This paper explores the multifaceted impact of…

Robotics · Computer Science 2024-08-16 Yeseung Kim , Dohyun Kim , Jieun Choi , Jisang Park , Nayoung Oh , Daehyung Park

Large language models (LLMs) have emerged as powerful and general solutions to many natural language tasks. However, many of the most important applications of language generation are interactive, where an agent has to talk to a person to…

Machine Learning · Computer Science 2023-11-10 Joey Hong , Sergey Levine , Anca Dragan