English
Related papers

Related papers: Towards an LLM-Based Speech Interface for Robot-As…

200 papers

The rapid advancement of Large Language Models (LLMs) has marked a significant breakthrough in Artificial Intelligence (AI), ushering in a new era of Human-centered Artificial Intelligence (HAI). HAI aims to better serve human welfare and…

Robotics · Computer Science 2025-10-29 Wenbin Ding , Jun Chen , Mingjia Chen , Fei Xie , Qi Mao , Philip Dames

The combination of Large Language Models (LLM) and Automatic Speech Recognition (ASR), when deployed on edge devices (called edge ASR-LLM), can serve as a powerful personalized assistant to enable audio-based interaction for users. Compared…

Large Language Models (LLMs) have showcased remarkable proficiency in various information-processing tasks. These tasks span from extracting data and summarizing literature to generating content, predictive modeling, decision-making, and…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Sonda Fourati , Wael Jaafar , Noura Baccar , Safwan Alfattani

Natural language interfaces can simplify interaction with multi-robot systems, especially when non-expert users need to issue high-level commands. Acoustic manipulation using ultrasonic phased arrays also enables contactless object handling…

Robotics · Computer Science 2026-05-29 Yingying Wang , Narsimlu Kemsaram , Sriram Subramanian

As spacecraft journey further from Earth with more complex missions, systems of greater autonomy and onboard intelligence are called for. Reducing reliance on human-based mission control becomes increasingly critical if we are to increase…

Robotics · Computer Science 2024-05-03 David Maranto

With the advent of Large Language Models (LLMs), medical artificial intelligence (AI) has experienced substantial technological progress and paradigm shifts, highlighting the potential of LLMs to streamline healthcare delivery and improve…

Computation and Language · Computer Science 2024-12-10 Lei Liu , Xiaoyan Yang , Junchi Lei , Yue Shen , Jian Wang , Peng Wei , Zhixuan Chu , Zhan Qin , Kui Ren

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

Robotics · Computer Science 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

Recent progress in large language model (LLM) technology has significantly enhanced the interaction experience between humans and voice assistants (VAs). This project aims to explore a user's continuous interaction with LLM-based VA…

Human-Computer Interaction · Computer Science 2024-09-04 Szeyi Chan , Shihan Fu , Jiachen Li , Bingsheng Yao , Smit Desai , Mirjana Prpa , Dakuo Wang

Training Large Language Models (LLMs) to follow user instructions has been shown to supply the LLM with ample capacity to converse fluently while being aligned with humans. Yet, it is not completely clear how an LLM can lead a plan-grounded…

Computation and Language · Computer Science 2024-02-05 Diogo Glória-Silva , Rafael Ferreira , Diogo Tavares , David Semedo , João Magalhães

Interactions with virtual assistants typically start with a predefined trigger phrase followed by the user command. To make interactions with the assistant more intuitive, we explore whether it is feasible to drop the requirement that users…

Computation and Language · Computer Science 2024-03-27 Dominik Wagner , Alexander Churchill , Siddharth Sigtia , Panayiotis Georgiou , Matt Mirsamadi , Aarshee Mishra , Erik Marchi

This study investigates the design, development, and evaluation of a Large Language Model (LLM)-based chatbot for teaching English conversations in an English as a Foreign Language (EFL) context. Employing the Design and Development…

Human-Computer Interaction · Computer Science 2024-09-10 Jaekwon Park , Jiyoung Bae , Unggi Lee , Taekyung Ahn , Sookbun Lee , Dohee Kim , Aram Choi , Yeil Jeong , Jewoong Moon , Hyeoncheol Kim

Human acceptance of social robots is greatly effected by empathy and perceived understanding. This necessitates accurate and flexible responses to various input data from the user. While systems such as this can become increasingly complex…

Robotics · Computer Science 2024-12-31 Jordan Sinclair , Christopher Reardon

Speech therapy is essential for rehabilitating speech disorders caused by neurological impairments such as stroke. However, traditional manual and computer-assisted systems are limited in real-time accessibility and articulatory motion…

Sound · Computer Science 2025-11-03 Yudong Yang , Xiaokang Liu , Shaofeng zhao , Rongfeng Su , Nan Yan , Lan Wang

Large language models (LLMs) have demonstrated exciting progress in acquiring diverse new capabilities through in-context learning, ranging from logical reasoning to code-writing. Robotics researchers have also explored using LLMs to…

Autonomous Driving Systems (ADSs) are revolutionizing transportation by reducing human intervention, improving operational efficiency, and enhancing safety. Large Language Models (LLMs) have been integrated into ADSs to support high-level…

Multiagent Systems · Computer Science 2025-10-15 Yaozu Wu , Dongyuan Li , Yankai Chen , Renhe Jiang , Henry Peng Zou , Wei-Chieh Huang , Yangning Li , Liancheng Fang , Zhen Wang , Philip S. Yu

Hundreds of millions of people rely on large language models (LLMs) for education, work, and even healthcare. Yet these models are known to reproduce and amplify social biases present in their training data. Moreover, text-based interfaces…

Computation and Language · Computer Science 2026-03-24 Carolin Holtermann , Minh Duc Bui , Kaitlyn Zhou , Valentin Hofmann , Katharina von der Wense , Anne Lauscher

Unmanned Aerial Vehicles (UAVs) have emerged as a transformative technology across diverse sectors, offering adaptable solutions to complex challenges in both military and civilian domains. Their expanding capabilities present a platform…

Artificial Intelligence · Computer Science 2024-05-06 Shumaila Javaid , Nasir Saeed , Bin He

To achieve natural and intuitive interaction with people, HRI frameworks combine a wide array of methods for human perception, intention communication, human-aware navigation and collaborative action. In practice, when encountering…

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing…

Machine Learning · Computer Science 2025-01-10 Xuran Zheng , Chang D. Yoo

Existing learning-based autonomous driving (AD) systems face challenges in comprehending high-level information, generalizing to rare events, and providing interpretability. To address these problems, this work employs Large Language Models…

Robotics · Computer Science 2025-04-16 Hao Sha , Yao Mu , Yuxuan Jiang , Li Chen , Chenfeng Xu , Ping Luo , Shengbo Eben Li , Masayoshi Tomizuka , Wei Zhan , Mingyu Ding