English
Related papers

Related papers: Training microrobots to swim by a large language m…

200 papers

We investigated the capability of the GPT-3.5 large language model (LLM) to operationalize natural language descriptions of cooperative, competitive, altruistic, and self-interested behavior in two social dilemmas: the repeated Prisoners…

Computer Science and Game Theory · Computer Science 2024-07-02 Steve Phelps , Yvan I. Russell

We present a method for developing navigation policies for multi-robot teams that interpret and follow natural language instructions. We condition these policies on embeddings from pretrained Large Language Models (LLMs), and train them via…

Robotics · Computer Science 2024-07-30 Steven Morad , Ajay Shankar , Jan Blumenkamp , Amanda Prorok

Multimodal large language models are typically trained in two stages: first pre-training on image-text pairs, and then fine-tuning using supervised vision-language instruction data. Recent studies have shown that large language models can…

Machine Learning · Computer Science 2026-04-14 Lai Wei , Xiaozhe Li , Zihao Jiang , Weiran Huang , Lichao Sun

Large language models (LLMs) such as ChatGPT, Gemini, LlaMa, and Claude are trained on massive quantities of text parsed from the internet and have shown a remarkable ability to respond to complex prompts in a manner often indistinguishable…

Optics · Physics 2025-04-01 Darui Lu , Yang Deng , Jordan M. Malof , Willie J. Padilla

Augmenting large language models (LLMs) with user-specific knowledge is crucial for real-world applications, such as personal AI assistants. However, LLMs inherently lack mechanisms for prompt-driven knowledge capture. This paper…

Computation and Language · Computer Science 2024-02-02 Tolga Çöplü , Arto Bendiken , Andrii Skomorokhov , Eduard Bateiko , Stephen Cobb , Joshua J. Bouw

This paper provides an in-depth evaluation of three state-of-the-art Large Language Models (LLMs) for personalized career mentoring in the computing field, using three distinct student profiles that consider gender, race, and professional…

Computation and Language · Computer Science 2024-12-16 Xiao Luo , Sean O'Connell , Shamima Mithun

Large language models (LLMs) have demonstrated remarkable language abilities. GPT-4, based on advanced LLMs, exhibits extraordinary multimodal capabilities beyond previous visual language models. We attribute this to the use of more…

Computation and Language · Computer Science 2023-05-23 Feilong Chen , Minglun Han , Haozhi Zhao , Qingyang Zhang , Jing Shi , Shuang Xu , Bo Xu

Large language models (LLMs) possess broad world knowledge and strong general-purpose reasoning ability, yet they struggle to learn from many in-context examples on standard machine learning (ML) tasks, that is, to leverage many-shot…

Computation and Language · Computer Science 2026-04-14 Haoyu Dong , Pengkun Zhang , Mingzhe Lu , Yanzhen Shen , Guolin Ke

One emergent ability of large language models (LLMs) is that query-specific examples can be included in the prompt at inference time. In this work, we use active learning for adaptive prompt design and call it Active In-context Prompt…

Machine Learning · Computer Science 2024-06-03 Subhojyoti Mukherjee , Anusha Lalitha , Aniket Deshmukh , Ge Liu , Yifei Ma , Branislav Kveton

Large language models (LLMs), such as GPT-4, PaLM, and LLaMa, have been shown to achieve remarkable performance across a variety of natural language tasks. Recent advancements in instruction tuning bring LLMs with ability in following…

Computation and Language · Computer Science 2023-09-12 Vu-Thuan Doan , Quoc-Truong Truong , Duc-Vu Nguyen , Vinh-Tiep Nguyen , Thuy-Ngan Nguyen Luu

Engineering safety-critical systems such as medical devices and digital health intervention systems is complex, where long-term engagement with subject-matter experts (SMEs) is needed to capture the systems' expected behaviour. In this…

We report the development of Alter3, a humanoid robot capable of generating spontaneous motion using a Large Language Model (LLM), specifically GPT-4. This achievement was realized by integrating GPT-4 into our proprietary android, Alter3,…

Robotics · Computer Science 2023-12-12 Takahide Yoshida , Atsushi Masumori , Takashi Ikegami

This comprehensive review delves into the pivotal role of prompt engineering in unleashing the capabilities of Large Language Models (LLMs). The development of Artificial Intelligence (AI), from its inception in the 1950s to the emergence…

Computation and Language · Computer Science 2025-06-18 Banghao Chen , Zhaofeng Zhang , Nicolas Langrené , Shengxin Zhu

With the rapid development of large language models (LLM), robots are starting to enjoy the benefits of new interaction methods that large language models bring. Because edge computing fulfills the needs for rapid response, privacy, and…

Robotics · Computer Science 2024-12-16 Yuxuan Chen , Yixin Han , Xiao Li

Large Language Models (LLMs) have limited performance when solving arithmetic reasoning tasks and often provide incorrect answers. Unlike natural language understanding, math problems typically have a single correct answer, making the task…

Computation and Language · Computer Science 2023-03-10 Shima Imani , Liang Du , Harsh Shrivastava

Synthetic microswimmers show great promise in biomedical applications such as drug delivery and microsurgery. Their locomotion, however, is subject to stringent constraints due to the dominance of viscous over inertial forces at low…

Fluid Dynamics · Physics 2020-07-15 Alan Cheng Hou Tsang , Pun Wai Tong , Shreyes Nallan , On Shun Pak

Robot end users increasingly require accessible means of specifying tasks for robots to perform. Two common end-user programming paradigms include drag-and-drop interfaces and natural language programming. Although natural language…

Artificial Intelligence · Computer Science 2026-05-18 David Porfirio , Vincent Hsiao , Morgan Fine-Morris , Leslie Smith , Laura M. Hiatt

This paper presents Swarm-GPT, a system that integrates large language models (LLMs) with safe swarm motion planning - offering an automated and novel approach to deployable drone swarm choreography. Swarm-GPT enables users to automatically…

Current literature demonstrates that Large Language Models (LLMs) are great few-shot learners, and prompting significantly increases their performance on a range of downstream tasks in a few-shot learning setting. An attempt to automate…

Computation and Language · Computer Science 2023-06-26 Yulin Zhou , Yiren Zhao , Ilia Shumailov , Robert Mullins , Yarin Gal