English
Related papers

Related papers: LayoutCopilot: An LLM-powered Multi-agent Collabor…

200 papers

Modern-day Integrated Development Environments (IDEs) have come a long way from the early text editing utilities to the complex programs encompassing thousands of functions to help developers. However, with the increasing number of…

Software Engineering · Computer Science 2024-02-20 Yaroslav Zharov , Yury Khudyakov , Evgeniia Fedotova , Evgeny Grigorenko , Egor Bogomolov

During Automated Program Repair (APR), it can be challenging to synthesize correct patches for real-world systems in general-purpose programming languages. Recent Large Language Models (LLMs) have been shown to be helpful "copilots" in…

Software Engineering · Computer Science 2023-11-10 Yuxiang Wei , Chunqiu Steven Xia , Lingming Zhang

To accelerate mechanical design and enhance design quality and innovation, we present a Multidisciplinary Design and Optimization (MDO) Agent driven by Large Language Models (LLMs). The agent semi-automates the end-to-end workflow by…

Human-Computer Interaction · Computer Science 2025-11-25 Bingkun Guo , Wentian Li , Xiaojian Liu , Jiaqi Luo , Zibin Yu , Dalong Dong , Shuyou Zhang , Yiming Zhang

Large language models (LLMs) have opened up new possibilities for intelligent agents, endowing them with human-like thinking and cognitive abilities. In this work, we delve into the potential of large language models (LLMs) in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Erfei Cui , Wenhai Wang , Zhiqi Li , Jiangwei Xie , Haoming Zou , Hanming Deng , Gen Luo , Lewei Lu , Xizhou Zhu , Jifeng Dai

Recent advancements on Large Language Models (LLMs) enable AI Agents to automatically generate and execute multi-step plans to solve complex tasks. However, since LLM's content generation process is hardly controllable, current LLM-based…

Machine Learning · Computer Science 2024-08-13 Zelong Li , Wenyue Hua , Hao Wang , He Zhu , Yongfeng Zhang

Large language models (LLMs) serve as powerful tools for design, providing capabilities for both task automation and design assistance. Recent advancements have shown tremendous potential for facilitating LLM integration into the chip…

Building Task-Oriented Dialogue (TOD) systems that generalize across different tasks remains a challenging problem. Data-driven approaches often struggle to transfer effectively to unseen tasks. While recent schema-based TOD frameworks…

Computation and Language · Computer Science 2026-04-21 Radin Shayanfar , Chu Fei Luo , Rohan Bhambhoria , Samuel Dahan , Xiaodan Zhu

Online question-and-answer (Q\&A) systems based on the Large Language Model (LLM) have progressively diverged from recreational to professional use. This paper proposed a Multi-Agent framework with environmentally reinforcement learning…

Software Engineering · Computer Science 2024-09-05 Jiapeng Yu , Yuqian Wu , Yajing Zhan , Wenhao Guo , Zhou Xu , Raymond Lee

The field of machine learning (ML) has gained widespread adoption, leading to significant demand for adapting ML to specific scenarios, which is yet expensive and non-trivial. The predominant approaches towards the automation of solving ML…

Machine Learning · Computer Science 2024-02-20 Lei Zhang , Yuge Zhang , Kan Ren , Dongsheng Li , Yuqing Yang

The increasing use of large language model (LLM)-powered code generation tools, such as GitHub Copilot, is transforming software engineering practices. This paper investigates how developers validate and repair code generated by Copilot and…

Software Engineering · Computer Science 2024-05-28 Ningzhi Tang , Meng Chen , Zheng Ning , Aakash Bansal , Yu Huang , Collin McMillan , Toby Jia-Jun Li

Large Language Models (LLMs) can generate Computer-Aided Design (CAD), yet lack physical comprehension required for reliable engineering design. Instead of attempting to implicitly learn physical laws from data, we propose a Hybrid…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Elias Berger , Muhammad Usama , Jan Mehlstäubl , Bernhard Saske , Kristin Paetzold-Byhain

This study focuses on using large language models (LLMs) as a planner for embodied agents that can follow natural language instructions to complete complex tasks in a visually-perceived environment. The high data cost and poor sample…

Artificial Intelligence · Computer Science 2023-09-08 Chan Hee Song , Jiaman Wu , Clayton Washington , Brian M. Sadler , Wei-Lun Chao , Yu Su

The rise of LLM has enabled natural language-based table assistants, but existing systems assume users already have a well-formed table, neglecting the challenge of table discovery in large-scale table pools. To address this, we introduce…

Databases · Computer Science 2025-07-14 Lingxi Cui , Guanyu Jiang , Huan Li , Ke Chen , Lidan Shou , Gang Chen

Advancements in Large Language Models (LLMs), such as ChatGPT, offer significant opportunities to enhance instructional support in introductory programming courses. While extensive research has explored the effectiveness of LLMs in…

Human-Computer Interaction · Computer Science 2025-05-09 Muntasir Hoq , Jessica Vandenberg , Shuyin Jiao , Seung Lee , Bradford Mott , Narges Norouzi , James Lester , Bita Akram

In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable challenge. Addressing this imperative, this study contributes…

The absence of explicit communication channels between automated vehicles (AVs) and other road users requires the use of external Human-Machine Interfaces (eHMIs) to convey messages effectively in uncertain scenarios. Currently, most eHMI…

Human-Computer Interaction · Computer Science 2025-10-13 Ding Xia , Xinyue Gui , Fan Gao , Dongyuan Li , Mark Colley , Takeo Igarashi

Large-language models (LLMs) hold significant promise in improving human-robot interaction, offering advanced conversational skills and versatility in managing diverse, open-ended user requests in various tasks and domains. Despite the…

Robotics · Computer Science 2024-01-09 Callie Y. Kim , Christine P. Lee , Bilge Mutlu

Text-based telemedicine has become increasingly common, yet the quality of medical advice in doctor-patient interactions is often judged more on how advice is communicated rather than its clinical accuracy. To address this, we introduce Dr.…

Computation and Language · Computer Science 2025-07-22 Andrei Niculae , Adrian Cosma , Cosmin Dumitrache , Emilian Rǎdoi

This research focuses on how Large Language Models (LLMs) can help with (path) planning for mobile embodied agents such as robots, in a human-in-the-loop and interactive manner. A novel framework named LLM A*, aims to leverage the…

Robotics · Computer Science 2025-05-16 Hengjia Xiao , Peng Wang , Mingzhe Yu , Mattia Robbiani

Recent advancements in Generative AI offer promising capabilities for spatial analysis. Despite their potential, the integration of generative AI with established GIS platforms remains underexplored. In this study, we propose a framework…

Artificial Intelligence · Computer Science 2024-11-25 Temitope Akinboyewa , Zhenlong Li , Huan Ning , M. Naser Lessani