English
Related papers

Related papers: From Tool to Teammate: LLM Coding Agents as Collab…

200 papers

The integration of large language models (LLMs) into education presents unprecedented opportunities for scalable personalized learning. However, standard LLMs often function as generic information providers, lacking alignment with…

Machine Learning · Computer Science 2025-07-29 Siyu Song , Wentao Liu , Ye Lu , Ruohua Zhang , Tao Liu , Jinze Lv , Xinyun Wang , Aimin Zhou , Fei Tan , Bo Jiang , Hao Hao

Large Language Models (LLMs) based agent systems have made great strides in real-world applications beyond traditional NLP tasks. This paper proposes a new LLM-based Multi-Agent System (LLM-MAS) benchmark, Collab-Overcooked, built on the…

Computation and Language · Computer Science 2025-12-02 Haochen Sun , Shuwen Zhang , Lujie Niu , Lei Ren , Hao Xu , Hao Fu , Fangkun Zhao , Caixia Yuan , Xiaojie Wang

Automatic code optimization remains a difficult challenge, particularly for complex loop nests on modern hardware. This paper investigates a novel approach to code optimization where Large Language Models (LLMs) guide the process through a…

Programming Languages · Computer Science 2025-12-30 Massinissa Merouani , Islem Kara Bernou , Riyadh Baghdadi

Background: Traditional research on collaborative learning scaffolding is often time-consuming and resource-heavy, which hinders the rapid iteration and optimization of instructional strategies. LLM-based multi-agent systems have recently…

Human-Computer Interaction · Computer Science 2026-04-14 Han Wua , Lishan Zhang , Chunming Lu

AI programming tools enable powerful code generation, and recent prototypes attempt to reduce user effort with proactive AI agents, but their impact on programming workflows remains unexplored. We introduce and evaluate Codellaborator, a…

Human-Computer Interaction · Computer Science 2025-09-09 Kevin Pu , Daniel Lazaro , Ian Arawjo , Haijun Xia , Ziang Xiao , Tovi Grossman , Yan Chen

Our study introduces an automated system leveraging large language models (LLMs) to assess the effectiveness of five key tutoring strategies: 1. giving effective praise, 2. reacting to errors, 3. determining what students know, 4. helping…

Human-Computer Interaction · Computer Science 2025-04-22 Megan Gu , Chloe Qianhui Zhao , Claire Liu , Nikhil Patel , Jahnvi Shah , Jionghao Lin , Kenneth R. Koedinger

Effective prompt engineering is critical to realizing the promised productivity gains of large language models (LLMs) in knowledge-intensive tasks. Yet, many users struggle to craft prompts that yield high-quality outputs, limiting the…

Human-Computer Interaction · Computer Science 2025-10-02 Niklas Gutheil , Valentin Mayer , Leopold Müller , Jörg Rommelt , Niklas Kühl

Large language models are rapidly changing how learners acquire and demonstrate cybersecurity skills. However, when human--AI collaboration is allowed, educators still lack validated competition designs and evaluation practices that remain…

Proof engineering is notoriously labor-intensive: proofs that are straightforward on paper often require lengthy scripts in theorem provers. Recent advances in large language models (LLMs) create new opportunities for proof automation:…

Programming Languages · Computer Science 2026-01-08 Yichen Xu , Martin Odersky

We envision a continuous collaborative learning system where groups of LLM agents work together to solve reasoning problems, drawing on memory they collectively build to improve performance as they gain experience. This work establishes the…

Artificial Intelligence · Computer Science 2025-03-11 Julie Michelman , Nasrin Baratalipour , Matthew Abueg

Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective…

Computation and Language · Computer Science 2025-06-06 Junior Cedric Tonga , KV Aditya Srivatsa , Kaushal Kumar Maurya , Fajri Koto , Ekaterina Kochmar

We explore the use of Large Language Models (LLMs) for automated assessment of open-text student reflections and prediction of academic performance. Traditional methods for evaluating reflections are time-consuming and may not scale…

Machine Learning · Computer Science 2025-06-19 Gen Li , Li Chen , Cheng Tang , Valdemar Švábenský , Daisuke Deguchi , Takayoshi Yamashita , Atsushi Shimada

Multi-agent systems built from teams of large language models (LLMs) are increasingly deployed for collaborative scientific reasoning and problem-solving. These systems require agents to coordinate under shared constraints, such as GPUs or…

Computation and Language · Computer Science 2026-05-08 Shivani Kumar , Adarsh Bharathwaj , David Jurgens

Organizations have widely deployed generative AI tools, yet productivity gains remain uneven, suggesting that how people use AI matters as much as whether they have access. We conducted a field experiment with 388 employees at a Fortune 500…

General Economics · Economics 2026-04-21 Alex Farach , Alexia Cambon , Lev Tankelevitch , Connie Hsueh , Rebecca Janssen

Aligning LLMs for math tutoring typically requires RL-based training with multi-GPU infrastructure. We investigate whether training-free prompt optimization-evolving only the system prompt via API calls-can serve as a practical alternative.…

Computation and Language · Computer Science 2026-05-27 Unggi Lee , Minchul Shin , Yeil Jeong , Sookbun Lee , Jeongsu Moon , Kyungtae Joo , Eunjoo Lee , Hoilym Kwon

AI agent development relies heavily on natural language prompting to define agents' tasks, knowledge, and goals. These prompts are interpreted by Large Language Models (LLMs), which govern agent behavior. Consequently, agentic performance…

Artificial Intelligence · Computer Science 2026-04-14 Roi Ben-Gigi , Yuval David , Fabiana Fournier , Lior Limonad , Dany Moshkovich , Hadar Mulian , Segev Shlomov

The integration of large language models (LLMs) into intelligent tutoring systems offers transformative potential for personalized learning in higher education. However, most existing learning path planning approaches lack transparency,…

Artificial Intelligence · Computer Science 2026-01-27 Haoxin Xu , Changyong Qi , Tong Liu , Bohao Zhang , Anna He , Bingqian Jiang , Longwei Zheng , Xiaoqing Gu

Large language models (LLMs) have advanced virtual educators and learners, bridging NLP with AI4Education. Existing work often lacks scalability and fails to leverage diverse, large-scale course content, with limited frameworks for…

Artificial Intelligence · Computer Science 2025-09-08 Jiahuan Pei , Fanghua Ye , Xin Sun , Wentao Deng , Koen Hindriks , Junxiao Wang

Recent advances in large language models (LLMs) have led to the development of artificial intelligence (AI)-powered tutoring chatbots, showing promise in providing broad access to high-quality personalized education. Existing works have…

Computation and Language · Computer Science 2025-07-30 Alexander Scarlatos , Ryan S. Baker , Andrew Lan

Effective feedback, including critique and evaluation, helps designers develop design concepts and refine their ideas, supporting informed decision-making throughout the iterative design process. However, in studio-based design courses,…

Human-Computer Interaction · Computer Science 2025-12-03 Hyunseung Lim , Dasom Choi , DaEun Choi , Sooyohn Nam , Hwajung Hong