English
Related papers

Related papers: Tapilot-Crossing: Benchmarking and Evolving LLMs T…

200 papers

LLM-powered agents are both a promising new technology and a source of complexity, where choices about models, tools, and prompting can affect their usefulness. While numerous benchmarks measure agent accuracy across domains, they mostly…

The evolution of Large Language Models (LLMs) into autonomous agents necessitates the management of extensive, dynamic contexts. Current benchmarks, however, remain largely static, relying on passive retrieval tasks that fail to simulate…

Computation and Language · Computer Science 2026-02-02 Shicheng Fang , Yuxin Wang , Xiaoran Liu , Jiahao Lu , Chuanyuan Tan , Xinchi Chen , Yining Zheng , Xuanjing Huang , Xipeng Qiu

Large language models (LLMs) are increasingly deployed in collaborative settings, yet little is known about how they coordinate when treated as black-box agents. We simulate 7500 multi-agent, multi-round discussions in an inductive coding…

Computation and Language · Computer Science 2025-12-02 Angelina Parfenova , Alexander Denzler , Juergen Pfeffer

Context: Manual qualitative data analysis is time-intensive and can compromise validity and replicability, affecting analysis design, implementation, and reporting. Large Language Models (LLMs) enable human-bot collaboration in Software…

Software Engineering · Computer Science 2025-10-14 Zeeshan Rasheed , Muhammad Waseem , Aakash Ahmad , Kai-Kristian Kemell , Wang Xiaofeng , Anh Nguyen Duc , Pekka Abrahamsson

LLM-based agents can autonomously accomplish complex tasks across various domains. However, to further cultivate capabilities such as adaptive behavior and long-term decision-making, training on static datasets built from human-level…

Machine Learning · Computer Science 2025-12-24 Yuchen Huang , Sijia Li , Minghao Liu , Wei Liu , Shijue Huang , Zhiyuan Fan , Hou Pong Chan , Yi R. Fung

As large language models (LLMs) transition from static tools to fully agentic systems, their potential for transforming social science research has become increasingly evident. This paper introduces a structured framework for understanding…

Multiagent Systems · Computer Science 2026-05-19 Jennifer Haase , Sebastian Pokutta

Large Language Models (LLMs) have demonstrated remarkable success in conversational systems by generating human-like responses. However, they can fall short, especially when required to account for personalization or specific knowledge. In…

Computation and Language · Computer Science 2025-11-12 Soyeong Jeong , Aparna Elangovan , Emine Yilmaz , Oleg Rokhlenko

This paper investigates the ontological characterization of Large Language Models (LLMs) like ChatGPT. Between inflationary and deflationary accounts, we pay special attention to their status as agents. This requires explaining in detail…

Artificial Intelligence · Computer Science 2026-03-09 Xabier E. Barandiaran , Lola S. Almendros

Textual data annotation, the process of labeling or tagging text with relevant information, is typically costly, time-consuming, and labor-intensive. While large language models (LLMs) have demonstrated their potential as direct…

Computation and Language · Computer Science 2025-08-12 Yu-Min Tseng , Wei-Lin Chen , Chung-Chi Chen , Hsin-Hsi Chen

Despite advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), their integration into language-grounded, human-like embodied agents remains incomplete, hindering complex real-life task performance in physical…

Computation and Language · Computer Science 2024-08-20 Zhili Cheng , Zhitong Wang , Jinyi Hu , Shengding Hu , An Liu , Yuge Tu , Pengkai Li , Lei Shi , Zhiyuan Liu , Maosong Sun

The injection molding industry faces critical challenges in preserving and transferring field knowledge, particularly as experienced workers retire and multilingual barriers hinder effective communication. This study introduces IM-Chat, a…

Artificial Intelligence · Computer Science 2025-10-23 Junhyeong Lee , Joon-Young Kim , Heekyu Kim , Inhyo Lee , Seunghwa Ryu

While Large Language Model (LLM)-based agents can be used to create highly engaging interactive applications through prompting personality traits and contextual data, effectively assessing their personalities has proven challenging. This…

Human-Computer Interaction · Computer Science 2025-10-29 Eswari Jayakumar , Niladri Sekhar Dash , Debasmita Mukherjee

With large language models (LLMs) increasingly deployed as cognitive engines for AI agents, the reliability and effectiveness critically hinge on their intrinsic epistemic agency, which remains understudied. Epistemic agency, the ability to…

Artificial Intelligence · Computer Science 2025-06-05 Lingyu Li , Yixu Wang , Haiquan Zhao , Shuqi Kong , Yan Teng , Chunbo Li , Yingchun Wang

As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM…

The current paradigm of test-time scaling relies on generating long reasoning traces ("thinking" more) before producing a response. In agent problems that require interaction, this can be done by generating thinking traces before acting in…

Due to strong capabilities in conducting fluent, multi-turn conversations with users, Large Language Models (LLMs) have the potential to further improve the performance of Conversational Recommender System (CRS). Unlike the aimless…

Information Retrieval · Computer Science 2024-02-05 Jiabao Fang , Shen Gao , Pengjie Ren , Xiuying Chen , Suzan Verberne , Zhaochun Ren

Large language models (LLMs) are increasingly used to support creative tasks such as research idea generation. While recent work has shown that structured dialogues between LLMs can improve the novelty and feasibility of generated ideas,…

Computation and Language · Computer Science 2025-07-14 Keisuke Ueda , Wataru Hirota , Takuto Asakura , Takahiro Omi , Kosuke Takahashi , Kosuke Arima , Tatsuya Ishigaki

The advancement of Large Language Models (LLMs) has led to significant improvements in various service domains, including search, recommendation, and chatbot applications. However, applying state-of-the-art (SOTA) research to industrial…

Computation and Language · Computer Science 2025-05-30 Chiwan Park , Wonjun Jang , Daeryong Kim , Aelim Ahn , Kichang Yang , Woosung Hwang , Jihyeon Roh , Hyerin Park , Hyosun Wang , Min Seok Kim , Jihoon Kang

Large language models (LLMs) can support democratic deliberation at scales previously constrained by turn-taking and facilitation bandwidth. Recent work shows that LLM-generated group statements are often preferred over human-mediated…

Computation and Language · Computer Science 2026-05-27 Wajdi Zaghouani

Large language models (LLMs) increasingly serve as the central control unit of AI agents, yet current approaches remain limited in their ability to deliver personalized interactions. While Retrieval Augmented Generation enhances LLM…

Artificial Intelligence · Computer Science 2025-10-10 Rebecca Westhäußer , Wolfgang Minker , Sebatian Zepf