English
Related papers

Related papers: Dynamic benchmarking framework for LLM-based conve…

200 papers

Large Language Models (LLMs) have demonstrated their ability to replicate human behaviors across a wide range of scenarios. However, their capability in handling complex, multi-character social interactions has yet to be fully explored,…

Computation and Language · Computer Science 2024-03-06 Yuanzhi Liang , Linchao Zhu , Yi Yang

Large Language Models (LLMs) have transformed agent-agent and human-agent interaction by enabling software, physical, and simulation agents to communicate and deliberate through natural language. Yet fluent language use does not by itself…

Multiagent Systems · Computer Science 2026-05-05 Önder Gürcan , Moharram Challenger

Current research on large language model (LLM) agents is fragmented: discussions of conceptual frameworks and methodological principles are frequently intertwined with low-level implementation details, causing both readers and authors to…

Artificial Intelligence · Computer Science 2026-02-10 Haoyu Jia , Kento Kawaharazuka , Kei Okada

Large language models (LLMs) have enabled a range of applications in zero-shot and few-shot learning settings, including the generation of synthetic datasets for training and testing. However, to reliably use these synthetic datasets, it is…

Computation and Language · Computer Science 2024-09-19 Gaurav Maheshwari , Dmitry Ivanov , Kevin El Haddad

Evaluating large language models (LLMs) has recently emerged as a critical issue for safe and trustworthy application of LLMs in the medical domain. Although a variety of static medical question-answering (QA) benchmarks have been proposed,…

Computation and Language · Computer Science 2025-12-12 Gyutaek Oh , Sangjoon Park , Byung-Hoon Kim

We propose a novel framework for summarizing structured enterprise data across multiple dimensions using large language model (LLM)-based agents. Traditional table-to-text models often lack the capacity to reason across hierarchical…

Artificial Intelligence · Computer Science 2025-08-12 Amit Dhanda

While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an…

Computation and Language · Computer Science 2024-02-06 Ivar Frisch , Mario Giulianelli

For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing problem. The efficiency…

Computation and Language · Computer Science 2022-12-19 Harsh Lara , Manoj Tiwari

The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities has spurred public curiosity to evaluate and compare different LLMs, leading many researchers to propose their own LLM benchmarks. Noticing preliminary…

Artificial Intelligence · Computer Science 2025-05-15 Timothy R. McIntosh , Teo Susnjak , Nalin Arachchilage , Tong Liu , Paul Watters , Malka N. Halgamuge

Large language models (LLMs) have evolved into interactive agents that collaborate with users in real-world tasks. Effective collaboration in such settings increasingly depends on understanding the user beyond what is explicitly stated, as…

Artificial Intelligence · Computer Science 2026-05-27 Yuxin Chen , Yi Zhang , Zhengzhou Cai , Yaorui Shi , Zhiyuan Yao , Chenhang Cui , Jingnan Zheng , Yaqi Huo , Xi Su , Qi Gu , Xunliang Cai , Xiang Wang , An Zhang , Tat-Seng Chua

The rapid advancement of large language models (LLMs) has enabled role-playing language agents to demonstrate significant potential in various applications. However, relying solely on prompts and contextual inputs often proves insufficient…

Computation and Language · Computer Science 2025-07-24 Xiaoyu Zhan , Xinyu Fu , Hao Sun , Yuanqi Li , Jie Guo , Yanwen Guo

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Large Language Models (LLMs) often experience performance degradation during long-running interactions due to increasing context length, memory saturation, and computational overhead. This paper presents an adaptive context compression…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Payal Fofadiya , Sunil Tiwari

Spoken language models (SLMs) have advanced rapidly in recent years, accompanied by a growing number of evaluation benchmarks. However, most existing benchmarks emphasize task completion and capability scaling, while remaining poorly…

Computation and Language · Computer Science 2026-01-13 Zehan Li , Hongjie Chen , Qing Wang , Yuxin Zhang , Jing Zhou , Hang Lv , Mengjie Du , Yaodong Song , Jie Lian , Jian Kang , Jie Li , Yongxiang Li , Xuelong Li

Effective decision-making in complex systems requires synthesizing diverse perspectives to address multifaceted challenges under uncertainty. This study introduces an agentic Large Language Models (LLMs) framework for simulating decision…

Artificial Intelligence · Computer Science 2026-03-20 Antoine Dolant , Praveen Kumar

Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less attention has been paid to their ability to simulate human…

Computational Engineering, Finance, and Science · Computer Science 2025-08-25 Yuanjun Feng , Vivek Choudhary , Yash Raj Shrestha

Mobile agents are essential for automating tasks in complex and dynamic mobile environments. As foundation models evolve, the demands for agents that can adapt in real-time and process multimodal data have grown. This survey provides a…

Artificial Intelligence · Computer Science 2025-09-16 Biao Wu , Yanda Li , Zhiwei Zhang , Yunchao Wei , Meng Fang , Ling Chen

The inability of Large Language Models (LLMs) to modulate their personality expression in response to evolving dialogue dynamics hinders their performance in complex, interactive contexts. We propose a model-agnostic framework for dynamic…

Computation and Language · Computer Science 2026-02-26 Leon Pielage , Ole Hätscher , Mitja Back , Bernhard Marschall , Benjamin Risse

Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choices. Prior evaluations frequently conflate base-model…

Artificial Intelligence · Computer Science 2026-02-03 Xuan Liu , Haoyang Shang , Zizhang Liu , Xinyan Liu , Yunze Xiao , Yiwen Tu , Haojian Jin

Large language models (LLMs) are increasingly deployed as customer-facing agents, yet evaluating their reliability remains challenging due to stochastic, multi-turn interactions. Current evaluation protocols rely on linear Monte Carlo…

Artificial Intelligence · Computer Science 2026-04-24 Itay Nakash , George Kour , Ateret Anaby-Tavor
‹ Prev 1 3 4 5 6 7 10 Next ›