English
Related papers

Related papers: Dynamic benchmarking framework for LLM-based conve…

200 papers

This paper presents a system for procedurally generating agent-based narratives using large language models (LLMs). Users could drag and drop multiple agents and objects into a scene, with each entity automatically assigned semantic…

Graphics · Computer Science 2025-12-24 Vinayak Regmi , Christos Mousas

This paper presents a novel application of large language models (LLMs) to enhance user comprehension of privacy policies through an interactive dialogue agent. We demonstrate that LLMs significantly outperform traditional models in tasks…

Human-Computer Interaction · Computer Science 2024-10-17 Bolun Sun , Yifan Zhou , Haiyun Jiang

Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Junlin Xie , Zhihong Chen , Ruifei Zhang , Xiang Wan , Guanbin Li

Recent advances in generative AI have led to remarkable interest in using systems that rely on large language models (LLMs) for practical applications. However, meaningful evaluation of these systems in real-world scenarios comes with a…

Artificial Intelligence · Computer Science 2025-07-22 Ethan M. Rudd , Christopher Andrews , Philip Tully

Large language models (LLMs) enabled dialogue systems have become one of the central modes in human-machine interaction, which bring about vast amounts of conversation logs and increasing demand for dialogue generation. The dialogue's…

Computation and Language · Computer Science 2025-06-02 Minzheng Wang , Xinghua Zhang , Kun Chen , Nan Xu , Haiyang Yu , Fei Huang , Wenji Mao , Yongbin Li

Large language models (LLMs) and LLM-based agents are increasingly deployed as assistants in planning and decision making, yet most existing systems are implicitly optimized for a single-principal interaction paradigm, in which the model is…

Computation and Language · Computer Science 2026-04-29 Shu Yang , Shenzhe Zhu , Hao Zhu , José Ramón Enríquez , Di Wang , Alex Pentland , Michiel A. Bakker , Jiaxin Pei

Recommender systems are essential components of many online platforms, yet traditional approaches still struggle with understanding complex user preferences and providing explainable recommendations. The emergence of Large Language Model…

Information Retrieval · Computer Science 2025-03-05 Qiyao Peng , Hongtao Liu , Hua Huang , Qing Yang , Minglai Shao

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and discourse phenomena…

Computation and Language · Computer Science 2025-08-29 Miguel Moura Ramos , Patrick Fernandes , Sweta Agrawal , André F. T. Martins

Effective engagement by large language models (LLMs) requires adapting responses to users' sociodemographic characteristics, such as age, occupation, and education level. While many real-world applications leverage dialogue history for…

Computation and Language · Computer Science 2025-05-28 Qishuai Zhong , Zongmin Li , Siqi Fan , Aixin Sun

Recent developments in large language models (LLMs) have unlocked new opportunities for healthcare, from information synthesis to clinical decision support. These new LLMs are not just capable of modeling language, but can also act as…

Human-Computer Interaction · Computer Science 2023-09-21 Nikita Mehandru , Brenda Y. Miao , Eduardo Rodriguez Almaraz , Madhumita Sushil , Atul J. Butte , Ahmed Alaa

While Large Language Model (LLM) based agents excel at complex tasks, their performance in open-ended scenarios is often constrained by isolated operation and reliance on static databases, missing the dynamic knowledge exchange of human…

Computation and Language · Computer Science 2026-03-06 Hang Gao , Yongfeng Zhang

Evaluation insights are limited by the availability of high-quality benchmarks. As models evolve, there is a need to create benchmarks that can measure progress on new and complex generative capabilities. However, manually creating new…

Machine Learning · Computer Science 2025-10-08 Natasha Butt , Varun Chandrasekaran , Neel Joshi , Besmira Nushi , Vidhisha Balachandran

Large Language Models (LLMs) show significant potential in economic and strategic interactions, where communication via natural language is often prevalent. This raises key questions: Do LLMs behave rationally? How do they perform compared…

Computation and Language · Computer Science 2026-03-03 Eilam Shapira , Omer Madmon , Itamar Reinman , Samuel Joseph Amouyal , Roi Reichart , Moshe Tennenholtz

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

Large-language-model (LLM) agents exhibit complex, context-sensitive behaviour that quickly renders static benchmarks and ad-hoc manual testing obsolete. We present Neo, a configurable, multi-agent framework that automates realistic,…

Full-Duplex Speech-to-Speech Large Language Models (LLMs) are foundational to natural human-computer interaction, enabling real-time spoken dialogue systems. However, benchmarking and modeling these models remains a fundamental challenge.…

Computation and Language · Computer Science 2025-09-29 Yuan Ge , Saihan Chen , Jingqi Xiao , Xiaoqian Liu , Tong Xiao , Yan Xiang , Zhengtao Yu , Jingbo Zhu

Each day, individuals set behavioral goals such as eating healthier, exercising regularly, or increasing productivity. While psychological frameworks (i.e., goal setting and implementation intentions) can be helpful, they often need…

Human-Computer Interaction · Computer Science 2026-02-10 Michel Schimpf , Sebastian Maier , Anton Wyrowski , Lara Christoforakos , Stefan Feuerriegel , Thomas Bohné

Large Language Models (LLMs) have made significant progress in open-ended dialogue, yet their inability to retain and retrieve relevant information from long-term interactions limits their effectiveness in applications requiring sustained…

We aim to evaluate Large Language Models (LLMs) for embodied decision making. While a significant body of work has been leveraging LLMs for decision making in embodied environments, we still lack a systematic understanding of their…

Large Language Model (LLM) agents increasingly serve as personal assistants and workplace collaborators, where their utility depends on memory systems that extract, retrieve, and apply information across long-running conversations. However,…

Computation and Language · Computer Science 2026-05-19 Jingbo Yang , Kwei-Herng Lai , Xiaowen Wang , Shiyu Chang , Yaar Harari , Evgeniy Gabrilovich