English
Related papers

Related papers: Tachikuma: Understading Complex Interactions with …

200 papers

Recent advances in foundation models, particularly Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), have facilitated the development of intelligent agents capable of performing complex tasks. By leveraging the…

Large language models (LLMs) have facilitated significant strides in generating conversational agents, enabling seamless, contextually relevant dialogues across diverse topics. However, the existing LLM-driven conversational agents have…

Human-Computer Interaction · Computer Science 2024-02-26 Juhye Ha , Hyeon Jeon , DaEun Han , Jinwook Seo , Changhoon Oh

The evolution of Large Language Models (LLMs) into autonomous agents necessitates the management of extensive, dynamic contexts. Current benchmarks, however, remain largely static, relying on passive retrieval tasks that fail to simulate…

Computation and Language · Computer Science 2026-02-02 Shicheng Fang , Yuxin Wang , Xiaoran Liu , Jiahao Lu , Chuanyuan Tan , Xinchi Chen , Yining Zheng , Xuanjing Huang , Xipeng Qiu

Modern Large Language Models (LLMs) exhibit impressive zero-shot and few-shot generalization capabilities across complex natural language tasks, enabling their widespread use as virtual assistants for diverse applications such as…

Computation and Language · Computer Science 2025-06-19 Arjun Vaithilingam Sudhakar

Graphical User Interface (GUI) agents are autonomous systems that interpret and generate actions, enabling intelligent user assistance and automation. Effective training of these agent presents unique challenges, such as sparsity in…

Computation and Language · Computer Science 2025-03-28 Yiqiao Jin , Stefano Petrangeli , Yu Shen , Gang Wu

The study of emergent behaviors in large language model (LLM)-driven multi-agent systems is a critical research challenge, yet progress is limited by a lack of principled methodologies for controlled experimentation. To address this, we…

Artificial Intelligence · Computer Science 2025-10-13 So Kuroki , Yingtao Tian , Kou Misaki , Takashi Ikegami , Takuya Akiba , Yujin Tang

Recently, large language model (LLM)-based agents have made significant advances across various fields. One of the most popular research areas involves applying these agents to video games. Traditionally, these methods have relied on game…

Artificial Intelligence · Computer Science 2024-09-24 Peng Chen , Pi Bu , Jun Song , Yuan Gao , Bo Zheng

Towards an embodied generalist for real-world interaction, Multimodal Large Language Model (MLLM) agents still suffer from challenging latency, sparse feedback, and irreversible mistakes. Video games offer an ideal testbed with rich visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Mingyu Ouyang , Siyuan Hu , Kevin Qinghong Lin , Hwee Tou Ng , Mike Zheng Shou

The rapid advancement of chat-based language models has led to remarkable progress in complex task-solving. However, their success heavily relies on human input to guide the conversation, which can be challenging and time-consuming. This…

Artificial Intelligence · Computer Science 2023-11-03 Guohao Li , Hasan Abed Al Kader Hammoud , Hani Itani , Dmitrii Khizbullin , Bernard Ghanem

Agentic systems have transformed how Large Language Models (LLMs) can be leveraged to create autonomous systems with goal-directed behaviors, consisting of multi-step planning and the ability to interact with different environments. These…

Artificial Intelligence · Computer Science 2026-01-27 Judy Zhu , Dhari Gandhi , Himanshu Joshi , Ahmad Rezaie Mianroodi , Sedef Akinli Kocak , Dhanesh Ramachandran

Large language models (LLMs) are increasingly leveraged to empower autonomous agents to simulate human beings in various fields of behavioral research. However, evaluating their capacity to navigate complex social interactions remains a…

Computation and Language · Computer Science 2024-11-26 Xinyi Mou , Jingcong Liang , Jiayu Lin , Xinnong Zhang , Xiawei Liu , Shiyue Yang , Rong Ye , Lei Chen , Haoyu Kuang , Xuanjing Huang , Zhongyu Wei

This article explores the dynamic influence of computational entities based on multi-agent systems theory (SMA) combined with large language models (LLM), which are characterized by their ability to simulate complex human interactions, as a…

Artificial Intelligence · Computer Science 2024-03-18 Carlos Jose Xavier Cruz

The emergence of complex life on Earth is often attributed to the arms race that ensued from a huge number of organisms all competing for finite resources. We present an artificial intelligence research environment, inspired by the human…

Multiagent Systems · Computer Science 2019-03-05 Joseph Suarez , Yilun Du , Phillip Isola , Igor Mordatch

Enhancing AI systems with efficient communication skills for effective human assistance necessitates proactive initiatives from the system side to discern specific circumstances and interact aptly. This research focuses on a collective…

Computation and Language · Computer Science 2024-02-09 Jack Zhang

The era of Large Language Models (LLMs) presents a new opportunity for interpretability--agentic interpretability: a multi-turn conversation with an LLM wherein the LLM proactively assists human understanding by developing and leveraging a…

Artificial Intelligence · Computer Science 2025-06-17 Been Kim , John Hewitt , Neel Nanda , Noah Fiedel , Oyvind Tafjord

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential…

Artificial Intelligence · Computer Science 2024-04-10 Saikat Barua

Large Language Models (LLMs) have the capacity of performing complex scheduling in a multi-agent system and can coordinate these agents into completing sophisticated tasks that require extensive collaboration. However, despite the…

Artificial Intelligence · Computer Science 2023-09-20 Ran Gong , Qiuyuan Huang , Xiaojian Ma , Hoi Vo , Zane Durante , Yusuke Noda , Zilong Zheng , Song-Chun Zhu , Demetri Terzopoulos , Li Fei-Fei , Jianfeng Gao

Recent work has proposed a methodology for the systematic evaluation of "Situated Language Understanding Agents"-agents that operate in rich linguistic and non-linguistic contexts-through testing them in carefully constructed interactive…

Computation and Language · Computer Science 2023-11-27 Kranti Chalamalasetti , Jana Götze , Sherzod Hakimov , Brielen Madureira , Philipp Sadler , David Schlangen

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

As large language models (LLMs) evolve into autonomous agents capable of acting in open-ended environments, ensuring behavioral alignment with human values becomes a critical safety concern. Existing benchmarks, focused on static,…

Computation and Language · Computer Science 2026-03-10 Weixiang Zhao , Haozhen Li , Yanyan Zhao , xuda zhi , Yongbo Huang , Hao He , Bing Qin , Ting Liu