English
Related papers

Related papers: Mobilizing Waldo: Evaluating Multimodal AI for Pub…

200 papers

The rapid advancement of Large Language Models (LLMs) has significantly impacted human-computer interaction, epitomized by the release of GPT-4o, which introduced comprehensive multi-modality capabilities. In this paper, we first explored…

Multimedia · Computer Science 2024-05-28 Haiwei Dong , Shuang Xie

Significant advancements have occurred in the application of Large Language Models (LLMs) for social simulations. Despite this, their abilities to perform teaming in task-oriented social events are underexplored. Such capabilities are…

Artificial Intelligence · Computer Science 2025-08-18 Yuan Li , Lichao Sun , Yixuan Zhang

Large language models (LLMs) are increasingly proposed as agents in strategic decision environments, yet their behavior in structured geopolitical simulations remains under-researched. We evaluate six popular state-of-the-art LLMs alongside…

Computation and Language · Computer Science 2026-03-03 Veronika Solopova , Viktoria Skorik , Maksym Tereshchenko , Alina Haidun , Ostap Vykhopen

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

The recent developments in Large Language Models (LLM), mark a significant moment in the research and development of social interactions with artificial agents. These agents are widely deployed in a variety of settings, with potential…

Human-Computer Interaction · Computer Science 2024-07-03 Guy Laban , Tomer Laban , Hatice Gunes

Conversational agents show the promise to allow users to interact with mobile devices using language. However, to perform diverse UI tasks with natural language, developers typically need to create separate datasets and models for each…

Human-Computer Interaction · Computer Science 2023-02-21 Bryan Wang , Gang Li , Yang Li

Understanding how humans collaborate and communicate in teams is essential for improving human-agent teaming and AI-assisted decision-making. However, relying solely on data from large-scale user studies is impractical due to logistical,…

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

Large Language Models (LLMs) are a transformational technology, fundamentally changing how people obtain information and interact with the world. As people become increasingly reliant on them for an enormous variety of tasks, a body of…

Computers and Society · Computer Science 2025-05-08 Nouar Aldahoul , Hazem Ibrahim , Matteo Varvello , Aaron Kaufman , Talal Rahwan , Yasir Zaki

Recent work in open-domain conversational agents has demonstrated that significant improvements in model engagingness and humanness metrics can be achieved via massive scaling in both pre-training data and model size (Adiwardana et al.,…

Computation and Language · Computer Science 2020-10-05 Kurt Shuster , Eric Michael Smith , Da Ju , Jason Weston

Large Language Models (LLMs) have gained popularity in task planning for long-horizon manipulation tasks. To enhance the validity of LLM-generated plans, visual demonstrations and online videos have been widely employed to guide the…

Robotics · Computer Science 2025-03-12 Kejia Chen , Zheng Shen , Yue Zhang , Lingyun Chen , Fan Wu , Zhenshan Bing , Sami Haddadin , Alois Knoll

In recent years, significant concern has emerged regarding the potential threat that Large Language Models (LLMs) pose to democratic societies through their persuasive capabilities. We expand upon existing research by conducting two survey…

Computation and Language · Computer Science 2025-05-02 Zhongren Chen , Joshua Kalla , Quan Le , Shinpei Nakamura-Sakai , Jasjeet Sekhon , Ruixiao Wang

Large Language Models (LLMs) enable unprecedented social science experimentation by creating controlled hybrid human-AI environments. We introduce Epitome (www.epitome-ai.com), an open experimental platform that operationalizes this…

Computers and Society · Computer Science 2025-12-25 Jingjing Qu , Kejia Hu , Jun Zhu , Yulei Ye , Wenhao Li , Teng Wang , Zhiyun Chen , Chaochao Lu , Aimin Zhou , Xiangfeng Wang , Xia Hu , James Evans

Simulation powered by Large Language Models (LLMs) has become a promising method for exploring complex human social behaviors. However, the application of LLMs in simulations presents significant challenges, particularly regarding their…

Computers and Society · Computer Science 2025-02-26 Qian Wang , Zhenheng Tang , Bingsheng He

Large language models (LLMs) are increasing in capability and popularity, propelling their application in new domains -- including as replacements for human participants in computational social science, user testing, annotation tasks, and…

Computers and Society · Computer Science 2025-02-04 Angelina Wang , Jamie Morgenstern , John P. Dickerson

Human behavior models are essential as behavior references and for simulating human agents in virtual safety assessment of automated vehicles (AVs), yet current models face a trade-off between interpretability and flexibility.…

Artificial Intelligence · Computer Science 2026-05-19 Samir H. A. Mohammad , Wouter Mooi , Arkady Zgonnikov

Large Language Models (LLMs) have transformed agent-agent and human-agent interaction by enabling software, physical, and simulation agents to communicate and deliberate through natural language. Yet fluent language use does not by itself…

Multiagent Systems · Computer Science 2026-05-05 Önder Gürcan , Moharram Challenger

Autonomous agents have long been a prominent research focus in both academic and industry communities. Previous research in this field often focuses on training agents with limited knowledge within isolated environments, which diverges…

Artificial Intelligence · Computer Science 2025-03-04 Lei Wang , Chen Ma , Xueyang Feng , Zeyu Zhang , Hao Yang , Jingsen Zhang , Zhiyuan Chen , Jiakai Tang , Xu Chen , Yankai Lin , Wayne Xin Zhao , Zhewei Wei , Ji-Rong Wen

Proactive task-oriented dialogue (TOD), such as outbound sales, demands a persuasive agent that actively probes the user's concerns and steers the conversation toward acceptance within a bounded number of turns. Yet post-trained LLMs are…

Artificial Intelligence · Computer Science 2026-05-22 Hongbin Zhang , Ning Gao , Yuqin Dai , Ruiyuan Wu , Jinpeng Wang , Rena Wei Gao , Bingdong Tan , Shuzheng Gao , Zongjie Li , Chaozheng Wang

This study investigates the potential of a multimodal large language model (LLM), specifically ChatGPT-4o, to perform human-like interpretations of traffic scenes using static dashcam images. Herein, we focus on three judgment tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Yuki Yoshihara , Linjing Jiang , Nihan Karatas , Hitoshi Kanamori , Asuka Harada , Takahiro Tanaka