English
Related papers

Related papers: SocialMind: LLM-based Proactive AR Social Assistiv…

200 papers

Proactive agents that anticipate user intentions without explicit prompts represent a significant evolution in human-AI interaction, promising to reduce cognitive load and streamline workflows. However, existing datasets suffer from two…

Human-Computer Interaction · Computer Science 2026-02-11 Yuanbo Tang , Huaze Tang , Tingyu Cao , Lam Nguyen , Anping Zhang , Xinwen Cao , Chunkang Liu , Wenbo Ding , Yang Li

Modern Large Language Models (LLMs) exhibit impressive zero-shot and few-shot generalization capabilities across complex natural language tasks, enabling their widespread use as virtual assistants for diverse applications such as…

Computation and Language · Computer Science 2025-06-19 Arjun Vaithilingam Sudhakar

Evaluating the surroundings to gain understanding, frame perspectives, and anticipate behavioral reactions is an inherent human trait. However, these continuous encounters are diverse and complex, posing challenges to their study and…

Computers and Society · Computer Science 2026-02-26 Deepank Verma , Olaf Mumm , Vanessa Miriam Carlow

Recommender systems are essential components of many online platforms, yet traditional approaches still struggle with understanding complex user preferences and providing explainable recommendations. The emergence of Large Language Model…

Information Retrieval · Computer Science 2025-03-05 Qiyao Peng , Hongtao Liu , Hua Huang , Qing Yang , Minglai Shao

Information workers' productivity is significantly influenced by their cognitive states and physiological responses. AI assistants such as ChatGPT, Copilot, and others have become integral components of knowledge-intensive workplaces. These…

Human-Computer Interaction · Computer Science 2026-05-12 Amog Rao , Utkarsh Agarwal , Amol Harsh , Siddharth Siddharth

The social science of large language models (LLMs) examines how these systems evoke mind attributions, interact with one another, and transform human activity and institutions. We conducted a systematic review of 270 studies, combining text…

Artificial Intelligence · Computer Science 2025-10-28 Xiao Jia , Zhanzhan Zhao

Vision-Language Models (VLMs) typically assume a uniform spatial fidelity across the entire field of view of visual inputs, dedicating equal precision to even the uninformative regions. By contrast, human vision is neither uniform nor…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Soumyaratna Debnath , Bui Duc Manh , Zinan Liu , Lin Wang

Proactive and real-time interactive experiences are essential for human-like AI companions, yet face three key challenges: (1) achieving low-latency inference under continuous streaming inputs, (2) autonomously deciding when to respond, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weicai Yan , Yuhong Dai , Qi Ran , Haodong Li , Wang Lin , Tao Jin , Xing Xie , Hao Liao , Jianxun Lian

Large language models have increasingly been proposed as a powerful replacement for classical agent-based models (ABMs) to simulate social dynamics. By using LLMs as a proxy for human behavior, the hope of this new approach is to be able to…

Computers and Society · Computer Science 2024-12-09 Da Ju , Adina Williams , Brian Karrer , Maximilian Nickel

We introduce LlamaPIE, the first real-time proactive assistant designed to enhance human conversations through discreet, concise guidance delivered via hearable devices. Unlike traditional language models that require explicit user…

Machine Learning · Computer Science 2025-07-30 Tuochao Chen , Nicholas Batchelder , Alisa Liu , Noah Smith , Shyamnath Gollakota

Smart assistants increasingly act proactively, yet mistimed or intrusive behavior often causes users to lose trust and disable these features. Learning user preferences for proactive assistance is difficult because real-world studies are…

Human-Computer Interaction · Computer Science 2026-02-05 Ziyi Xuan , Yiwen Wu , Zhaoyang Yan , Vinod Namboodiri , Yu Yang

Providing students with flexible and timely academic support is a challenge at most colleges and universities, leaving many students without help outside scheduled hours. Large language models (LLMs) are promising for bridging this gap, but…

Computers and Society · Computer Science 2025-09-12 Chang Liu , Loc Hoang , Andrew Stolman , Rene F. Kizilcec , Bo Wu

Large Language Model (LLM) agents have developed rapidly in recent years to solve complex real-world problems using external tools. However, the scarcity of high-quality trajectories still hinders the development of stronger LLM agents.…

Artificial Intelligence · Computer Science 2025-12-08 Chen Yang , Ran Le , Yun Xing , Zhenwei An , Zongchao Chen , Wayne Xin Zhao , Yang Song , Tao Zhang

To increase social bonding with interlocutors, humans naturally acquire the ability to respond appropriately in a given situation by considering which conversational skill is most suitable for the response - a process we call skill-of-mind.…

Computation and Language · Computer Science 2024-11-08 Young-Jun Lee , Dokyong Lee , Junyoung Youn , Kyeongjin Oh , Ho-Jin Choi

Human communication is a complex and diverse process that not only involves multiple factors such as language, commonsense, and cultural backgrounds but also requires the participation of multimodal information, such as speech. Large…

Computation and Language · Computer Science 2024-01-09 Dong Zhang , Zhaowei Li , Pengyu Wang , Xin Zhang , Yaqian Zhou , Xipeng Qiu

The development of AI agents based on large, open-domain language models (LLMs) has paved the way for the development of general-purpose AI assistants that can support human in tasks such as writing, coding, graphic design, and scientific…

Artificial Intelligence · Computer Science 2025-06-03 Mustafa Mert Çelikok , Saptarashmi Bandyopadhyay , Robert Loftin

Ideation is a critical component of video-based design (VBD), where videos serve as the primary medium for design exploration and inspiration. The emergence of generative AI offers considerable potential to enhance this process by…

Human-Computer Interaction · Computer Science 2024-11-07 Tianhao He , Andrija Stankovic , Evangelos Niforatos , Gerd Kortuem

Conversational Assistants (CA) are increasingly supporting human workers in knowledge management. Traditionally, CAs respond in specific ways to predefined user intents and conversation patterns. However, this rigidness does not handle the…

Human-Computer Interaction · Computer Science 2024-07-15 Samuel Kernan Freire , Chaofan Wang , Evangelos Niforatos

Social media enables dynamic user engagement with trending topics, and recent research has explored the potential of large language models (LLMs) for response generation. While some studies investigate LLMs as agents for simulating user…

Computation and Language · Computer Science 2025-02-18 Zhongyi Qiu , Hanjia Lyu , Wei Xiong , Jiebo Luo

Traditional Human-Swarm Interaction (HSI) methods often lack intuitive real-time adaptive interfaces, making decision making slower and increasing cognitive load while limiting command flexibility. To solve this, we present SwarmChat, a…

Robotics · Computer Science 2025-09-23 Ettilla Mohiuddin Eumi , Hussein Abbass , Nadine Marcus