English
Related papers

Related papers: How do Visual Attributes Influence Web Agents? A C…

200 papers

Graphical user interfaces (GUIs) are the primary medium for human-computer interaction, yet automating GUI interactions remains challenging due to the complexity of visual elements, dynamic environments, and the need for multi-step…

Natural human conversation is full-duplex and audio-visual: people simultaneously speak and listen while continuously interpreting and producing nonverbal cues, such as nods, smiles, and gestures. To support successful human-agent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Amrita Mazumdar , Seonwook Park , Rajarshi Roy , Nikhil Srihari , Shengze Wang , Yuhao Zhou , Julia Wang , Koki Nagano , Shalini De Mello

In this paper, we consider a setting where heterogeneous agents with connectivity are performing inference using unlabeled streaming data. Observed data are only partially informative about the target variable of interest. In order to…

Machine Learning · Computer Science 2025-01-28 Mert Kayaalp , Yunus Inan , Visa Koivunen , Ali H. Sayed

The rise of AI conversational agents has broadened opportunities to enhance human capabilities across various domains. As these agents become more prevalent, it is crucial to investigate the impact of different affective abilities on their…

Human-Computer Interaction · Computer Science 2023-10-20 Javier Hernandez , Jina Suh , Judith Amores , Kael Rowan , Gonzalo Ramos , Mary Czerwinski

Food recommender systems play an important role in assisting users to identify the desired food to eat. Deciding what food to eat is a complex and multi-faceted process, which is influenced by many factors such as the ingredients,…

Information Retrieval · Computer Science 2019-01-08 Xiaoyan Gao , Fuli Feng , Xiangnan He , Heyan Huang , Xinyu Guan , Chong Feng , Zhaoyan Ming , Tat-Seng Chua

Text-to-image models produce graphic design at production scale, but their supervision comes from photo-style preference data with a single overall verdict per comparison. Designers evaluate along several distinct axes, including…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Haonan Zhu , Elad Hirsch , Alexandria Minetti , Allison Nulty , Purvanshi Mehta

Large language model (LLM)-based computer use agents execute user commands by interacting with available UI elements, but little is known about how users want to interact with these agents or what design factors matter for their user…

Human-Computer Interaction · Computer Science 2026-02-10 Ruijia Cheng , Jenny T. Liang , Eldon Schoop , Jeffrey Nichols

Given pedestrians' vulnerability in road traffic, it remains unclear how novel AV appearances will impact pedestrians crossing behaviour. To address this gap, this study pioneers an investigation into the influence of AVs' exterior design,…

Human-Computer Interaction · Computer Science 2024-07-10 Wei Lyu , Yaqin Cao , Yi Ding , Jingyu Li , Kai Tian , Hui Zhang

Recently, recommender systems play a pivotal role in alleviating the problem of information overload. Latent factor models have been widely used for recommendation. Most existing latent factor models mainly utilize the interaction…

Information Retrieval · Computer Science 2019-09-17 Chuan Shi , Xiaotian Han , Li Song , Xiao Wang , Senzhang Wang , Junping Du , Philip S. Yu

The General Video Game AI competitions have been the testing ground for several techniques for game playing, such as evolutionary computation techniques, tree search algorithms, hyper heuristic based or knowledge based algorithms. So far…

Artificial Intelligence · Computer Science 2018-06-05 Ivan Bravi , Jialin Liu , Diego Perez-Liebana , Simon Lucas

There is an intricate relation between the properties of an image and how humans behave while describing the image. This behavior shows ample variation, as manifested in human signals such as eye movements and when humans start to describe…

Computation and Language · Computer Science 2024-02-05 Ece Takmaz , Sandro Pezzelle , Raquel Fernández

The dark patterns, deceptive interface designs manipulating user behaviors, have been extensively studied for their effects on human decision-making and autonomy. Yet, with the rising prominence of LLM-powered GUI agents that automate tasks…

Agentic AI increasingly intervenes proactively by inferring users' situations from contextual data yet often fails for lack of principled judgment about when, why, and whether to act. We address this gap by proposing a conceptual model that…

Artificial Intelligence · Computer Science 2026-02-27 Soyoung Jung , Daehoo Yoon , Sung Gyu Koh , Young Hwan Kim , Yehan Ahn , Sung Park

Computational thematic analysis is rapidly emerging as a method of using large text corpora to understand the lived experience of people across the continuum of health care: patients, practitioners, and everyone in between. However, many…

Human-Computer Interaction · Computer Science 2024-12-20 Luka Ugaya Mazza , Plinio Morita , James R. Wallace

Explanations are central to improving transparency, trust, and user satisfaction in recommender systems (RS), yet it remains unclear how different explanation formats (visual vs. textual) are suited to users with different personal…

Human-Computer Interaction · Computer Science 2026-03-27 Qurat Ul Ain , Mohamed Amine Chatti , Nasim Yazdian Varjani , Farah Kamal , Astrid Rosenthal-von der Pütten

Web agents automate browser tasks, ranging from simple form completion to complex workflows like ordering groceries. While current benchmarks evaluate general-purpose performance~(e.g., WebArena) or safety against malicious actions~(e.g.,…

Cryptography and Security · Computer Science 2026-04-09 Guruprasad Viswanathan Ramesh , Asmit Nayak , Basieem Siddique , Kassem Fawaz

Agent systems powered by large language models (LLMs) have demonstrated impressive performance on repository-level code-generation tasks. However, for tasks such as website codebase generation, which depend heavily on visual effects and…

Computation and Language · Computer Science 2025-09-29 Zimu Lu , Houxing Ren , Yunqiao Yang , Ke Wang , Zhuofan Zong , Junting Pan , Mingjie Zhan , Hongsheng Li

Multi-agent systems often operate under feedback, adaptation, and non-stationarity, yet many simulation studies retain static decision rules and fixed control parameters. This paper introduces a general adaptive multi-agent learning…

Multiagent Systems · Computer Science 2025-11-26 Roberto Garrone

Web browsers are a portal to the internet, where much of human activity is undertaken. Thus, there has been significant research work in AI agents that interact with the internet through web browsing. However, there is also another…

Computation and Language · Computer Science 2025-06-18 Yueqi Song , Frank Xu , Shuyan Zhou , Graham Neubig

We present a recurrent agent who perceives surroundings through a series of discrete fixations. At each timestep, the agent imagines a variety of plausible scenes consistent with the fixation history. The next fixation is planned using…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Samrudhdhi B. Rangrej , James J. Clark