English
Related papers

Related papers: UI-Evol: Automatic Knowledge Evolving for Computer…

200 papers

Agentic evolution has emerged as a powerful paradigm for improving programs, workflows, and scientific solutions by iteratively generating candidates, evaluating them, and using feedback to guide future search. However, existing methods are…

Artificial Intelligence · Computer Science 2026-05-14 Jiayi Zhang , Yongfeng Gu , Jianhao Ruan , Maojia Song , Yiran Peng , Zhiguang Han , Jinyu Xiang , Zhitao Wang , Caiyin Yang , Yixi Ouyang , Bang Liu , Chenglin Wu , Yuyu Luo

Human-like Agents with diverse and dynamic personalities could serve as an essential design probe in the process of user-centered design, thereby enabling designers to enhance the user experience of interactive applications. In this…

Human-Computer Interaction · Computer Science 2024-06-18 Jiale Li , Jiayang Li , Jiahao Chen , Yifan Li , Shijie Wang , Hugo Zhou , Minjun Ye , Yunsheng Su

Autonomous graphical user interface (GUI) agents aim to facilitate task automation by interacting with the user interface without manual intervention. Recent studies have investigated eliciting the capabilities of large language models…

Computation and Language · Computer Science 2024-06-10 Zhuosheng Zhang , Aston Zhang

Agent skills today are static artifact: authored once -- by human curation or one-shot generation from parametric knowledge -- and then consumed unchanged, with no mechanism to improve from real use. We propose \textbf{SkillEvolver}, a…

Artificial Intelligence · Computer Science 2026-05-12 Genrui Zhang , Erle Zhu , Jinfeng Zhou , Caiyan Jia , Hongning Wang

Designing protocols enhancing cooperation for multi-agent systems remains a grand challenge. Cheap talk, defined as costless, non-binding communication before formal action, serves as a pivotal solution. However, existing theoretical…

Multiagent Systems · Computer Science 2026-03-03 Zhao Song , Chen Shen , Zhen Wang , The Anh Han

The rapid proliferation of scientific knowledge presents a grand challenge: transforming this vast repository of information into an active engine for discovery, especially in high-stakes domains like healthcare. Current AI agents, however,…

Artificial Intelligence · Computer Science 2025-10-14 Yinghao Zhu , Yifan Qi , Zixiang Wang , Lei Gu , Dehao Sui , Haoran Hu , Xichen Zhang , Ziyi He , Junjun He , Liantao Ma , Lequan Yu

Computer use agents (CUA) are systems that automatically interact with graphical user interfaces (GUIs) to complete tasks. CUA have made significant progress with the advent of large vision-language models (VLMs). However, these agents…

Artificial Intelligence · Computer Science 2025-06-04 Man Luo , David Cobbley , Xin Su , Shachar Rosenman , Vasudev Lal , Shao-Yen Tseng , Phillip Howard

Previous research has demonstrated the potential of AI agents to act as companions that can provide constant emotional support for humans. In this paper, we emphasize the necessity of autonomous adaptation in personal AI companionship, an…

Computation and Language · Computer Science 2025-06-10 Yi Cheng , Wenge Liu , Kaishuai Xu , Wenjun Hou , Yi Ouyang , Chak Tou Leong , Wenjie Li , Xian Wu , Yefeng Zheng

Embodied Artificial Intelligence (AI) is an intelligent system formed by agents and their environment through active perception, embodied cognition, and action interaction. Existing embodied AI remains confined to human-crafted setting, in…

Emerging Technologies · Computer Science 2026-02-05 Tongtong Feng , Xin Wang , Wenwu Zhu

A fundamental aspect of behaviour is the ability to encode salient features of experience in memory and use these memories, in combination with current sensory information, to predict the best action for each situation such that long-term…

Neural and Evolutionary Computing · Computer Science 2021-06-25 Stephen Kelly , Tatiana Voegerl , Wolfgang Banzhaf , Cedric Gondro

Embodied AI agents continue to become more capable every year with the advent of new models, environments, and benchmarks, but are still far away from being performant and reliable enough to be deployed in real, user-facing, applications.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Kunal Pratap Singh , Luca Weihs , Alvaro Herrasti , Jonghyun Choi , Aniruddha Kemhavi , Roozbeh Mottaghi

While AI agents demonstrate remarkable capabilities in reasoning and tool use, they remain fundamentally reactive: they compute responses only after explicit user prompts. This paradigm ignores a critical opportunity: the idle time between…

Computation and Language · Computer Science 2026-05-27 Haoyi Hu , Qirong Lyu , Xianghan Kong , Weiwen Liu , Jianghao Lin , Zixuan Guo , Yan Xu , Yasheng Wang , Weinan Zhang , Yong Yu

Many challenges remain before AI agents can be deployed in real-world environments. However, one virtue of such environments is that they are inherently multi-agent and contain human experts. Using advanced social intelligence in such an…

Machine Learning · Computer Science 2025-08-22 Eric Ye , Ren Tao , Natasha Jaques

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

Computer-use agents (CUAs) automate on-screen work, as illustrated by GPT-5.4 and Claude. Yet their reliability on complex, low-frequency interactions is still poor, limiting user trust. Our analysis of failure cases from advanced models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Miaosen Zhang , Xiaohan Zhao , Zhihong Tan , Zhou Huoshen , Yijia Fan , Yifan Yang , Kai Qiu , Bei Liu , Justin Wagle , Chenzhong Yin , Mingxi Cheng , Ji Li , Qi Dai , Chong Luo , Xu Yang , Xin Geng , Baining Guo

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Motivated by concerns that AI-driven entry-level automation may deprive new generations of valuable work experience, this paper studies how technological change affects the intergenerational transmission of tacit knowledge -- practical,…

General Economics · Economics 2026-04-03 Enrique Ide

This paper presents Face2Feel, a novel user interface (UI) model that dynamically adapts to user emotions and preferences captured through computer vision. This adaptive UI framework addresses the limitations of traditional static…

Human-Computer Interaction · Computer Science 2025-10-02 Ismail Alihan Hadimlioglu , Siddharth Linga

Test-time evolution of agent memory serves as a pivotal paradigm for achieving AGI by bolstering complex reasoning through experience accumulation. However, even during benign task evolution, agent safety alignment remains vulnerable-a…

Artificial Intelligence · Computer Science 2026-02-04 Yu Cheng , Jiuan Zhou , Yongkang Hu , Yihang Chen , Huichi Zhou , Mingang Chen , Zhizhong Zhang , Kun Shao , Yuan Xie , Zhaoxia Yin

Achieving truly adaptive embodied intelligence requires agents that learn not just by imitating static demonstrations, but by continuously improving through environmental interaction, which is akin to how humans master skills through…

Robotics · Computer Science 2025-12-17 Zechen Bai , Chen Gao , Mike Zheng Shou