English
Related papers

Related papers: ColorAgent: Building A Robust, Personalized, and I…

200 papers

Dermatological diagnosis requires integrating fine-grained visual perception with expert clinical knowledge. Although Multimodal Large Language Models (MLLMs) facilitate interactive medical image analysis, their application in dermatology…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yize Liu , Siyuan Yan , Ming Hu , Lie Ju , Xieji Li , Feilong Tang , Wei Feng , Zongyuan Ge

Autonomous interaction with the computer has been a longstanding challenge with great potential, and the recent proliferation of large language models (LLMs) has markedly accelerated progress in building digital agents. However, most of…

Artificial Intelligence · Computer Science 2024-02-16 Zhiyong Wu , Chengcheng Han , Zichen Ding , Zhenmin Weng , Zhoumianze Liu , Shunyu Yao , Tao Yu , Lingpeng Kong

Large language models (LLMs) have evolved AI assistants into autonomous reasoning engines that maintain context, invoke tools, and pursue long-horizon tasks. This has spurred Agent Operating Systems (Agent OS) as kernel-like layers for…

Human-Computer Interaction · Computer Science 2026-05-18 Heyuan Huang , Yeyi Guan , Jihong Wang , Mingzhi Wang , Jiamu Zhou , Xiangmou Qu , Jiaxin Yin , Xin Liao , Xingyu Lou , Jun Wang

To fulfill user instructions, autonomous web agents must contend with the inherent complexity and volatile nature of real-world websites. Conventional paradigms predominantly rely on Supervised Fine-Tuning (SFT) or Offline Reinforcement…

Artificial Intelligence · Computer Science 2026-05-01 Yuyu Guo , Wenjie Yang , Siyuan Yang , Ziyang Liu , Cheng Chen , Yuan Wei , Yun Hu , Yang Huang , Guoliang Hao , Dongsheng Yuan , Jianming Wang , Xin Chen , Hang Yu , Lei Lei , Peng Di

Artificial intelligence has shown promise in medical imaging, yet most existing systems lack flexibility, interpretability, and adaptability - challenges especially pronounced in ophthalmology, where diverse imaging modalities are…

Wireless networks are increasingly facing challenges due to their expanding scale and complexity. These challenges underscore the need for advanced AI-driven strategies, particularly in the upcoming 6G networks. In this article, we…

Networking and Internet Architecture · Computer Science 2024-09-13 Jingwen Tong , Jiawei Shao , Qiong Wu , Wei Guo , Zijian Li , Zehong Lin , Jun Zhang

Dental image analysis plays a pivotal role in supporting accurate diagnosis and treatment planning in oral healthcare. Although recent advances have produced dental AI models for specific tasks and individual imaging modalities, their…

The Graphical User Interface (GUI) is how users interact with mobile apps. To ensure it functions properly, testing engineers have to make sure it functions as intended, based on test requirements that are typically written in natural…

Software Engineering · Computer Science 2024-07-15 Yongxiang Hu , Xuan Wang , Yingchuan Wang , Yu Zhang , Shiyu Guo , Chaoyi Chen , Xin Wang , Yangfan Zhou

Humans solve problems by executing targeted plans, yet large language models (LLMs) remain unreliable for structured workflow execution. We propose RunAgent, a multi-agent plan execution platform that interprets natural-language plans while…

Machine Learning · Computer Science 2026-05-04 Arunabh Srivastava , Mohammad A. , Khojastepour , Srimat Chakradhar , Sennur Ulukus

Human communication is a complex and diverse process that not only involves multiple factors such as language, commonsense, and cultural backgrounds but also requires the participation of multimodal information, such as speech. Large…

Computation and Language · Computer Science 2024-01-09 Dong Zhang , Zhaowei Li , Pengyu Wang , Xin Zhang , Yaqian Zhou , Xipeng Qiu

In this work, we propose MetaAgent, an agentic paradigm inspired by the principle of learning-by-doing, where expertise is developed through hands-on practice and continual self-improvement. MetaAgent starts with a minimal workflow,…

Artificial Intelligence · Computer Science 2025-09-03 Hongjin Qian , Zheng Liu

Tool learning empowers large language models (LLMs) as agents to use external tools and extend their utility. Existing methods employ one single LLM-based agent to iteratively select and execute tools, thereafter incorporating execution…

Computation and Language · Computer Science 2024-06-25 Zhengliang Shi , Shen Gao , Xiuyi Chen , Yue Feng , Lingyong Yan , Haibo Shi , Dawei Yin , Pengjie Ren , Suzan Verberne , Zhaochun Ren

We introduce Reagent, a technology that readily converts ordinary webpages containing structured data into software agents with which one can interact naturally, via a combination of speech and pointing. Previous efforts to make webpage…

Human-Computer Interaction · Computer Science 2018-10-30 Mathew Peveler , Jeffery Kephart , Hui Su

While Graphical User Interface (GUI) agents have shown promising performance in automated device interaction, they primarily depend on static parametric knowledge from pre-training or instruction tuning. This reliance fundamentally limits…

Artificial Intelligence · Computer Science 2026-05-19 Jingjing Liu , Ziye Huang , Zihao Cheng , Zeming Liu , Jiahong Wu , Yuhang Guo , Kehai Chen , Yunhong Wang , Haifeng Wang

This paper introduces GUI-Owl, a foundational GUI agent model that achieves state-of-the-art performance among open-source end-to-end models on ten GUI benchmarks across desktop and mobile environments, covering grounding, question…

Artificial Intelligence · Computer Science 2025-09-03 Jiabo Ye , Xi Zhang , Haiyang Xu , Haowei Liu , Junyang Wang , Zhaoqing Zhu , Ziwei Zheng , Feiyu Gao , Junjie Cao , Zhengxi Lu , Jitong Liao , Qi Zheng , Fei Huang , Jingren Zhou , Ming Yan

Large Language Models (LLMs)-based agents have made impressive progress in reasoning and tool use, enabling them to solve complex tasks. However, their ability to proactively collaborate with users, especially when goals are vague,…

A central bottleneck for phone-use agents is that controllable, reproducible environments covering real mobile behavior are hard to build at scale. Existing mobile-agent benchmarks have made important progress on evaluation, but they do not…

6G services are evolving toward goal-oriented and AI-native communication, which are expected to deliver transformative societal benefits across various industries and promote energy sustainability. Yet today's networking architectures,…

Networking and Internet Architecture · Computer Science 2026-03-26 Shutong Chen , Qi Liao , Adnan Aijaz , Yansha Deng

The believable simulation of multi-user behavior is crucial for understanding complex social systems. Recently, large language models (LLMs)-based AI agents have made significant progress, enabling them to achieve human-like intelligence…

Artificial Intelligence · Computer Science 2024-12-16 Yijun Liu , Wu Liu , Xiaoyan Gu , Yong Rui , Xiaodong He , Yongdong Zhang

Omnimodal large language models have made significant strides in unifying audio and visual modalities; however, they often face challenges in fine-grained cross-modal understanding and have difficulty with multimodal alignment. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Keda Tao , Wenjie Du , Bohan Yu , Weiqiang Wang , Jian Liu , Huan Wang