English
Related papers

Related papers: AQuaUI: Visual Token Reduction for GUI Agents with…

200 papers

Mobile GUI agents powered by large foundation models enable autonomous task execution, but frequent updates altering UI appearance and reorganizing workflows cause agents trained on historical data to fail. Despite surface changes,…

Artificial Intelligence · Computer Science 2026-02-03 Libo Sun , Jiwen Zhang , Siyuan Wang , Zhongyu Wei

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

We present Qwen-Image, an image generation foundation model in the Qwen series that achieves significant advances in complex text rendering and precise image editing. To address the challenges of complex text rendering, we design a…

In contemporary design practices, the integration of computer vision and generative artificial intelligence (genAI) represents a transformative shift towards more interactive and inclusive processes. These technologies offer new dimensions…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Timo Kapsalis

Long-form video understanding remains challenging for Video Large Language Models (VideoLLMs), as the dense frame sampling introduces massive visual tokens while sparse sampling risks missing critical temporal evidence and leading to LLM…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Jiameng Li , Minye Wu , Jiezhang Cao , Aleksei Tiulpin , Matthew B. Blaschko

Multimodal large language models (MLLMs) have made significant strides by integrating visual and textual modalities. A critical factor in training MLLMs is the quality of image-text pairs within multimodal pretraining datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Han Huang , Yuqi Huo , Zijia Zhao , Haoyu Lu , Shu Wu , Bingning Wang , Qiang Liu , Weipeng Chen , Liang Wang

Recent progress in GUI agents has substantially improved visual grounding, yet robust planning remains challenging, particularly when the environment deviates from a canonical initial state. In real applications, users often invoke…

Artificial Intelligence · Computer Science 2026-05-26 Henry Hengyuan Zhao , Kaiming Yang , Wendi Yu , Difei Gao , Mike Zheng Shou

Classical GAN architectures have shown interesting results for solving anomaly detection problems in general and for time series anomalies in particular, such as those arising in communication networks. In recent years, several quantum GAN…

Machine Learning · Computer Science 2023-10-10 Benjamin Kalfon , Soumaya Cherkaoui , Jean-Frédéric Laprade , Ola Ahmad , Shengrui Wang

While Large Language Model (LLM) agents show great potential for automated UI navigation such as automated UI testing and AI assistants, their efficiency has been largely overlooked. Our motivating study reveals that inefficient UI…

Software Engineering · Computer Science 2025-12-16 Dezhi Ran , Zhi Gong , Yuzhe Guo , Mengzhou Wu , Yuan Cao , Haochuan Lu , Hengyu Zhang , Xia Zeng , Gang Cao , Liangchao Yao , Yuetang Deng , Wei Yang , Tao Xie

Graphical User Interface (GUI) grounding plays a crucial role in enhancing the capabilities of Vision-Language Model (VLM) agents. While general VLMs, such as GPT-4V, demonstrate strong performance across various tasks, their proficiency in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Anthony Nguyen

Contemporary GUI agents, while increasingly capable due to advances in Large Vision-Language Models (VLMs), often operate with a critical limitation: they treat each task in isolation, lacking a mechanism to systematically learn from past…

Artificial Intelligence · Computer Science 2026-04-13 Runze Li , Yuwen Zhai , Bo Xu , LiWu Xu , Nian Shi , Wei Zhang , Ran Lin , Liang Wang

To realize Quantitative MRI (QMRI) with clinically acceptable scan time, acceleration factors achieved by conventional parallel imaging techniques are often inadequate. Further acceleration is possible using model-based reconstruction. We…

Signal Processing · Electrical Eng. & Systems 2022-02-23 Riwaj Byanju , Stefan Klein , Alexandra Cristobal-Huerta , J. A. Hernandez-Tamames , Dirk H. J. Poot

Recent advances in Multimodal Large Language Models (MLLMs) have expanded reasoning capabilities into 3D domains, enabling fine-grained spatial understanding. However, the substantial size of 3D MLLMs and the high dimensionality of input…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Yuhui Lin , Siyue Yu , Yuxing Yang , Guangliang Cheng , Jimin Xiao

Watermarking has emerged as a pivotal solution for content traceability and intellectual property protection in Large Vision-Language Models (LVLMs). However, vision-agnostic watermarks may introduce visually irrelevant tokens and disrupt…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yue Li , Xin Yi , Dongsheng Shi , Yongyi Cui , Gerard de Melo , Linlin Wang

While the efficacy of deep learning models heavily relies on data, gathering and annotating data for specific tasks, particularly when addressing novel or sensitive subjects lacking relevant datasets, poses significant time and resource…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Quang-Binh Nguyen , Trong-Vu Hoang , Ngoc-Do Tran , Tam V. Nguyen , Minh-Triet Tran , Trung-Nghia Le

Modern software systems are subjected to various types of uncertainties arising from context, environment, etc. To this end, self-adaptation techniques have been sought out as potential solutions. Although recent advances in self-adaptation…

Software Engineering · Computer Science 2024-04-16 Raghav Donakanti , Prakhar Jain , Shubham Kulkarni , Karthik Vaidhyanathan

As terminal agents scale to long-horizon, multi-turn workflows, a key bottleneck is not merely limited context length, but the accumulation of noisy terminal observations in the interaction history. Retaining raw observations preserves…

Computation and Language · Computer Science 2026-05-18 Jincheng Ren , Siwei Wu , Yizhi Li , Kang Zhu , Shu Xu , Boyu Feng , Ruibin Yuan , Wei Zhang , Riza Batista-Navarro , Jian Yang , Chenghua Lin

Recently, Multimodal Large Language Models (MLLMs) have been used as agents to control keyboard and mouse inputs by directly perceiving the Graphical User Interface (GUI) and generating corresponding commands. However, current agents…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Dongping Chen , Yue Huang , Siyuan Wu , Jingyu Tang , Liuyi Chen , Yilin Bai , Zhigang He , Chenlong Wang , Huichi Zhou , Yiqiang Li , Tianshuo Zhou , Yue Yu , Chujie Gao , Qihui Zhang , Yi Gui , Zhen Li , Yao Wan , Pan Zhou , Jianfeng Gao , Lichao Sun

There is an urgent need for streamlining radiology Quality Assurance (QA) programs to make them better and faster. Here, we present a novel approach, Artificial Intelligence (AI)-Based QUality Assurance by Restricted Investigation of…

Human-Computer Interaction · Computer Science 2022-05-05 Axel Wismueller , Larry Stockmaster , Ali Vosoughi

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities by integrating visual and textual inputs, yet modality alignment remains one of the most challenging aspects. Current MLLMs typically rely on simple adapter…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Yuanyang Yin , Yaqi Zhao , Yajie Zhang , Yuanxing Zhang , Ke Lin , Jiahao Wang , Xin Tao , Pengfei Wan , Wentao Zhang , Feng Zhao