English
Related papers

Related papers: BAMI: Training-Free Bias Mitigation in GUI Groundi…

200 papers

Recent advancements in Large Vision-Language Models are accelerating the development of Graphical User Interface (GUI) agents that utilize human-like vision perception capabilities to enhance productivity on digital devices. Compared to…

Human-Computer Interaction · Computer Science 2025-07-31 Xinyi Liu , Xiaoyi Zhang , Ziyun Zhang , Yan Lu

Prior work has shown that Visual Recognition datasets frequently underrepresent bias groups $B$ (\eg Female) within class labels $Y$ (\eg Programmers). This dataset bias can lead to models that learn spurious correlations between class…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Maan Qraitem , Kate Saenko , Bryan A. Plummer

In this paper we present an algorithm for rapid Bayesian analysis that combines the benefits of nested sampling and artificial neural networks. The blind accelerated multimodal Bayesian inference (BAMBI) algorithm implements the MultiNest…

Instrumentation and Methods for Astrophysics · Physics 2012-03-12 Philip Graff , Farhan Feroz , Michael P. Hobson , Anthony Lasenby

Prompt-induced cognitive biases are changes in a general-purpose AI (GPAI) system's decisions caused solely by biased wording in the input (e.g., framing, anchors), not task logic. In software engineering (SE) decision support (where…

Software Engineering · Computer Science 2026-04-23 Francesco Sovrano , Gabriele Dominici , Alberto Bacchelli

Text-to-image (T2I) generative models have gained increased popularity in the public domain. While boasting impressive user-guided generative abilities, their black-box nature exposes users to intentionally- and intrinsically-biased…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Referring expression grounding is an important and challenging task in computer vision. To avoid the laborious annotation in conventional referring grounding, unpaired referring grounding is introduced, where the training data only contains…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Hengcan Shi , Munawar Hayat , Jianfei Cai

Computer-use agents (CUAs) automate on-screen work, as illustrated by GPT-5.4 and Claude. Yet their reliability on complex, low-frequency interactions is still poor, limiting user trust. Our analysis of failure cases from advanced models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Miaosen Zhang , Xiaohan Zhao , Zhihong Tan , Zhou Huoshen , Yijia Fan , Yifan Yang , Kai Qiu , Bei Liu , Justin Wagle , Chenzhong Yin , Mingxi Cheng , Ji Li , Qi Dai , Chong Luo , Xu Yang , Xin Geng , Baining Guo

Vision Language Models (VLMs) have recently achieved significant progress in bridging visual perception and linguistic reasoning. Recently, OpenAI o3 model introduced a zoom-in search strategy that effectively elicits active perception…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Wanfu Wang , Qipeng Huang , Guangquan Xue , Xiaobo Liang , Juntao Li

Human cognitive biases in software engineering can lead to costly errors. While general-purpose AI (GPAI) systems may help mitigate these biases due to their non-human nature, their training on human-generated data raises a critical…

Human-Computer Interaction · Computer Science 2025-12-02 Francesco Sovrano , Gabriele Dominici , Rita Sevastjanova , Alessandra Stramiglio , Alberto Bacchelli

Graphical User Interface (GUI) automation holds significant promise for assisting users with complex tasks, thereby boosting human productivity. Existing works leveraging Large Language Model (LLM) or LLM-based AI agents have shown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Difei Gao , Lei Ji , Zechen Bai , Mingyu Ouyang , Peiran Li , Dongxing Mao , Qinchen Wu , Weichen Zhang , Peiyi Wang , Xiangwu Guo , Hengxu Wang , Luowei Zhou , Mike Zheng Shou

Mobile GUI agents excel at immediate reactive control but frequently fail in realistic, long-horizon tasks that require memory. This failure stems from a fundamental conflict between limited context windows and token-heavy screenshots. To…

Computation and Language · Computer Science 2026-05-29 Junyang Wang , Haiyang Xu , Xi Zhang , Zhaoqing Zhu , Ming Yan , Jieping Ye , Jitao Sang

The measurement of bias in machine learning often focuses on model performance across identity subgroups (such as man and woman) with respect to groundtruth labels. However, these methods do not directly measure the associations that a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Osman Aka , Ken Burke , Alex Bäuerle , Christina Greer , Margaret Mitchell

Vision-Language Models (VLMs) have shown remarkable performance in User Interface (UI) grounding tasks, driven by their ability to process increasingly high-resolution screenshots. However, screenshots are tokenized into thousands of visual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Mingyu Ouyang , Kevin Qinghong Lin , Mike Zheng Shou , Hwee Tou Ng

Graphical user interface (GUI) agents have recently emerged as an intriguing paradigm for human-computer interaction, capable of automatically executing user instructions to operate intelligent terminal devices. However, when encountering…

Machine Learning · Computer Science 2025-11-25 Zheng Wu , Pengzhou Cheng , Zongru Wu , Lingzhong Dong , Zhuosheng Zhang

Explainable artificial intelligence (XAI) methods lack ground truth. In its place, method developers have relied on axioms to determine desirable properties for their explanations' behavior. For high stakes uses of machine learning that…

Machine Learning · Computer Science 2022-09-02 Isha Hameed , Samuel Sharpe , Daniel Barcklow , Justin Au-Yeung , Sahil Verma , Jocelyn Huang , Brian Barr , C. Bayan Bruss

Recent advances in Multimodal Large Language Models (MLLMs) have enabled autonomous agents to interact with computers via Graphical User Interfaces (GUIs), where accurately localizing the coordinates of interface elements (e.g., buttons) is…

Machine Learning · Computer Science 2025-05-27 Hyunseok Lee , Jeonghoon Kim , Beomjun Kim , Jihoon Tack , Chansong Jo , Jaehong Lee , Cheonbok Park , Sookyo In , Jinwoo Shin , Kang Min Yoo

With generative models becoming increasingly sophisticated and diverse, detecting AI-generated images has become increasingly challenging. While existing AI-genereted Image detectors achieve promising performance on in-distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Haozhen Yan , Yan Hong , Suning Lang , Jiahui Zhan , Yikun Ji , Yujie Gao , Huijia Zhu , Jun Lan , Jianfu Zhang

One of the principal challenges in building VLM-powered GUI agents is visual grounding, i.e., localizing the appropriate screen region for action execution based on both the visual content and the textual plans. Most existing work…

Autonomous robot manipulation is a complex and continuously evolving robotics field. This paper focuses on data augmentation methods in imitation learning. Imitation learning consists of three stages: data collection from experts, learning…

Robotics · Computer Science 2024-10-08 Masato Kobayashi , Thanpimon Buamanee , Yuki Uranishi

As a novel and effective fine-tuning paradigm based on large-scale pre-trained language models (PLMs), prompt-tuning aims to reduce the gap between downstream tasks and pre-training objectives. While prompt-tuning has yielded continuous…

Computation and Language · Computer Science 2024-03-21 Jiangmeng Li , Fei Song , Yifan Jin , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong