English
Related papers

Related papers: Beyond Binary: Reframing GUI Critique as Continuou…

200 papers

Computer-use agents (CUAs) automate on-screen work, as illustrated by GPT-5.4 and Claude. Yet their reliability on complex, low-frequency interactions is still poor, limiting user trust. Our analysis of failure cases from advanced models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Miaosen Zhang , Xiaohan Zhao , Zhihong Tan , Zhou Huoshen , Yijia Fan , Yifan Yang , Kai Qiu , Bei Liu , Justin Wagle , Chenzhong Yin , Mingxi Cheng , Ji Li , Qi Dai , Chong Luo , Xu Yang , Xin Geng , Baining Guo

Traditional ranking systems optimize offline proxy objectives that rely on oversimplified assumptions about user behavior, often neglecting factors such as position bias and item diversity. Consequently, these models fail to improve true…

Information Retrieval · Computer Science 2025-10-21 Gaurav Bhatt , Kiran Koshy Thekumparampil , Tanmay Gangwani , Tesi Xiao , Leonid Sigal

Scalable oversight studies methods of training and evaluating AI systems in domains where human judgment is unreliable or expensive, such as scientific research and software engineering in complex codebases. Most work in this area has…

Machine Learning · Computer Science 2024-10-22 Alex Mallen , Nora Belrose

Class imbalance poses a significant challenge to supervised classification, particularly in critical domains like medical diagnostics and anomaly detection where minority class instances are rare. While numerous studies have explored…

Machine Learning · Computer Science 2025-09-10 Ali Nawaz , Amir Ahmad , Shehroz S. Khan

Previous studies dominantly target at self-supervised learning on real-valued networks and have achieved many promising results. However, on the more challenging binary neural networks (BNNs), this task has not yet been fully explored in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zhiqiang Shen , Zechun Liu , Jie Qin , Lei Huang , Kwang-Ting Cheng , Marios Savvides

Benchmarks are paramount for gauging progress in the domain of Mobile GUI Agents. In practical scenarios, users frequently fail to articulate precise directives containing full task details at the onset, and their expressions are typically…

Continual post-training adapts a single text-to-image diffusion model to learn new tasks without incurring the cost of separate models, but naive post-training causes forgetting of pretrained knowledge and undermines zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Zhehao Huang , Yuhang Liu , Yixin Lou , Zhengbao He , Mingzhen He , Wenxing Zhou , Tao Li , Kehan Li , Zeyi Huang , Xiaolin Huang

In the field of AI-driven human-GUI interaction automation, while rapid advances in multimodal large language models and reinforcement fine-tuning techniques have yielded remarkable progress, a fundamental challenge persists: their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Shaojie Zhang , Ruoceng Zhang , Pei Fu , Shaokang Wang , Jiahui Yang , Xin Du , Shiqi Cui , Bin Qin , Ying Huang , Zhenbo Luo , Jian Luan

Clicks on rankings suffer from position-bias: generally items on lower ranks are less likely to be examined - and thus clicked - by users, in spite of their actual preferences between items. The prevalent approach to unbiased click-based…

Machine Learning · Computer Science 2022-11-01 Harrie Oosterhuis

We introduce MMBench-GUI, a hierarchical benchmark for evaluating GUI automation agents across Windows, macOS, Linux, iOS, Android, and Web platforms. It comprises four levels: GUI Content Understanding, Element Grounding, Task Automation,…

Human Activity Recognition using wearable inertial sensors is foundational to healthcare monitoring, fitness analytics, and context-aware computing, yet its deployment is hindered by cross-user variability arising from heterogeneous…

Machine Learning · Computer Science 2026-03-18 Xiaozhou Ye , Feng Jiang , Zihan Wang , Xiulai Wang , Yutao Zhang , Kevin I-Kai Wang

Modern text-to-image (T2I) models amplify harmful societal biases, challenging their ethical deployment. We introduce an inference-time method that reliably mitigates social bias while keeping prompt semantics and visual context…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Venkatesh Thirugnana Sambandham , Torsten Schön

Learning from human feedback is an effective way to improve robotic learning in exploration-heavy tasks. Compared to the wide application of binary human feedback, scalar human feedback has been used less because it is believed to be noisy…

Robotics · Computer Science 2025-12-15 Hang Yu , Reuben M. Aronson , Katherine H. Allen , Elaine Schaertl Short

Binary classification is a task that involves the classification of data into one of two distinct classes. It is widely utilized in various fields. However, conventional classifiers tend to make overconfident predictions for data that…

Machine Learning · Computer Science 2025-03-13 Shoma Yokura , Akihisa Ichiki

Automatic metrics are now central to evaluating text-to-image models, often substituting for human judgment in benchmarking and large-scale filtering. However, it remains unclear whether these metrics truly prioritize semantic correctness…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Subhadeep Roy , Gagan Bhatia , Steffen Eger

Recent Graphical User Interface (GUI) agents replicate the R1-Zero paradigm, coupling online Reinforcement Learning (RL) with explicit chain-of-thought reasoning prior to object grounding and thereby achieving substantial performance gains.…

Computation and Language · Computer Science 2025-05-23 Yuqi Zhou , Sunhao Dai , Shuai Wang , Kaiwen Zhou , Qinglin Jia , Jun Xu

As the world becomes increasingly saturated with AI-generated content, disinformation, and algorithmic persuasion, critical thinking - the capacity to evaluate evidence, detect unreliable claims, and exercise independent judgment - is…

In the era of increasingly complex AI models for time series forecasting, progress is often measured by marginal improvements on benchmark leaderboards. However, this approach suffers from a fundamental flaw: standard evaluation metrics…

Machine Learning · Computer Science 2026-05-28 Wanjin Feng , Yuan Yuan , Jingtao Ding , Yong Li

Linguistic bias in online news and social media is widespread but difficult to measure. Yet, its identification and quantification remain difficult due to subjectivity, context dependence, and the scarcity of high-quality gold-label…

Information Retrieval · Computer Science 2025-12-17 Fabian Haak , Philipp Schaer

GUI grounding, which maps natural-language instructions to actionable UI elements, is a core capability of GUI agents. Prior works largely treats instructions as a static proxy for user intent, overlooking the impact of instruction…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Liangyu Chen , Hanzhang Zhou , Chenglin Cai , Jianan Zhang , Panrong Tong , Quyu Kong , Xu Zhang , Chen Liu , Yuqi Liu , Wenxuan Wang , Yue Wang , Qin Jin , Steven Hoi