English
Related papers

Related papers: Iris: Breaking GUI Complexity with Adaptive Focus …

200 papers

The rapid evolution of intelligent document processing systems demands robust solutions that adapt to diverse domains without extensive retraining. Traditional methods often falter with variable document types, leading to poor performance.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Maria Pilligua , Nil Biescas , Javier Vazquez-Corral , Josep Lladós , Ernest Valveny , Sanket Biswas

The rise of large language models (LLMs) has introduced a new era in information retrieval (IR), where queries and documents that were once assumed to be generated exclusively by humans can now also be created by automated agents. These…

Information Retrieval · Computer Science 2025-02-21 Haya Nachimovsky , Moshe Tennenholtz , Oren Kurland

Composed Image Retrieval (CIR) requires both preserving the visual continuity of the reference image and faithfully executing the semantic variables specified in the modification text, which constitute the core challenge of the task.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xingtian Pei , Yukun Song , Changwei Wang , Shunpeng Chen , Rongtao Xu , Shengpeng Xu , Shibiao Xu

In recent years, mobile Internet has accelerated the proliferation of smart mobile development. The mobile payment, mobile security and privacy protection have become the focus of widespread attention. Iris recognition becomes a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Siming Zheng , Rahmita Wirza O. K. Rahmat , Fatimah Khalid , Nurul Amelina Nasharuddin

Multimodal Large Language Models (MLLMs) have powered Graphical User Interface (GUI) Agents, showing promise in automating tasks on computing devices. Recent works have begun exploring reasoning in GUI tasks with encouraging results.…

Artificial Intelligence · Computer Science 2025-04-22 Yuhang Liu , Pengxiang Li , Congkai Xie , Xavier Hu , Xiaotian Han , Shengyu Zhang , Hongxia Yang , Fei Wu

Existing automatic 3D image segmentation methods usually fail to meet the clinic use. Many studies have explored an interactive strategy to improve the image segmentation performance by iteratively incorporating user hints. However, the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Xuan Liao , Wenhao Li , Qisen Xu , Xiangfeng Wang , Bo Jin , Xiaoyun Zhang , Ya Zhang , Yanfeng Wang

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

Despite the significant advances in iris segmentation, accomplishing accurate iris segmentation in non-cooperative environment remains a grand challenge. In this paper, we present a deep learning framework, referred to as Iris R-CNN, to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Chunyang Feng , Yufeng Sun , Xin Li

Despite the rapid progress of multimodal large language models in building Graphical User Interface (GUI) agents, their real-world task completion is fundamentally bottlenecked by a lack of world knowledge about GUI operations. Existing…

Computation and Language · Computer Science 2026-05-28 Zheng Wu , Chengcheng Han , Zhengxi Lu , Tianjie Ju , Yanyu Chen , Qi Gu , Xunliang Cai , Zhuosheng Zhang

With the advancement of Multimodal Large Language Models (MLLM), LLM-driven visual agents are increasingly impacting software interfaces, particularly those with graphical user interfaces. This work introduces a novel LLM-based multimodal…

Human-Computer Interaction · Computer Science 2025-09-18 Yanda Li , Chi Zhang , Wenjia Jiang , Wanqi Yang , Bin Fu , Pei Cheng , Xin Chen , Ling Chen , Yunchao Wei

Large Language Model (LLM)-based agents have shown effectiveness across many applications. However, their use in data science scenarios requiring solving long-term interconnected tasks, dynamic data adjustments and domain expertise remains…

Semantic IDs are discrete identifiers generated by quantizing the Multi-modal Large Language Models (MLLMs) embeddings, enabling efficient multi-modal content integration in recommendation systems. However, their lack of collaborative…

Information Retrieval · Computer Science 2025-11-25 Wencai Ye , Mingjie Sun , Shaoyun Shi , Peng Wang , Wenjin Wu , Peng Jiang

Expert programmers' eye-movements during source code reading are valuable sources that are considered to be associated with their domain expertise. We advocate a vision of new intelligent systems incorporating expertise of experts for…

Software Engineering · Computer Science 2019-03-18 Yoshiharu Ikutani , Nishanth Koganti , Hideaki Hata , Takatomi Kubo , Kenichi Matsumoto

Reconfigurable intelligent surface (RIS) has become a promising technology for enhancing the reliability of wireless communications, which is capable of reflecting the desired signals through appropriate phase shifts. However, the intended…

Signal Processing · Electrical Eng. & Systems 2021-03-03 Bo Yang , Xuelin Cao , Chongwen Huang , Chau Yuen , Lijun Qian , Marco Di Renzo

Unified multimodal understanding and generation models recently have achieve significant improvement in image generation capability, yet a large gap remains in instruction following and detail preservation compared to systems that tightly…

Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) promise human-like interaction with software applications, yet long-horizon tasks remain challenging due to memory limitations. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Zikang Liu , Junyi Li , Wayne Xin Zhao , Dawei Gao , Yaliang Li , Ji-rong Wen

Large Language Model (LLM)-based agents have demonstrated strong capabilities across a wide range of tasks, and their application in the medical domain holds particular promise due to the demand for high generalizability and reliance on…

Artificial Intelligence · Computer Science 2025-08-18 Yangyang Zhuang , Wenjia Jiang , Jiayu Zhang , Ze Yang , Joey Tianyi Zhou , Chi Zhang

Robust local feature representations are essential for spatial intelligence tasks such as robot navigation and augmented reality. Establishing reliable correspondences requires descriptors that provide both high discriminative power and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Haodi Yao , Fenghua He , Ning Hao , Yao Su

Agentic AI systems use specialized agents to handle tasks within complex workflows, enabling automation and efficiency. However, optimizing these systems often requires labor-intensive, manual adjustments to refine roles, tasks, and…

Computation and Language · Computer Science 2024-12-24 Kamer Ali Yuksel , Hassan Sawaf

Psychological assessments commonly rely on rating-scale items, which require respondents to condense complex experiences into predefined categories. Although rich, unstructured text is often captured alongside these scales, it rarely…

Computation and Language · Computer Science 2026-03-20 Joe Watson , Ivan O'Connor , Chia-Wen Chen , Luning Sun , Fang Luo , David Stillwell