English
Related papers

Related papers: A Unified, Cross-Platform Framework for Automatic …

200 papers

User simulation is a valuable methodology for evaluation in Information Retrieval (IR), enabling low-cost experimentation and counterfactual analysis. However, existing simulation frameworks are primarily code-centric libraries that require…

Information Retrieval · Computer Science 2026-04-28 Saber Zerhoudi , Adam Roegiest , Michael Granitzer

Recent progress in GUI agents has substantially improved visual grounding, yet robust planning remains challenging, particularly when the environment deviates from a canonical initial state. In real applications, users often invoke…

Artificial Intelligence · Computer Science 2026-05-26 Henry Hengyuan Zhao , Kaiming Yang , Wendi Yu , Difei Gao , Mike Zheng Shou

Molecular dynamics simulations are an essential tool in understanding protein structure, dynamics, and function at the atomic level. However, preparing high quality input files for MD simulations can be a time consuming and error prone…

Computation and Language · Computer Science 2025-07-11 Achuth Chandrasekhar , Amir Barati Farimani

In high-energy particle physics, workflow management systems are primarily used as tailored solutions in dedicated areas such as Monte Carlo production. However, physicists performing data analyses are usually required to steer their…

Data Analysis, Statistics and Probability · Physics 2017-06-06 Marcel Rieger , Martin Erdmann , Benjamin Fischer , Robert Fischer

Contemporary GUI agents, while increasingly capable due to advances in Large Vision-Language Models (VLMs), often operate with a critical limitation: they treat each task in isolation, lacking a mechanism to systematically learn from past…

Artificial Intelligence · Computer Science 2026-04-13 Runze Li , Yuwen Zhai , Bo Xu , LiWu Xu , Nian Shi , Wei Zhang , Ran Lin , Liang Wang

The recent development of large language models (LLMs) with multi-billion parameters, coupled with the creation of user-friendly application programming interfaces (APIs), has paved the way for automatically generating and executing code in…

Artificial Intelligence · Computer Science 2023-12-14 Alejandro Duque , Abdullah Syed , Kastan V. Day , Matthew J. Berry , Daniel S. Katz , Volodymyr V. Kindratenko

The rapid growth of scientific software has created practical barriers for bioinformatics research. Although powerful statistical, artificial intelligence (AI)-based methods are now widely available, their effective use is often hindered by…

Software Engineering · Computer Science 2026-04-24 Simon Süwer , Zoe Chervontseva , Kester Bagemihl , Jan Baumbach , Olga Tsoy , Andreas Maier

At present, executable visual workflows have emerged as a mainstream paradigm in real-world industrial deployments, offering strong reliability and controllability. However, in current practice, such workflows are almost entirely…

Computation and Language · Computer Science 2026-05-27 Yi Zhong , Buqiang Xu , Yijun Wang , Zifei Shan , Shuofei Qiao , Guozhou Zheng , Ningyu Zhang

Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. Although existing multimodal large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-05-26 Peitong Duan , Chin-Yi Cheng , Bjoern Hartmann , Yang Li

Graphical User Interface (GUI) agents possess significant commercial and social value, and GUI agents powered by advanced multimodal large language models (MLLMs) have demonstrated remarkable potential. Currently, existing GUI agents…

Artificial Intelligence · Computer Science 2025-09-05 Weizhi Chen , Ziwei Wang , Leyang Yang , Sheng Zhou , Xiaoxuan Tang , Jiajun Bu , Yong Li , Wei Jiang

CLPGUI is a graphical user interface for visualizing and interacting with constraint logic programs over finite domains. In CLPGUI, the user can control the execution of a CLP program through several views of constraints, of finite domain…

Software Engineering · Computer Science 2007-05-23 Francois Fages

Recent advances in Multimodal Large Language Models (MLLMs) have substantially driven the progress of autonomous agents for Graphical User Interface (GUI). Nevertheless, in real-world applications, GUI agents are often faced with…

Artificial Intelligence · Computer Science 2026-02-17 Yibo Wang , Guangda Huzhang , Yuwei Hu , Yu Xia , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Lijun Zhang

In traumatic medical emergencies, the patients heavily depend on cranioplasty - the craft of neurocranial repair using cranial implants. Despite the improvements made in recent years, the design of a patient-specific implant (PSI) is among…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Michael Lackner , Behrus Puladi , Jens Kleesiek , Jan Egger , Jianning Li

Input devices, such as buttons and sliders, are the foundation of any interface. The typical user-centered design workflow requires the developers and users to go through many iterations of design, implementation, and analysis. The…

Human-Computer Interaction · Computer Science 2021-03-10 Yi-Chi Liao

GraphFlow is a visual workflow system designed to improve the reliability of agentic AI automation in multi-step, mission-critical processes. In these workflows, small errors compound rapidly: under an idealized model of independent steps,…

Artificial Intelligence · Computer Science 2026-05-15 Drewry H. Morris , Luis Valles , Reza Hosseini Ghomi

Graphical user interface (GUI) has become integral to modern society, making it crucial to be understood for human-centric systems. However, unlike natural images or documents, GUIs comprise artificially designed graphical elements arranged…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ziwei Wang , Weizhi Chen , Leyang Yang , Sheng Zhou , Shengchu Zhao , Hanbei Zhan , Jiongchao Jin , Liangcheng Li , Zirui Shao , Jiajun Bu

Text-based prompting remains the predominant interaction paradigm in generative AI, yet it often introduces friction for novice users such as small business owners (SBOs), who struggle to articulate creative goals in domain-specific…

Human-Computer Interaction · Computer Science 2025-04-23 Nimisha Karnatak , Adrien Baranes , Rob Marchant , Huinan Zeng , Tríona Butler , Kristen Olson

Large language models are redefining software engineering by implementing AI-powered techniques throughout the whole software development process, including requirement gathering, software architecture, code generation, testing, and…

Software Engineering · Computer Science 2024-06-11 Malik Abdul Sami , Muhammad Waseem , Zeeshan Rasheed , Mika Saari , Kari Systä , Pekka Abrahamsson

Generative art unlocks boundless creative possibilities, yet its full potential remains untapped due to the technical expertise required for advanced architectural concepts and computational workflows. To bridge this gap, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Duc-Hung Nguyen , Huu-Phuc Huynh , Minh-Triet Tran , Trung-Nghia Le

Mobile graphical user interface (GUI) agents are designed to automate everyday tasks on smartphones. Recent advances in large language models (LLMs) have significantly enhanced the capabilities of mobile GUI agents. However, most…

Human-Computer Interaction · Computer Science 2026-01-27 Mingxian Yu , Siqi Luo , Xu Chen