English
Related papers

Related papers: GAIR: GUI Automation via Information-Joint Reasoni…

200 papers

Autoregressive (AR) vision-language models (VLMs) have long dominated multimodal understanding, reasoning, and graphical user interface (GUI) grounding. Recently, discrete diffusion vision-language models (DVLMs) have shown strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Shrinidhi Kumbhar , Haofu Liao , Srikar Appalaraju , Kunwar Yashraj Singh

LLMs often underperform on complex reasoning tasks when relying on a single generation-and-selection pipeline. Inference-time ensemble methods can improve performance by sampling diverse reasoning paths or aggregating multiple candidate…

Machine Learning · Computer Science 2026-02-03 Tong Zhu , Baiting Chen , Jin Zhou , Hua Zhou , Sriram Sankararaman , Xiaowu Dai

Interactive recommendation is a typical information-seeking task that allows users to interactively express their needs through natural language and obtain personalized recommendations. Large language model-powered (LLM-powered) agents have…

Computation and Language · Computer Science 2025-07-01 Haocheng Yu , Yaxiong Wu , Hao Wang , Wei Guo , Yong Liu , Yawen Li , Yuyang Ye , Junping Du , Enhong Chen

The growing capabilities of large language models (LLMs) in instruction-following and context-understanding lead to the era of agents with numerous applications. Among these, task planning agents have become especially prominent in…

The evolution of Large Language Models (LLMs) from passive text generators to autonomous, goal-driven systems represents a fundamental shift in artificial intelligence. This chapter examines the emergence of agentic AI systems that…

Artificial Intelligence · Computer Science 2026-01-07 Nadia Sibai , Yara Ahmed , Serry Sibaee , Sawsan AlHalawani , Adel Ammar , Wadii Boulila

Large Language Models (LLMs) have demonstrated impressive real-world utility, exemplifying artificial useful intelligence (AUI). However, their ability to reason adaptively and robustly -- the hallmarks of artificial general intelligence…

Machine Learning · Computer Science 2025-08-27 Seungwook Han , Jyothish Pari , Samuel J. Gershman , Pulkit Agrawal

While progress in GUI agents has been largely driven by industrial-scale training, ungrounded hallucinations often trigger cascading failures in real-world deployments.Unlike general VLM domains, the GUI agent field lacks a…

Artificial Intelligence · Computer Science 2026-04-21 Chao Jin , Wenkui Yang , Hao Sun , Yuqi Liao , Qianyi Jiang , Kai Zhou , Jie Cao , Ran He , Huaibo Huang

LLMs are popular among clinicians for decision-support because of simple text-based interaction. However, their impact on clinicians' performance is ambiguous. Not knowing how clinicians use this new technology and how they compare it to…

Human-Computer Interaction · Computer Science 2026-02-02 Behnam Rahdari , Sameer Shaikh , Jonathan H Chen , Tobias Gerstenberg , Shriti Raj

Graphical user interfaces (GUIs) are the primary medium for human-computer interaction, yet automating GUI interactions remains challenging due to the complexity of visual elements, dynamic environments, and the need for multi-step…

In the rapidly evolving landscape of AI research and application, Multimodal Large Language Models (MLLMs) have emerged as a transformative force, adept at interpreting and integrating information from diverse modalities such as text,…

Artificial Intelligence · Computer Science 2024-07-23 Abdur Rahman , Rajat Chawla , Muskaan Kumar , Arkajit Datta , Adarsh Jha , Mukunda NS , Ishaan Bhola

The ability of large language models (LLMs) to mimic human-like intelligence has led to a surge in LLM-based autonomous agents. Though recent LLMs seem capable of planning and reasoning given user instructions, their effectiveness in…

The booming success of LLMs initiates rapid development in LLM agents. Though the foundation of an LLM agent is the generative model, it is critical to devise the optimal reasoning strategies and agent architectures. Accordingly, LLM agent…

A critical bottleneck in automating AI research is the execution of complex machine learning engineering (MLE) tasks. MLE differs from general software engineering due to computationally expensive evaluation (e.g., model training) and…

Artificial Intelligence · Computer Science 2026-05-21 Jiefeng Chen , Bhavana Dalvi Mishra , Jaehyun Nam , Rui Meng , Tomas Pfister , Jinsung Yoon

Distributed Artificial Intelligence-Generated Content (AIGC) has attracted significant attention, but two key challenges remain: maximizing subjective Quality of Experience (QoE) and improving energy efficiency, which are particularly…

Networking and Internet Architecture · Computer Science 2025-04-24 Hongyang Du , Ruichen Zhang , Dusit Niyato , Jiawen Kang , Zehui Xiong , Shuguang Cui , Xuemin Shen , Dong In Kim

Recent advances in large language models (LLMs) enabled the development of AI agents that can plan and interact with tools to complete complex tasks. However, literature on their reliability in real-world applications remains limited. In…

Computation and Language · Computer Science 2025-08-20 Lorenzo Jaime Yu Flores , Junyi Shen , Goodman Gu

Conducting a comprehensive literature review is crucial for advancing circuit design methodologies. However, the rapid influx of state-of-the-art research, inconsistent data representation, and the complexity of optimizing circuit design…

Machine Learning · Computer Science 2025-08-12 Pravallika Abbineni , Saoud Aldowaish , Colin Liechty , Soroosh Noorzad , Ali Ghazizadeh , Morteza Fayazi

Large language models (LLMs) have shown remarkable multimodal information processing and reasoning ability. When equipped with tools through function calling and enhanced with retrieval-augmented techniques, compound LLM-based systems can…

Machine Learning · Computer Science 2025-11-06 Borun Shi , Ioannis Panagiotas

Embodied robotic AI systems designed to manage complex daily tasks rely on a task planner to understand and decompose high-level tasks. While most research focuses on enhancing the task-understanding abilities of LLMs/VLMs through…

Robotics · Computer Science 2025-12-23 Zhenglong Guo , Yiming Zhao , Feng Jiang , Heng Jin , Zongbao Feng , Jianbin Zhou , Siyuan Xu

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of language tasks, yet complex multi-step reasoning remains a fundamental challenge. While Large Reasoning Models (LRMs) equipped with extended…

Artificial Intelligence · Computer Science 2026-03-17 Guangfu Hao , Yuming Dai , Xianzhe Qin , Shan Yu

Recent research has explored the use of Large Language Models (LLMs) for tackling complex graph reasoning tasks. However, due to the intricacies of graph structures and the inherent limitations of LLMs in handling long text, current…

Artificial Intelligence · Computer Science 2025-11-26 Yuwei Hu , Runlin Lei , Xinyi Huang , Zhewei Wei , Yongchao Liu