English
Related papers

Related papers: Visual Agents as Fast and Slow Thinkers

200 papers

Spoken Language Understanding (SLU) consists of two sub-tasks: intent detection (ID) and slot filling (SF). Given its broad range of real-world applications, enhancing SLU for practical deployment is increasingly critical. Profile-based SLU…

Artificial Intelligence · Computer Science 2025-11-25 Di Wu , Liting Jiang , Ruiyu Fang , Bianjing , Hongyan Xie , Haoxiang Su , Hao Huang , Zhongjiang He , Shuangyong Song , Xuelong Li

Significant digitalization of financial services in a short period of time has led to an urgent demand to have autonomous, transparent and real-time credit risk decision making systems. The traditional machine learning models are effective…

Artificial Intelligence · Computer Science 2026-01-06 Chandra Sekhar Kubam

Vision-Language-Action (VLA) models convert high-level language instructions into concrete, executable actions, a task that is especially challenging in open-world environments. We present Visual Foresight Planning (ForeAct), a general and…

Robotics · Computer Science 2026-02-16 Zhuoyang Zhang , Shang Yang , Qinghao Hu , Luke J. Huang , James Hou , Yufei Sun , Yao Lu , Song Han

The effectiveness of LLM-based agents is often limited not by model capacity alone, but by how efficiently contextual information is utilized at runtime. Existing agent frameworks rely on rigid, syntax-heavy state representations such as…

Machine Learning · Computer Science 2026-02-10 Tong Yang , Yemin Wang , Chaoning Zhang , Aming Wu

Vision-Language Models (VLMs) enable on-demand visual assistance, yet current applications for people with visual impairments (PVI) impose high cognitive load and exhibit task drift, limiting real-world utility. We first conducted a…

Human-Computer Interaction · Computer Science 2025-11-04 Yi Zhao , Siqi Wang , Qiqun Geng , Erxin Yu , Jing Li

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

Artificial Intelligence · Computer Science 2026-01-06 Bin Xu

Human reasoning can be understood as a cooperation between the intuitive, associative "System-1" and the deliberative, logical "System-2". For existing System-1-like methods in visual activity understanding, it is crucial to integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoqian Wu , Yong-Lu Li , Jianhua Sun , Cewu Lu

Real-time execution is crucial for deploying Vision-Language-Action (VLA) models in the physical world. Existing asynchronous inference methods primarily optimize trajectory smoothness, but neglect the critical latency in reacting to…

Robotics · Computer Science 2026-05-19 Yuxiang Lu , Zhe Liu , Xianzhe Fan , Zhenya Yang , Jinghua Hou , Junyi Li , Kaixin Ding , Hengshuang Zhao

Modern reinforcement learning algorithms reach super-human performance on many board and video games, but they are sample inefficient, i.e. they typically require significantly more playing experience than humans to reach an equal…

Machine Learning · Computer Science 2018-06-12 Dane Corneil , Wulfram Gerstner , Johanni Brea

Real-world applications are stretching context windows to hundreds of thousand of tokens while Large Language Models (LLMs) swell from billions to trillions of parameters. This dual expansion send compute and memory costs skyrocketing,…

Computation and Language · Computer Science 2025-12-12 Ling Xing , Alex Jinpeng Wang , Rui Yan , Xiangbo Shu , Jinhui Tang

A core process in human cognition is analogical mapping: the ability to identify a similar relational structure between different situations. We introduce a novel task, Visual Analogies of Situation Recognition, adapting the classical…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Yonatan Bitton , Ron Yosef , Eli Strugo , Dafna Shahaf , Roy Schwartz , Gabriel Stanovsky

Vision-Language Models (VLMs) typically rely on static initial frames for video reasoning, restricting their ability to incorporate essential dynamic information as the reasoning process evolves. Existing methods that augment…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Martin Q. Ma , Yuxiao Qu , Aditya Agrawal , Willis Guo , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency

The intelligent dialogue system, aiming at communicating with humans harmoniously with natural language, is brilliant for promoting the advancement of human-machine interaction in the era of artificial intelligence. With the gradually…

Artificial Intelligence · Computer Science 2022-07-05 Hao Wang , Bin Guo , Yating Zeng , Yasan Ding , Chen Qiu , Ying Zhang , Lina Yao , Zhiwen Yu

Human vision is highly adaptive, efficiently sampling intricate environments by sequentially fixating on task-relevant regions. In contrast, prevailing machine vision models passively process entire scenes at once, resulting in excessive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yulin Wang , Yang Yue , Yang Yue , Huanqian Wang , Haojun Jiang , Yizeng Han , Zanlin Ni , Yifan Pu , Minglei Shi , Rui Lu , Qisen Yang , Andrew Zhao , Zhuofan Xia , Shiji Song , Gao Huang

Reasoning models have recently shown remarkable progress in domains such as math and coding. However, their expert-level abilities in math and coding contrast sharply with their performance in long-horizon, interactive tasks such as web…

Computation and Language · Computer Science 2025-10-13 Xiao Yu , Baolin Peng , Michel Galley , Hao Cheng , Qianhui Wu , Janardhan Kulkarni , Suman Nath , Zhou Yu , Jianfeng Gao

Forensic cause-of-death determination faces systemic challenges, including workforce shortages and diagnostic variability, particularly in high-volume systems like China's medicolegal infrastructure. We introduce FEAT (ForEnsic AgenT), a…

Recent research looks to harness the general knowledge and reasoning of large language models (LLMs) into agents that accomplish user-specified goals in interactive environments. Vision-language models (VLMs) extend LLMs to multi-modal data…

Machine Learning · Computer Science 2025-05-07 Jake Grigsby , Yuke Zhu , Michael Ryoo , Juan Carlos Niebles

Story visualization is the transformation of narrative elements into image sequences. While existing research has primarily focused on visual contextual coherence, the deeper narrative essence of stories often remains overlooked. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Seungkwon Kim , GyuTae Park , Sangyeon Kim , Seung-Hun Nam

Visual navigation requires a whole range of capabilities. A crucial one of these is the ability of an agent to determine its own location and heading in an environment. Prior works commonly assume this information as given, or use methods…

Machine Learning · Computer Science 2024-02-20 Moritz Lange , Raphael C. Engelhardt , Wolfgang Konen , Laurenz Wiskott

SmartAvatar is a vision-language-agent-driven framework for generating fully rigged, animation-ready 3D human avatars from a single photo or textual prompt. While diffusion-based methods have made progress in general 3D object generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Alexander Huang-Menders , Xinhang Liu , Andy Xu , Yuyao Zhang , Chi-Keung Tang , Yu-Wing Tai