English
Related papers

Related papers: Survey on Vision-Language-Action Models

200 papers

The rapid progress of auto-regressive vision-language models (VLMs) has inspired growing interest in vision-language-action models (VLA) for robotic manipulation. Recently, masked diffusion models, a paradigm distinct from autoregressive…

Robotics · Computer Science 2025-09-11 Yuqing Wen , Hebei Li , Kefan Gu , Yucheng Zhao , Tiancai Wang , Xiaoyan Sun

The landscape of education is changing rapidly, shaped by emerging pedagogical approaches, technological innovations such as artificial intelligence (AI), and evolving societal expectations, all of which demand thorough evaluation of new…

Computers and Society · Computer Science 2026-03-19 Fiammetta Caccavale , Carina L. Gargalo , Julian Kager , Magdalena Skowyra , Steen Larsen , Krist V. Gernaey , Ulrich Krühne

Large Language Models (LLMs) have recently emerged as a focal point of research and application, driven by their unprecedented ability to understand and generate text with human-like quality. Even more recently, LLMs have been extended into…

Computation and Language · Computer Science 2024-04-03 Kilian Carolan , Laura Fennelly , Alan F. Smeaton

Artificial intelligence (AI) is transforming society, making it crucial to prepare the next generation through AI literacy in K-12 education. However, scalable and reliable AI literacy materials and assessment resources are lacking. To…

Human-Computer Interaction · Computer Science 2024-12-03 Jiayi Wang , Ruiwei Xiao , Ying-Jui Tseng

Peer review at AI conferences is stressed by rapidly rising submission volumes, leading to deteriorating review quality and increased author dissatisfaction. To address these issues, we developed Review Feedback Agent, a system leveraging…

Artificial Intelligence · Computer Science 2025-04-15 Nitya Thakkar , Mert Yuksekgonul , Jake Silberg , Animesh Garg , Nanyun Peng , Fei Sha , Rose Yu , Carl Vondrick , James Zou

Current Vision-Language-Action (VLA) models predominantly rely on end-to-end fine-tuning. While effective, this paradigm compromises the inherent generalization capabilities of Vision-Language Models (VLMs) and incurs catastrophic…

Large Language Models (LLMs) are increasingly integrated into critical decision-making pipelines, a trend that raises the demand for robust and automated data analysis. Current approaches to dataset risk analysis are limited to manual…

Artificial Intelligence · Computer Science 2026-05-28 Panteleimon Rodis

Computer programming (coding) is indispensable for researchers across disciplines, yet it remains challenging to learn and time-consuming to carry out. Generative AI, particularly large language models (LLMs), has the potential to transform…

Computers and Society · Computer Science 2024-11-19 Tonghe Zhuang , Zhicheng Lin

As generative AI continues to evolve, Vision Language Models (VLMs) have emerged as promising tools in various healthcare applications. One area that remains relatively underexplored is their use in human activity recognition (HAR) for…

Computation and Language · Computer Science 2025-11-18 Abderrazek Abid , Thanh-Cong Ho , Fakhri Karray

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

The field of artificial intelligence (AI) alignment aims to investigate whether AI technologies align with human interests and values and function in a safe and ethical manner. AI alignment is particularly relevant for large language models…

Human-Computer Interaction · Computer Science 2023-01-18 Thilo Hagendorff , Sarah Fabi

While many researchers use Large Language Models (LLMs) through chat-based access, their real potential lies in leveraging LLMs via application programming interfaces (APIs). This paper conceptualizes LLMs as universal text processing…

Computation and Language · Computer Science 2026-03-23 Ivan Zupic

Systematic literature reviews and meta-analyses are essential for synthesizing research insights, but they remain time-intensive and labor-intensive due to the iterative processes of screening, evaluation, and data extraction. This paper…

Computation and Language · Computer Science 2025-10-09 Pouria Rouzrokh , Bardia Khosravi , Parsa Rouzrokh , Moein Shariatnia

Fine-tuning vision-language models (VLMs) on robot teleoperation data to create vision-language-action (VLA) models is a promising paradigm for training generalist policies, but it suffers from a fundamental tradeoff: learning to produce…

Robotics · Computer Science 2025-09-29 Asher J. Hancock , Xindi Wu , Lihan Zha , Olga Russakovsky , Anirudha Majumdar

Visual Language Action (VLA) models are a multi-modal class of Artificial Intelligence (AI) systems that integrate visual perception, natural language understanding, and action planning to enable agents to interpret their environment,…

Software Engineering · Computer Science 2025-08-04 Pablo Valle , Chengjie Lu , Shaukat Ali , Aitor Arrieta

With the advent of Vision-Language Models (VLMs), medical artificial intelligence (AI) has experienced significant technological progress and paradigm shifts. This survey provides an extensive review of recent advancements in Medical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Beria Chingnabe Kalpelbe , Angel Gabriel Adaambiik , Wei Peng

Background: Conducting Multi Vocal Literature Reviews (MVLRs) is often time and effort-intensive. Researchers must review and filter a large number of unstructured sources, which frequently contain sparse information and are unlikely to be…

Software Engineering · Computer Science 2025-09-17 Santiago Matalonga , Domenico Amalfitano , Jean Carlo Rossa Hauck , Martín Solari , Guilherme H. Travassos

Large language models (LLMs) have been extensively used for legal judgment prediction tasks based on case reports and crime history. However, with a surge in the availability of large vision language models (VLMs), legal judgment prediction…

Artificial Intelligence · Computer Science 2025-10-02 Sagnik Basu , Shubham Prakash , Ashish Maruti Barge , Siddharth D Jaiswal , Abhisek Dash , Saptarshi Ghosh , Animesh Mukherjee

Vision-language-action (VLA) models finetuned from vision-language models (VLMs) hold the promise of leveraging rich pretrained representations to build generalist robots across diverse tasks and environments. However, direct fine-tuning on…

Robotics · Computer Science 2025-09-18 Shresth Grover , Akshay Gopalkrishnan , Bo Ai , Henrik I. Christensen , Hao Su , Xuanlin Li

This paper offers an insightful examination of how currently top-trending AI technologies, i.e., generative artificial intelligence (Generative AI) and large language models (LLMs), are reshaping the field of video technology, including…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Pengyuan Zhou , Lin Wang , Zhi Liu , Yanbin Hao , Pan Hui , Sasu Tarkoma , Jussi Kangasharju