English
Related papers

Related papers: EAA: Automating materials characterization with vi…

200 papers

Agent-based AutoML systems rely on large language models to make complex, multi-stage decisions across data processing, model selection, and evaluation. However, existing evaluation practices remain outcome-centric, focusing primarily on…

Artificial Intelligence · Computer Science 2026-03-17 Gaoyuan Du , Amit Ahlawat , Xiaoyang Liu , Jing Wu

Earth Observation (EO) is moving beyond static prediction toward multi-step analytical workflows that require coordinated reasoning over data, tools, and geospatial state. While foundation models and vision-language models have advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Muhammad Akhtar Munir , Muhammad Umer Sheikh , Akashah Shabbir , Muhammad Haris Khan , Fahad Khan , Xiao Xiang Zhu , Begum Demir , Salman Khan

Autonomous experimentation (AE) combines machine learning and research hardware automation in a closed loop, guiding subsequent experiments toward user goals. As applied to materials research, AE can accelerate materials exploration,…

Materials Science · Physics 2023-06-21 Felix Adams , Austin McDannald , Ichiro Takeuchi , A. Gilad Kusne

The emergence of large language models (LLMs) has introduced a new paradigm in automation: LLM agents or Agentic Automation with Computer Use (AACU). Unlike traditional Robotic Process Automation (RPA), which relies on rule-based workflows…

Computers and Society · Computer Science 2025-09-05 Petr Průcha , Michaela Matoušková , Jan Strnad

Robotic manipulation has increasingly adopted vision-language-action (VLA) models, which achieve strong performance but typically require task-specific demonstrations and fine-tuning, and often generalize poorly under domain shift. We…

Robotics · Computer Science 2026-01-29 Brian Y. Tsui , Alan Y. Fang , Tiffany J. Hwu

Autonomous agents based on Large Language Models (LLMs) have evolved from reactive assistants to systems capable of planning, executing actions via tools, and iterating over environment observations. However, they remain vulnerable to…

Artificial Intelligence · Computer Science 2026-02-27 Elzo Brito dos Santos Filho

Computer use agents (CUA) are systems that automatically interact with graphical user interfaces (GUIs) to complete tasks. CUA have made significant progress with the advent of large vision-language models (VLMs). However, these agents…

Artificial Intelligence · Computer Science 2025-06-04 Man Luo , David Cobbley , Xin Su , Shachar Rosenman , Vasudev Lal , Shao-Yen Tseng , Phillip Howard

Image Aesthetic Assessment (IAA) is a vital and intricate task that entails analyzing and assessing an image's aesthetic values, and identifying its highlights and areas for improvement. Traditional methods of IAA often concentrate on a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuti Liu , Shice Liu , Junyuan Gao , Pengtao Jiang , Hao Zhang , Jinwei Chen , Bo Li

Recent advances in LLM-based agent systems have shown promise on complex, long-horizon tasks, but existing agent protocols (e.g., A2A and MCP) do not adequately support lifecycle-aware coordination across agents, tools, and environments. To…

Artificial Intelligence · Computer Science 2026-05-29 Wentao Zhang , Liang Zeng , Yuzhen Xiao , Yongcong Li , Ce Cui , Yilei Zhao , Rui Hu , Yang Liu , Yahui Zhou , Bo An

In this work, we focus on unsupervised vision-language-action mapping in the area of robotic manipulation. Recently, multiple approaches employing pre-trained large language and vision models have been proposed for this task. However, they…

Robotics · Computer Science 2025-05-29 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

Over the years, research in system identification has provided a rich set of methods for learning dynamical models, together with well-established theoretical guarantees. In practice, however, the choice of model class, training algorithm,…

Artificial Intelligence · Computer Science 2026-05-12 Dario Piga , Marco Forgione

Vision-Language-Action (VLA) models mark a transformative advancement in artificial intelligence, aiming to unify perception, natural language understanding, and embodied action within a single computational framework. This foundational…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ranjan Sapkota , Yang Cao , Konstantinos I. Roumeliotis , Manoj Karkee

This paper presents an AI-generated review of Vision-Language-Action (VLA) models, summarizing key methodologies, findings, and future directions. The content is produced using large language models (LLMs) and is intended only for…

Multimodal artificial intelligence (AI) systems have the potential to enhance clinical decision-making by interpreting various types of medical data. However, the effectiveness of these models across all medical fields is uncertain. Each…

Autonomous agents driven by Large Language Models (LLMs) offer enormous potential for automation. Early proof of this technology can be found in various demonstrations of agents solving complex tasks, interacting with external systems to…

Embodied intelligence systems, which enhance agent capabilities through continuous environment interactions, have garnered significant attention from both academia and industry. Vision-Language-Action models, inspired by advancements in…

Robotics · Computer Science 2025-11-13 Haoran Li , Yuhui Chen , Wenbo Cui , Weiheng Liu , Kai Liu , Mingcai Zhou , Zhengtao Zhang , Dongbin Zhao

Large Language Models (LLMs) exhibit remarkable capabilities in the hierarchical decomposition of complex tasks through semantic reasoning. However, their application in embodied systems faces challenges in ensuring reliable execution of…

Robotics · Computer Science 2025-03-04 Mingcong Lei , Ge Wang , Yiming Zhao , Zhixin Mai , Qing Zhao , Yao Guo , Zhen Li , Shuguang Cui , Yatong Han , Jinke Ren

We present the first language-model-driven agentic artificial intelligence (AI) system to autonomously execute multi-stage physics experiments on a production synchrotron light source. Implemented at the Advanced Light Source particle…

Accelerator Physics · Physics 2026-04-28 Thorsten Hellert , Drew Bertwistle , Simon C. Leemann , Antonin Sulc , Marco Venturini

Machine learning methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the APIs by major…

Recent advancements in the field of AI agents have impacted the way we work, enabling greater automation and collaboration between humans and agents. In the data visualization field, multi-agent systems can be useful for employing agents…

Artificial Intelligence · Computer Science 2025-09-03 Anton Wolter , Georgios Vidalakis , Michael Yu , Ankit Grover , Vaishali Dhanoa