English
Related papers

Related papers: Model Context Protocol for Vision Systems: Audit, …

200 papers

To standardize interactions between LLM-based agents and their environments, the Model Context Protocol (MCP) was proposed and has since been widely adopted. However, integrating external tools expands the attack surface, exposing agents to…

Cryptography and Security · Computer Science 2026-01-13 Ruiqi Li , Zhiqiang Wang , Yunhao Yao , Xiang-Yang Li

The integration of Large Language Models (LLMs) into software engineering education has driven the emergence of ``Vibe Coding,'' a paradigm where developers articulate high-level intent through natural language and delegate implementation…

Software Engineering · Computer Science 2026-01-07 Aizierjiang Aiersilan

The rise of AI agents introduces a fundamental shift in Visual Analytics (VA), in which agents act as a new user group. Current agentic approaches - based on computer vision and raw DOM access - fail to perform VA tasks accurately and…

Human-Computer Interaction · Computer Science 2026-04-01 Tobias Stähle , Péter Ferenc Gyarmati , Thilo Spinner , Rita Sevastjanova , Dominik Moritz , Mennatallah El-Assady

Image-to-code generation tests whether a vision-language model (VLM) can recover the structure of an image enough to express it as executable code. Existing benchmarks either focus on narrow visual domains, depend on paired executable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Ajay Vikram Periasami , Junlin Wang , Bhuwan Dhingra

Autonomous systems are increasingly deployed in real-world environments, where they must achieve high performance while maintaining safety under state and input constraints. Although Model Predictive Control (MPC) provides a principled…

Robotics · Computer Science 2026-04-28 Hao Wang , Nam Nguyen , Armand Jordana , Ludovic Righetti , Somil Bansal

A supervised learning framework is proposed to approximate a model predictive controller (MPC) with reduced computational complexity and guarantees on stability and constraint satisfaction. The framework can be used for a wide class of…

Systems and Control · Computer Science 2018-06-13 Michael Hertneck , Johannes Köhler , Sebastian Trimpe , Frank Allgöwer

The rapid advancement of vision-language models (VLMs) has brought a lot of attention to their safety alignment. However, existing methods have primarily focused on model undersafety, where the model responds to hazardous queries, while…

Information Retrieval · Computer Science 2025-05-28 Jiahui Geng , Qing Li , Zongxiong Chen , Yuxia Wang , Derui Zhu , Zhuohan Xie , Chenyang Lyu , Xiuying Chen , Preslav Nakov , Fakhri Karray

Spatial reasoning is foundational for Vision-Language Models (VLMs), particularly when deployed as Vision-Language-Action (VLA) agents in physical environments. However, existing benchmarks predominantly focus on elementary, single-hop…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Youngwan Lee , Soojin Jang , Yoorhim Cho , Seunghwan Lee , Yong-Ju Lee , Sung Ju Hwang

Large Language Model (LLM) agents face security vulnerabilities spanning AI-specific and traditional software domains, yet current research addresses these separately. This study bridges this gap through comparative evaluation of Function…

Cryptography and Security · Computer Science 2025-07-10 Tarek Gasmi , Ramzi Guesmi , Ines Belhadj , Jihene Bennaceur

Tool-using agents increasingly operate in open-ended deployment environments, where they compose file systems, web APIs, code interpreters, and enterprise services at runtime. This creates a safety gap in tool composition: an agent can…

Cryptography and Security · Computer Science 2026-05-27 Xiaochong Jiang , Shiqi Yang , Ziwei Li , Lifei Liu , Haoran Yu , Yichen Liu

Human spatiotemporal behavior simulation is critical for urban planning research, yet traditional rule-based and statistical approaches suffer from high computational costs, limited generalizability, and poor scalability. While large…

Artificial Intelligence · Computer Science 2025-06-13 Yu Zhang , Yang Hu , De Wang

The rapid extension of context windows in large vision-language models has given rise to long-context vision-language models (LCVLMs), which are capable of handling hundreds of images with interleaved text tokens in a single forward pass.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Zhaowei Wang , Wenhao Yu , Xiyu Ren , Jipeng Zhang , Yu Zhao , Rohit Saxena , Liang Cheng , Ginny Wong , Simon See , Pasquale Minervini , Yangqiu Song , Mark Steedman

Standard Operating Procedures (SOPs) are critical for enterprise operations, yet existing language models struggle with SOP understanding and cross-domain generalization. Current methods fail because joint training cannot differentiate…

Computation and Language · Computer Science 2026-02-11 Siyuan Huang , Ziyu Wang , Chao Pan , Han Zhao

We propose the Automata-based Multiparty Protocols framework (AMP) for top-down protocol development. The framework features a new very general formalism for global protocol specifications called Protocol State Machines (PSMs),…

Programming Languages · Computer Science 2025-01-29 Felix Stutz , Emanuele D'Osualdo

Video is a promising source of knowledge for embodied agents to learn models of the world's dynamics. Large deep networks have become increasingly effective at modeling complex video data in a self-supervised manner, as evaluated by metrics…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Stephen Tian , Chelsea Finn , Jiajun Wu

Enterprise agents increasingly operate inside scoped retrieval systems, delegated workflows, and policy-constrained evidence environments. In these settings, access control can be enforced correctly while the system still produces an answer…

Artificial Intelligence · Computer Science 2026-05-08 Krti Tallam

In recent years, blockchain has experienced widespread adoption across various industries, becoming integral to numerous enterprise applications. Concurrently, the rise of generative AI and LLMs has transformed human-computer interactions,…

Large Language Models (LLMs) face critical challenges when analyzing security vulnerabilities in real world codebases: token limits prevent loading entire repositories, code embeddings fail to capture inter procedural data flows, and LLMs…

Cryptography and Security · Computer Science 2026-03-27 Ahmed Lekssays

Mistake analysis in procedural activities is a critical area of research with applications spanning industrial automation, physical rehabilitation, education and human-robot collaboration. This paper reviews vision-based methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Konstantinos Bacharidis , Antonis A. Argyros

We present a framework to design nonlinear robust output feedback model predictive control (MPC) schemes that ensure constraint satisfaction under noisy output measurements and disturbances. We provide novel estimation methods to bound the…

Systems and Control · Electrical Eng. & Systems 2021-05-10 Johannes Köhler , Matthias A. Müller , Frank Allgöwer