中文
相关论文

相关论文: VLM-Fuzz: Vision Language Model Assisted Recursive…

200 篇论文

The flourishing ecosystem centered around voice personal assistants (VPA), such as Amazon Alexa, has led to the booming of VPA apps. The largest app market Amazon skills store, for example, hosts over 200,000 apps. Despite their popularity,…

软件工程 · 计算机科学 2024-07-04 Suwan Li , Lei Bu , Guangdong Bai , Fuman Xie , Kai Chen , Chang Yue

With the rapid advancement of large language models (LLMs), mobile agents have emerged as promising tools for phone automation, simulating human interactions on screens to accomplish complex tasks. However, these agents often suffer from…

人机交互 · 计算机科学 2026-04-21 Shiquan Zhang , Tianyi Zhang , Le Fang , Simon D'Alfonso , Hong Jia , Vassilis Kostakos

Fuzzing has been incredibly successful in uncovering bugs and vulnerabilities across diverse software systems. JSON parsers play a vital role in modern software development, and ensuring their reliability is of great importance. This…

软件工程 · 计算机科学 2024-10-31 Zhiyuan Zhong , Zhezhen Cao , Zhanwei Zhang

Modern life has witnessed the explosion of mobile devices. However, besides the valuable features that bring convenience to end users, security and privacy risks still threaten users of mobile apps. The increasing sophistication of these…

密码学与安全 · 计算机科学 2025-12-02 Tran Thanh Lam Nguyen , Barbara Carminati , Elena Ferrari

Maritime port inspection plays a critical role in ensuring safety, regulatory compliance, and operational efficiency in complex maritime environments. However, existing inspection methods often rely on manual operations and conventional…

机器人学 · 计算机科学 2026-01-21 Muhayy Ud Din , Waseem Akram , Ahsan B. Bakht , Irfan Hussain

Data visualization (DataViz) libraries play a crucial role in presentation, data analysis, and application development, underscoring the importance of their accuracy in transforming data into visual representations. Incorrect visualizations…

软件工程 · 计算机科学 2025-06-19 Weiqi Lu , Yongqiang Tian , Xiaohan Zhong , Haoyang Ma , Zhenyang Xu , Shing-Chi Cheung , Chengnian Sun

With the growing number and diversity of Vision-Language Models (VLMs), many works explore language-based ensemble, collaboration, and routing techniques across multiple VLMs to improve multi-model reasoning. In contrast, we address the…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Selim Furkan Tekin , Yichang Xu , Gaowen Liu , Ramana Rao Kompella , Margaret L. Loper , Ling Liu

The increasing integration of Visual Language Models (VLMs) into AI systems necessitates robust model alignment, especially when handling multimodal content that combines text and images. Existing evaluation datasets heavily lean towards…

计算与语言 · 计算机科学 2026-03-05 Gabriel Downer , Sean Craven , Damian Ruck , Jake Thomas

Recent advancements in generative AI have led to the widespread adoption of large language models (LLMs) in software engineering, addressing numerous long-standing challenges. However, a comprehensive study examining the capabilities of…

We propose general visual inspection model using Vision-Language Model~(VLM) with few-shot images of non-defective or defective products, along with explanatory texts that serve as inspection criteria. Although existing VLM exhibit high…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Shiryu Ueno , Yoshikazu Hayashi , Shunsuke Nakatsuka , Yusei Yamada , Hiroaki Aizawa , Kunihito Kato

Command-line interface (CLI) fuzzing tests programs by mutating both command-line options and input file contents, thus enabling discovery of vulnerabilities that only manifest under specific option-input combinations. Prior works of CLI…

密码学与安全 · 计算机科学 2026-03-16 Momoko Shiraishi , Yinzhi Cao , Takahiro Shinagawa

Visual agent models for automating human activities on Graphical User Interfaces (GUIs) have emerged as a promising research direction, driven by advances in large Vision Language Models (VLMs). A critical challenge in GUI automation is the…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Joonhyung Park , Peng Tang , Sagnik Das , Srikar Appalaraju , Kunwar Yashraj Singh , R. Manmatha , Shabnam Ghadar

Recent advancements in Vision-Language Models (VLMs) have sparked interest in their use for autonomous driving, particularly in generating interpretable driving decisions through natural language. However, the assumption that VLMs…

计算机视觉与模式识别 · 计算机科学 2025-01-08 Shaoyuan Xie , Lingdong Kong , Yuhao Dong , Chonghao Sima , Wenwei Zhang , Qi Alfred Chen , Ziwei Liu , Liang Pan

Network protocols are the foundation of modern communication, yet their implementations often contain semantic vulnerabilities stemming from inadequate understanding of specification semantics. Existing gray-box and black-box testing…

密码学与安全 · 计算机科学 2026-03-09 Yanbang Sun , Quan Luo , Yuelin Wang , Qian Chen , Benjin Liu , Ruiqi Chen , Qing Huang , Xiaohong Li , Junjie Wang

While AI-coding assistants accelerate software development, current testing frameworks struggle to keep pace with the resulting volume of AI-generated code. Traditional fuzzing techniques often allocate resources uniformly and lack semantic…

软件工程 · 计算机科学 2026-02-13 Ziyi Yang , Kalit Inani , Keshav Kabra , Vima Gupta , Anand Padmanabha Iyer

Due to the vast array of Android applications, their multifarious functions and intricate behavioral semantics, attackers can adopt various tactics to conceal their genuine attack intentions within legitimate functions. However, numerous…

密码学与安全 · 计算机科学 2024-10-23 Wenxiang Zhao , Juntao Wu , Zhaoyi Meng

In Android GUI testing, generating an action sequence for a task that can be replayed as a test script is common. Generating sequences of actions and respective test scripts from task goals described in natural language can eliminate the…

软件工程 · 计算机科学 2025-09-12 Hieu Huynh , Hai Phung , Hao Pham , Tien N. Nguyen , Vu Nguyen

Detecting vulnerabilities in source code remains critical yet challenging, as conventional static analysis tools construct inaccurate program representations, while existing LLM-based approaches often miss essential vulnerability context…

Deep learning has emerged as a promising technology for achieving Android malware detection. To further unleash its detection potentials, software visualization can be integrated for analyzing the details of app behaviors clearly. However,…

密码学与安全 · 计算机科学 2024-10-10 Zhaoyi Meng , Jiale Zhang , Jiaqi Guo , Wansen Wang , Wenchao Huang , Jie Cui , Hong Zhong , Yan Xiong

Large Language Models (LLMs) have shown promise in tasks like code translation, prompting interest in their potential for automating software vulnerability detection (SVD) and patching (SVP). To further research in this area, establishing a…

软件工程 · 计算机科学 2024-09-18 Arastoo Zibaeirad , Marco Vieira