English
Related papers

Related papers: Auditing Black-Box LLM APIs with a Rank-Based Unif…

200 papers

With the growth of web applications, REST APIs have become the primary communication method between services. In order to ensure system reliability and security, software quality can be assured by effective testing methods. Black box fuzz…

Software Engineering · Computer Science 2022-01-03 Chung-Hsuan Tsai , Shi-Chun Tsai , Shih-Kun Huang

Large language models have increasingly been proposed as a powerful replacement for classical agent-based models (ABMs) to simulate social dynamics. By using LLMs as a proxy for human behavior, the hope of this new approach is to be able to…

Computers and Society · Computer Science 2024-12-09 Da Ju , Adina Williams , Brian Karrer , Maximilian Nickel

Large Language Models (LLMs) aligned with human feedback have recently garnered significant attention. However, it remains vulnerable to jailbreak attacks, where adversaries manipulate prompts to induce harmful outputs. Exploring jailbreak…

Cryptography and Security · Computer Science 2024-12-23 Hongyi Li , Jiawei Ye , Jie Wu , Tianjie Yan , Chu Wang , Zhixin Li

Black-box explanation is the problem of explaining how a machine learning model -- whose internal logic is hidden to the auditor and generally complex -- produces its outcomes. Current approaches for solving this problem include model…

Machine Learning · Computer Science 2019-05-16 Ulrich Aïvodji , Hiromi Arai , Olivier Fortineau , Sébastien Gambs , Satoshi Hara , Alain Tapp

Recently, using Large Language Models (LLMs) to generate optimization models from natural language descriptions has became increasingly popular. However, a major open question is how to validate that the generated models are correct and…

Artificial Intelligence · Computer Science 2026-04-07 Alexander Zadorojniy , Segev Wasserkrug , Eitan Farchi

REST APIs are prevalent among web service implementations, easing interoperability through the HTTP protocol. API testers and users exploit the widely adopted OpenAPI Specification (OAS), a machine-readable standard to document REST APIs.…

Software Engineering · Computer Science 2025-07-17 Alix Decrop , Xavier Devroey , Mike Papadakis , Pierre-Yves Schobbens , Gilles Perrouin

As modern web services increasingly rely on REST APIs, their thorough testing has become crucial. Furthermore, the advent of REST API documentation languages, such as the OpenAPI Specification, has led to the emergence of many black-box…

Software Engineering · Computer Science 2025-01-23 Myeongsoo Kim , Tyler Stennett , Saurabh Sinha , Alessandro Orso

Large Language Models (LLMs) have significantly advanced the fact-checking studies. However, existing automated fact-checking evaluation methods rely on static datasets and classification metrics, which fail to automatically evaluate the…

Computation and Language · Computer Science 2025-03-04 Hongzhan Lin , Yang Deng , Yuxuan Gu , Wenxuan Zhang , Jing Ma , See-Kiong Ng , Tat-Seng Chua

Relay and reseller APIs increasingly intermediate access to large language models (LLMs), but users have no direct way to verify that a claimed endpoint is actually serving the advertised model. We introduce KBF, a low-cost black-box…

Cryptography and Security · Computer Science 2026-05-29 Yijia Fang , Yiqing Feng , Bingyu Li , Mingxun Zhou

In current benchmarks for evaluating large language models (LLMs), there are issues such as evaluation content restriction, untimely updates, and lack of optimization guidance. In this paper, we propose a new paradigm for the measurement of…

Computation and Language · Computer Science 2024-07-11 Jin Liu , Qingquan Li , Wenlong Du

LLM agents are increasingly expected to function as general-purpose systems capable of resolving open-ended user requests. While existing benchmarks focus on domain-aware environments for developing specialized agents, evaluating…

Artificial Intelligence · Computer Science 2026-02-24 Xiaochuan Li , Ryan Ming , Pranav Setlur , Abhijay Paladugu , Andy Tang , Hao Kang , Shuai Shao , Rong Jin , Chenyan Xiong

Current large language models (LLM) provide a strong foundation for large-scale user-oriented natural language tasks. Many users can easily inject adversarial text or instructions through the user interface, thus causing LLM model security…

Computation and Language · Computer Science 2024-11-14 Chong Zhang , Mingyu Jin , Dong Shu , Taowen Wang , Dongfang Liu , Xiaobo Jin

Abstention Ability (AA) is a critical aspect of Large Language Model (LLM) reliability, referring to an LLM's capability to withhold responses when uncertain or lacking a definitive answer, without compromising performance. Although…

Computation and Language · Computer Science 2024-09-25 Nishanth Madhusudhan , Sathwik Tejaswi Madhusudhan , Vikas Yadav , Masoud Hashemi

Software testing plays a critical role in ensuring that systems behave as intended. However, existing automated testing approaches struggle to match the capabilities of human engineers due to key limitations such as test locality, lack of…

Software Engineering · Computer Science 2025-06-16 Kangping Xu , Yifan Luo , Yang Yuan , Andrew Chi-Chih Yao

We present a novel black-box jailbreaking framework that integrates multiple LLM-as-Attacker strategies to deliver highly transferable and effective attacks. The framework is grounded in three key insights from prior jailbreaking research…

Cryptography and Security · Computer Science 2025-11-07 Yiqi Yang , Hongye Fu

Large Language Models (LLMs) are rarely static and are frequently updated in practice. A growing body of alignment research has shown that models initially deemed "aligned" can exhibit misaligned behavior after fine-tuning, such as…

Machine Learning · Computer Science 2026-02-02 Yavuz Bakman , Duygu Nur Yaldiz , Salman Avestimehr , Sai Praneeth Karimireddy

Large language models (LLMs) show strong performance across many applications, but their ability to memorize and potentially reveal training data raises serious privacy concerns. We introduce the PopQuiz Attack, a black-box membership…

Cryptography and Security · Computer Science 2026-05-08 Zeyuan Chen , Yihan Ma , Xinyue Shen , Michael Backes , Yang Zhang

The financial industry faces a significant challenge modeling and risk portfolios: balancing the predictability of advanced machine learning models, neural network models, and explainability required by regulatory entities (such as Office…

Machine Learning · Computer Science 2025-11-10 Rongbin Ye , Jiaqi Chen

Integrating large language models (LLMs) into robotic systems has revolutionised embodied artificial intelligence, enabling advanced decision-making and adaptability. However, ensuring reliability, encompassing both security against…

Robotics · Computer Science 2025-09-03 Wenxiao Zhang , Xiangrui Kong , Conan Dewitt , Thomas Bräunl , Jin B. Hong

Large Language Models (LLMs) hold significant potential for advancing fact-checking by leveraging their capabilities in reasoning, evidence retrieval, and explanation generation. However, existing benchmarks fail to comprehensively evaluate…

Computation and Language · Computer Science 2025-06-17 Shuo Yang , Yuqin Dai , Guoqing Wang , Xinran Zheng , Jinfeng Xu , Jinze Li , Zhenzhe Ying , Weiqiang Wang , Edith C. H. Ngai