English
Related papers

Related papers: Data Synthesis for Testing Black-Box Machine Learn…

200 papers

It is essential for users to understand what their AI systems can and can't do in order to use them safely. However, the problem of enabling users to assess AI systems with sequential decision-making (SDM) capabilities is relatively…

Artificial Intelligence · Computer Science 2023-10-31 Pulkit Verma , Rushang Karia , Siddharth Srivastava

Using AI to create autonomous researchers has the potential to accelerate scientific discovery. A prerequisite for this vision is understanding how well an AI model can identify the underlying structure of a black-box system from its…

Machine Learning · Computer Science 2025-05-26 Jiayi Geng , Howard Chen , Dilip Arumugam , Thomas L. Griffiths

For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing problem. The efficiency…

Computation and Language · Computer Science 2022-12-19 Harsh Lara , Manoj Tiwari

Large language models for code generation increasingly rely on synthetic data, where both problem solutions and verification tests are generated by models. While this enables scalable data creation, it introduces a previously unexplored…

Software Engineering · Computer Science 2025-09-26 Srishti Gureja , Elena Tommasone , Jingyi He , Sara Hooker , Matthias Gallé , Marzieh Fadaee

Data-driven methods have become paramount in modern systems and control problems characterized by growing levels of complexity. In safety-critical environments, deploying these methods requires rigorous guarantees, a need that has motivated…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Dario Paccagnan , Daniel Marks , Marco C. Campi , Simone Garatti

The future of work does not require a choice between human and robot. Aside from explicit human-robot collaboration, robotics can play an increasingly important role in helping train workers as well as the tools they may use, especially in…

We present a new approach to integrating deep learning with knowledge-based systems that we believe shows promise. Our approach seeks to emulate reasoning structure, which can be inspected part-way through, rather than simply learning…

Artificial Intelligence · Computer Science 2019-12-12 Aaron Eberhart , Monireh Ebrahimi , Lu Zhou , Cogan Shimizu , Pascal Hitzler

Automatic detection of depression is a rapidly growing field of research at the intersection of psychology and machine learning. However, with its exponential interest comes a growing concern for data privacy and scarcity due to the…

Machine Learning · Computer Science 2024-11-27 Andrea Kang , Jun Yu Chen , Zoe Lee-Youngzie , Shuhao Fu

Studying the reliability of complex systems using machine learning techniques involves facing a series of technical and practical challenges, ranging from the intrinsic nature of the system and data to the difficulties in modeling and…

Machine Learning · Computer Science 2024-10-08 Maria Luz Gamiz , Fernando Navas-Gomez , Rafael Nozal-Cañadas , Rocio Raya-Miranda

Large language models (LLMs) have facilitated the generation of high-quality, cost-effective synthetic data for developing downstream models and conducting statistical analyses in various domains. However, the increased reliance on…

Machine Learning · Computer Science 2025-02-04 Yixin Wu , Ziqing Yang , Yun Shen , Michael Backes , Yang Zhang

Machine learning (ML) offers a promising solution to pathloss prediction. However, its effectiveness can be degraded by the limited availability of data. To alleviate these challenges, this paper introduces a novel simulation-enhanced data…

Research on self-evolving language agents has accelerated, drawing increasing attention to their ability to create, adapt, and maintain tools from task requirements. However, existing benchmarks predominantly rely on predefined…

Software Engineering · Computer Science 2026-03-09 Bowei Xia , Mengkang Hu , Shijian Wang , Jiarui Jin , Wenxiang Jiao , Yuan Lu , Kexin Li , Ping Luo

In recent years, we observe an increasing amount of software with machine learning components being deployed. This poses the question of quality assurance for such components: how can we validate whether specified requirements are fulfilled…

Software Engineering · Computer Science 2021-05-04 Arnab Sharma , Caglar Demir , Axel-Cyrille Ngonga Ngomo , Heike Wehrheim

Automated decision making is used routinely throughout our everyday life. Recommender systems decide which jobs, movies, or other user profiles might be interesting to us. Spell checkers help us to make good use of language. Fraud detection…

Machine Learning · Computer Science 2020-07-15 Alexander Jung , Pedro H. J. Nardelli

We present a generic framework for creating differentially private versions of any hypothesis test in a black-box way. We analyze the resulting tests analytically and experimentally. Most crucially, we show good practical performance for…

Methodology · Statistics 2023-02-09 Zeki Kazan , Kaiyan Shi , Adam Groce , Andrew Bray

In this paper, our goal is to generate synthetic data for heterogeneous (mixed-type) tabular datasets with high machine learning utility (MLu). Since the MLu performance depends on accurately approximating the conditional distributions, we…

Machine Learning · Computer Science 2024-08-20 Seunghwan An , Gyeongdong Woo , Jaesung Lim , ChangHyun Kim , Sungchul Hong , Jong-June Jeon

Generating fake data is an essential dimension of modern software testing, as demonstrated by the number and significance of data faking libraries. Yet, developers of faking libraries cannot keep up with the wide range of data to be…

Software Engineering · Computer Science 2024-06-26 Benoit Baudry , Khashayar Etemadi , Sen Fang , Yogya Gamage , Yi Liu , Yuxin Liu , Martin Monperrus , Javier Ron , André Silva , Deepika Tiwari

The need to model and analyse dynamic systems operating over complex data is ubiquitous in AI and neighboring areas, in particular business process management. Analysing such data-aware systems is a notoriously difficult problem, as they…

Logic in Computer Science · Computer Science 2023-10-20 Alessandro Gianola , Marco Montali , Sarah Winkler

We propose a novel approach for using unsupervised boosting to create an ensemble of generative models, where models are trained in sequence to correct earlier mistakes. Our meta-algorithmic framework can leverage any existing base learner…

Machine Learning · Computer Science 2017-12-25 Aditya Grover , Stefano Ermon

Imbalanced data, where the positive samples represent only a small proportion compared to the negative samples, makes it challenging for classification problems to balance the false positive and false negative rates. A common approach to…

Machine Learning · Statistics 2026-02-17 Pengfei Lyu , Zhengchi Ma , Linjun Zhang , Anru R. Zhang