English
Related papers

Related papers: Certified Computation from Unreliable Datasets

200 papers

Programmatic weak supervision (PWS) significantly reduces human effort for labeling data by combining the outputs of user-provided labeling functions (LFs) on unlabeled datapoints. However, the quality of the generated labels depends…

Machine Learning · Computer Science 2025-06-05 Chenjie Li , Amir Gilad , Boris Glavic , Zhengjie Miao , Sudeepa Roy

We make two contributions to the problem of estimating the $L_1$ calibration error of a binary classifier from a finite dataset. First, we provide an upper bound for any classifier where the calibration function has bounded variation.…

Neural network controllers (NNCs) have shown great promise in autonomous and cyber-physical systems. Despite the various verification approaches for neural networks, the safety analysis of NNCs remains an open problem. Existing verification…

Machine Learning · Computer Science 2023-01-31 Chi Zhang , Wenjie Ruan , Peipei Xu

Certified robustness is a critical property for deploying neural networks (NN) in safety-critical applications. A principle approach to achieving such guarantees is to constrain the global Lipschitz constant of the network. However,…

Machine Learning · Computer Science 2025-07-01 Zain ul Abdeen , Vassilis Kekatos , Ming Jin

Despite rapid progress in claim verification, we lack a systematic understanding of what reasoning these benchmarks actually exercise. We generate structured reasoning traces for 24K claim-verification examples across 9 datasets using…

Computation and Language · Computer Science 2026-04-03 Delip Rao , Chris Callison-Burch

Adversarial training is arguably the most popular way to provide empirical robustness against specific adversarial examples. While variants based on multi-step attacks incur significant computational overhead, single-step variants are…

Machine Learning · Computer Science 2025-03-25 Alessandro De Palma , Serge Durand , Zakaria Chihani , François Terrier , Caterina Urban

As control systems become increasingly more complex, there exists a pressing need to find systematic ways of verifying them. To address this concern, there has been significant work in developing test generation schemes for black-box…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Prithvi Akella , Ugo Rosolia , Andrew Singletary , Aaron D. Ames

In this paper, we consider the data-driven model invalidation problem for Lipschitz continuous systems, where instead of given mathematical models, only prior noisy sampled data of the systems are available. We show that this data-driven…

Systems and Control · Electrical Eng. & Systems 2020-03-27 Zeyuan Jin , Mohammad Khajenejad , Sze Zheng Yong

Acquiring ground truth labels for unlabelled data can be a costly procedure, since it often requires manual labour that is error-prone. Consequently, the available amount of labelled data is increasingly reduced due to the limitations of…

Machine Learning · Computer Science 2019-12-24 Athanasios Davvetas , Iraklis A. Klampanos

In large-scale benchmarking of stochastic optimization algorithms, the key challenge is no longer whether repeated runs are needed for reliability, but how to determine when sufficient evidence has been collected without incurring…

Machine Learning · Computer Science 2026-05-28 Sara Gjorgjieva , Eva Tuba , Tome Eftimov

We introduce a reliable compressive procedure to uniquely characterize any given low-rank quantum measurement using a minimal set of probe states that is based solely on data collected from the unknown measurement itself. The procedure is…

Quantum Physics · Physics 2020-11-03 I. Gianani , Y. S. Teo , V. Cimini , H. Jeong , G. Leuchs , M. Barbieri , L. L. Sanchez-Soto

Writing correct distributed programs is hard. In spite of extensive testing and debugging, software faults persist even in commercial grade software. Many distributed systems, especially those employed in safety-critical environments,…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Neeraj Mittal , Vijay K. Garg

Algorithmic verification of realistic systems to satisfy safety and other temporal requirements has suffered from poor scalability of the employed formal approaches. To design systems with rigorous guarantees, many approaches still rely on…

Systems and Control · Electrical Eng. & Systems 2024-03-18 Oliver Schön , Zhengang Zhong , Sadegh Soudjani

Nonlinear, adaptive, or otherwise complex control techniques are increasingly relied upon to ensure the safety of systems operating in uncertain environments. However, the nonlinearity of the resulting closed-loop system complicates…

Systems and Control · Computer Science 2018-01-17 John F. Quindlen , Ufuk Topcu , Girish Chowdhary , Jonathan P. How

Trustworthy verifiers are essential for the success of reinforcement learning with verifiable reward (RLVR), which is the core methodology behind various large reasoning models such as DeepSeek-R1. In complex domains like mathematical…

Machine Learning · Computer Science 2025-10-08 Yuzhen Huang , Weihao Zeng , Xingshan Zeng , Qi Zhu , Junxian He

Computational problem certificates are additional data structures for each output, which can be used by a-possibly randomized-verification algorithm that proves the correctness of each output. In this paper, we give an algorithm that…

Symbolic Computation · Computer Science 2019-12-03 Jean-Guillaume Dumas , Erich Kaltofen , Emmanuel Thomé , Gilles Villard

Negative sampling approaches are prevalent in implicit collaborative filtering for obtaining negative labels from massive unlabeled data. As two major concerns in negative sampling, efficiency and effectiveness are still not fully achieved…

Machine Learning · Computer Science 2020-09-09 Jingtao Ding , Yuhan Quan , Quanming Yao , Yong Li , Depeng Jin

These notes outline a formal method for program verification of numerical computation. It forms the basis of the software package VPC in its initial phase of development. Much of the style of presentation is in the form of notes that…

Mathematical Software · Computer Science 2014-01-08 Garry Pantelis

Prediction, where observed data is used to quantify uncertainty about a future observation, is a fundamental problem in statistics. Prediction sets with coverage probability guarantees are a common solution, but these do not provide…

Statistics Theory · Mathematics 2022-11-22 Leonardo Cella , Ryan Martin

We propose a new reachability learning framework for high-dimensional nonlinear systems, focusing on reach-avoid problems. These problems require computing the reach-avoid set, which ensures that all its elements can safely reach a target…

Systems and Control · Electrical Eng. & Systems 2025-02-18 Jingqi Li , Donggun Lee , Jaewon Lee , Kris Shengjun Dong , Somayeh Sojoudi , Claire Tomlin