English
Related papers

Related papers: Improving Certified Robustness via Statistical Lea…

200 papers

While Machine Learning (ML) technologies are widely adopted in many mission critical fields to support intelligent decision-making, concerns remain about system resilience against ML-specific security attacks and privacy breaches as well as…

Machine Learning · Computer Science 2022-02-15 Pulei Xiong , Scott Buffett , Shahrear Iqbal , Philippe Lamontagne , Mohammad Mamun , Heather Molyneaux

Context: Machine Learning (ML) has been at the heart of many innovations over the past years. However, including it in so-called 'safety-critical' systems such as automotive or aeronautic has proven to be very challenging, since the shift…

Large Language Models (LLMs) have achieved remarkable success in tasks requiring complex reasoning, such as code generation, mathematical problem solving, and algorithmic synthesis -- especially when aided by reasoning tokens and…

Computation and Language · Computer Science 2025-06-13 Jaechul Roh , Varun Gandhi , Shivani Anilkumar , Arin Garg

LLMs have made significant progress in the field of mathematical reasoning, but whether they have true the mathematical understanding ability is still controversial. To explore this issue, we propose a new perturbation framework to evaluate…

Artificial Intelligence · Computer Science 2025-11-12 Zhishen Sun , Guang Dai , Ivor Tsang , Haishan Ye

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Synthetic verification techniques such as generating test cases and reward modelling are common ways to enhance the coding capabilities of large language models (LLM) beyond predefined tests. Additionally, code verification has recently…

Artificial Intelligence · Computer Science 2025-07-31 Aleksander Ficek , Somshubra Majumdar , Vahid Noroozi , Boris Ginsburg

Neural networks have demonstrated considerable success on a wide variety of real-world problems. However, networks trained only to optimize for training accuracy can often be fooled by adversarial examples - slightly perturbed inputs that…

Machine Learning · Computer Science 2019-02-19 Vincent Tjeng , Kai Xiao , Russ Tedrake

Reinforcement learning (RL) policies deployed in real-world environments must remain reliable under adversarial perturbations. At the same time, modern deep RL agents are heavily over-parameterized, raising costs and fragility concerns.…

Machine Learning · Computer Science 2025-10-16 James Pedley , Benjamin Etheridge , Stephen J. Roberts , Francesco Quinzan

Knowledge graph reasoning, which aims at predicting the missing facts through reasoning with the observed facts, is critical to many applications. Such a problem has been widely explored by traditional logic rule-based approaches and recent…

Machine Learning · Computer Science 2019-10-30 Meng Qu , Jian Tang

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Machine Learning · Computer Science 2022-02-03 Michael Everett , Bjorn Lutjens , Jonathan P. How

Deep neural networks have been widely adopted in many vision and robotics applications with visual inputs. It is essential to verify its robustness against semantic transformation perturbations, such as brightness and contrast. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hanjiang Hu , Bowei Li , Ziwei Wang , Tianhao Wei , Casidhe Hutchison , Eric Sample , Changliu Liu

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

Machine Learning · Computer Science 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

Machine Learning (ML) is increasingly used to implement advanced applications with non-deterministic behavior, which operate on the cloud-edge continuum. The pervasive adoption of ML is urgently calling for assurance solutions assessing…

Machine Learning · Computer Science 2023-10-24 Marco Anisetti , Claudio A. Ardagna , Nicola Bena , Ernesto Damiani

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

Computation and Language · Computer Science 2025-11-07 Pankaj Kumar , Subhankar Mishra

State-of-the-art NLP models can often be fooled by human-unaware transformations such as synonymous word substitution. For security reasons, it is of critical importance to develop models with certified robustness that can provably…

Machine Learning · Computer Science 2020-06-01 Mao Ye , Chengyue Gong , Qiang Liu

While most approaches in formal methods address system correctness, ensuring robustness has remained a challenge. In this paper we present and study the logic rLTL which provides a means to formally reason about both correctness and…

Logic in Computer Science · Computer Science 2022-01-20 Tzanis Anevlavis , Matthew Philippe , Daniel Neider , Paulo Tabuada

Statistical machine learning often uses probabilistic algorithms, such as Markov Chain Monte Carlo (MCMC), to solve a wide range of problems. Many accelerators are proposed using specialized hardware to address sampling inefficiency, the…

Signal Processing · Electrical Eng. & Systems 2020-03-09 Xiangyu Zhang , Sayan Mukherjee , Alvin R. Lebeck

Robustness is critical for machine learning (ML) classifiers to ensure consistent performance in real-world applications where models may encounter corrupted or adversarial inputs. In particular, assessing the robustness of classifiers to…

Machine Learning · Computer Science 2024-09-06 Georg Siedel , Ekagra Gupta , Andrey Morozov

Neural networks have emerged as essential components in safety-critical applications -- these use cases demand complex, yet trustworthy computations. Binarized Neural Networks (BNNs) are a type of neural network where each neuron is…

Machine Learning · Computer Science 2025-07-08 Jiong Yang , Yong Kiam Tan , Mate Soos , Magnus O. Myreen , Kuldeep S. Meel

Logic provides a controlled testbed for evaluating LLM-based reasoners, yet standard SAT-style benchmarks often conflate surface difficulty (length, wording, clause order) with the structural phenomena that actually determine…

Artificial Intelligence · Computer Science 2026-02-16 Naïm Es-sebbani , Esteban Marquer , Yakoub Salhi , Zied Bouraoui