English
Related papers

Related papers: Self-Correcting Neural Networks For Safe Classific…

200 papers

Sentence ordering aims at arranging a list of sentences in the correct order. Based on the observation that sentence order at different distances may rely on different types of information, we devise a new approach based on multi-granular…

Computation and Language · Computer Science 2021-01-29 Yutao Zhu , Kun Zhou , Jian-Yun Nie , Shengchao Liu , Zhicheng Dou

In online classification, a learner is presented with a sequence of examples and aims to predict their labels in an online fashion so as to minimize the total number of mistakes. In the self-directed variant, the learner knows in advance…

Machine Learning · Computer Science 2023-08-08 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

Neural networks in modern communication systems can be susceptible to internal numerical errors that can drastically effect decision results. Such structures are composed of many sections each of which generally contain weighting operations…

Signal Processing · Electrical Eng. & Systems 2023-06-16 George Redinbo

Modern neural network architectures for large-scale learning tasks have substantially higher model complexities, which makes understanding, visualizing and training these architectures difficult. Recent contributions to deep learning…

Machine Learning · Computer Science 2024-10-30 Jayadeva , Himanshu Pant , Mayank Sharma , Abhimanyu Dubey , Sumit Soman , Suraj Tripathi , Sai Guruju , Nihal Goalla

In the semi-supervised learning field, Graph Convolution Network (GCN), as a variant model of GNN, has achieved promising results for non-Euclidean data by introducing convolution into GNN. However, GCN and its variant models fail to safely…

Machine Learning · Computer Science 2022-07-06 Zhi Yang , Yadong Yan , Haitao Gan , Jing Zhao , Zhiwei Ye

This paper introduces a self-supervised learning framework for approximating the Security-Constrained DC Optimal Power Flow (SC-DCOPF) problem using a parametric linear model. The approach preserves the physical structure of the DC-OPF…

Optimization and Control · Mathematics 2026-01-21 Anderson Anrrango , André Quisaguano , Gonzalo E. Constante-Flores , Can Li

Neural networks serve as effective controllers in a variety of complex settings due to their ability to represent expressive policies. The complex nature of neural networks, however, makes their output difficult to verify and predict, which…

Artificial Intelligence · Computer Science 2021-10-22 Sydney M. Katz , Kyle D. Julian , Christopher A. Strong , Mykel J. Kochenderfer

Learning a set of tasks over time, also known as continual learning (CL), is one of the most challenging problems in artificial intelligence. While recent approaches achieve some degree of CL in deep neural networks, they either (1) grow…

Machine Learning · Computer Science 2019-07-15 Blake Camp , Jaya Krishna Mandivarapu , Rolando Estrada

We introduce a general framework for analyzing learning algorithms based on the notion of self-regularization, which captures implicit complexity control without requiring explicit regularization. This is motivated by previous observations…

Machine Learning · Statistics 2026-03-19 Max Schölpple , Liu Fanghui , Ingo Steinwart

Information-theoretic security is considered in the paradigm of network coding in the presence of wiretappers, who can access one arbitrary edge subset up to a certain size, also referred to as the security level. Secure network coding is…

Information Theory · Computer Science 2018-11-07 Xuan Guang , Raymond W. Yeung , Fang-Wei Fu

Safety is a fundamental requirement of control systems. Control Barrier Functions (CBFs) are proposed to ensure the safety of the control system by constructing safety filters or synthesizing control inputs. However, the safety guarantee…

Robotics · Computer Science 2024-03-29 Manan Tayal , Hongchao Zhang , Pushpak Jagtap , Andrew Clark , Shishir Kolathaya

Deep Learning Accelerators are prone to faults which manifest in the form of errors in Neural Networks. Fault Tolerance in Neural Networks is crucial in real-time safety critical applications requiring computation for long durations. Neural…

Machine Learning · Computer Science 2021-06-01 Vasisht Duddu , D. Vijay Rao , Valentina E. Balas

To train robust deep neural networks (DNNs), we systematically study several target modification approaches, which include output regularisation, self and non-self label correction (LC). Two key issues are discovered: (1) Self LC is the…

Machine Learning · Computer Science 2021-06-03 Xinshao Wang , Yang Hua , Elyor Kodirov , David A. Clifton , Neil M. Robertson

Convolutional neural networks (CNNs) are commonly used for image classification. Saliency methods are examples of approaches that can be used to interpret CNNs post hoc, identifying the most relevant pixels for a prediction following the…

Machine Learning · Computer Science 2020-10-01 Nicholas Halliwell , Freddy Lecue

Convolutional Neural Networks (CNNs) have recently emerged as the dominant model in computer vision. If provided with enough training data, they predict almost any visual quantity. In a discrete setting, such as classification, CNNs are not…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Deepak Pathak , Philipp Krähenbühl , Stella X. Yu , Trevor Darrell

Optimization-based controller tuning is challenging because it requires formulating optimization problems explicitly as functions of controller parameters. Safe learning algorithms overcome the challenge by creating surrogate models from…

Systems and Control · Electrical Eng. & Systems 2023-10-27 Marta Zagorowska , Christopher König , Hanlin Yu , Efe C. Balta , Alisa Rupenyan , John Lygeros

This paper considers the problem of learning safe policies in the context of reinforcement learning (RL). In particular, we consider the notion of probabilistic safety. This is, we aim to design policies that maintain the state of the…

Machine Learning · Computer Science 2023-04-20 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

When neural networks (NeuralNets) are implemented in hardware, their weights need to be stored in memory devices. As noise accumulates in the stored weights, the NeuralNet's performance will degrade. This paper studies how to use error…

Information Theory · Computer Science 2020-01-14 Kunping Huang , Paul Siegel , Anxiao , Jiang

Neural networks are not learning optimal decision boundaries. We show that decision boundaries are situated in areas of low training data density. They are impacted by few training samples which can easily lead to overfitting. We provide a…

Machine Learning · Computer Science 2023-10-09 Johannes Schneider

A key challenge for deploying deep neural networks (DNNs) in safety critical settings is the need to provide rigorous ways to quantify their uncertainty. In this paper, we propose a novel algorithm for constructing predicted classification…

Machine Learning · Computer Science 2021-03-19 Sangdon Park , Shuo Li , Insup Lee , Osbert Bastani