English
Related papers

Related papers: Riemannian data-dependent randomized smoothing for…

200 papers

Random feature mapping (RFM) is a popular method for speeding up kernel methods at the cost of losing a little accuracy. We study kernel ridge regression with random feature mapping (RFM-KRR) and establish novel out-of-sample error upper…

Machine Learning · Statistics 2019-09-26 Shusen Wang

One of the main purposes of earth observation is to extract interested information and knowledge from remote sensing (RS) images with high efficiency and accuracy. However, with the development of RS technologies, RS system provide images…

Computer Vision and Pattern Recognition · Computer Science 2014-01-14 Lefei Zhang

The current certification process for aerospace software is not adapted to "AI-based" algorithms such as deep neural networks. Unlike traditional aerospace software, the precise parameters optimized during neural network training are as…

Machine Learning · Computer Science 2023-02-23 Maxime Gariel , Brian Shimanuki , Rob Timpe , Evan Wilson

It is of importance to develop statistical techniques to analyze high-dimensional data in the presence of both complex dependence and possible outliers in real-world applications such as imaging data analyses. We propose a new robust…

Methodology · Statistics 2021-10-01 Bingyuan Liu , Qi Zhang , Lingzhou Xue , Peter X. K. Song , Jian Kang

A fundamental problem in robust learning is asymmetry: a learner needs to correctly classify every one of exponentially-many perturbations that an adversary might make to a test-time natural example. In contrast, the attacker only needs to…

Machine Learning · Computer Science 2024-02-14 Saba Ahmadi , Avrim Blum , Omar Montasser , Kevin Stangl

Formally verifying Deep Reinforcement Learning (DRL) systems is a challenging task due to the dynamic continuity of system behaviors and the black-box feature of embedded neural networks. In this paper, we propose a novel abstraction-based…

Artificial Intelligence · Computer Science 2021-06-15 Peng Jin , Min Zhang , Jianwen Li , Li Han , Xuejun Wen

Learning monotonic models with respect to a subset of the inputs is a desirable feature to effectively address the fairness, interpretability, and generalization issues in practice. Existing methods for learning monotonic neural networks…

Machine Learning · Computer Science 2022-12-16 Xingchao Liu , Xing Han , Na Zhang , Qiang Liu

We present a generic method for assessing the quality of non-rigid registration (NRR) algorithms, that does not depend on the existence of any ground truth, but depends solely on the data itself. The data is a set of images. The output of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Carole J. Twining , Vladimir S. Petrović , Timothy F. Cootes , Roy S. Schestowitz , William R. Crum , Christopher J. Taylor

Regularization is an effective way to promote the generalization performance of machine learning models. In this paper, we focus on label smoothing, a form of output distribution regularization that prevents overfitting of a neural network…

Machine Learning · Computer Science 2020-07-07 Weizhi Li , Gautam Dasarathy , Visar Berisha

Although randomized smoothing has demonstrated high certified robustness and superior scalability to other certified defenses, the high computational overhead of the robustness certification bottlenecks the practical applicability, as it…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Ruoxin Chen , Jie Li , Junchi Yan , Ping Li , Bin Sheng

Deep neural networks have proved very successful on archetypal tasks for which large training sets are available, but when the training data are scarce, their performance suffers from overfitting. Many existing methods of reducing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Wei Zhu , Qiang Qiu , Jiaji Huang , Robert Calderbank , Guillermo Sapiro , Ingrid Daubechies

This work is on constrained large-scale non-convex optimization where the constraint set implies a manifold structure. Solving such problems is important in a multitude of fundamental machine learning tasks. Recent advances on Riemannian…

Machine Learning · Computer Science 2023-02-23 Yian Deng , Tingting Mu

To overcome these obstacles and improve computational accuracy and efficiency, this paper presents the Randomized Radial Basis Function Neural Network (RRNN), an innovative approach explicitly crafted for solving multiscale elliptic…

Numerical Analysis · Mathematics 2024-07-23 Yuhang Wu , Ziyuan Liu , Wenjun Sun , Xu Qian

Rendering is the process of generating 2D images from 3D assets, simulated in a virtual environment, typically with a graphics pipeline. By inverting such renderer, one can think of a learning approach to predict a 3D shape from an input…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Shichen Liu , Weikai Chen , Tianye Li , Hao Li

Per-example gradient clipping is a key algorithmic step that enables practical differential private (DP) training for deep learning models. The choice of clipping threshold R, however, is vital for achieving high accuracy under DP. We…

Machine Learning · Computer Science 2023-10-05 Zhiqi Bu , Yu-Xiang Wang , Sheng Zha , George Karypis

A novel machine learning algorithm is presented, serving as a data-driven turbulence modeling tool for Reynolds Averaged Navier-Stokes (RANS) simulations. This machine learning algorithm, called the Tensor Basis Random Forest (TBRF), is…

Fluid Dynamics · Physics 2020-04-20 Mikael L. A. Kaandorp , Richard P. Dwight

Randomized artificial neural networks such as extreme learning machines provide an attractive and efficient method for supervised learning under limited computing ressources and green machine learning. This especially applies when equipping…

Machine Learning · Statistics 2022-01-02 Ansgar Steland , Bart E. Pieters

Artificial Neural Networks (ANNs) have demonstrated remarkable utility in various challenging machine learning applications. While formally verified properties of their behaviors are highly desired, they have proven notoriously difficult to…

Machine Learning · Computer Science 2020-10-05 Xuankang Lin , He Zhu , Roopsha Samanta , Suresh Jagannathan

Covariance matrices have attracted attention for machine learning applications due to their capacity to capture interesting structure in the data. The main challenge is that one needs to take into account the particular geometry of the…

Machine Learning · Computer Science 2019-09-13 Daniel Brooks , Olivier Schwander , Frederic Barbaresco , Jean-Yves Schneider , Matthieu Cord

Neural network verification aims at providing formal guarantees on the output of trained neural networks, to ensure their robustness against adversarial examples and enable their deployment in safety-critical applications. This paper…

Optimization and Control · Mathematics 2024-04-02 Haoruo Zhao , Hassan Hijazi , Haydn Jones , Juston Moore , Mathieu Tanneau , Pascal Van Hentenryck