English
Related papers

Related papers: Using learned optimizers to make models robust to …

200 papers

A central goal of unsupervised learning is to acquire representations from unlabeled data or experience that can be used for more effective learning of downstream tasks from modest amounts of labeled data. Many prior unsupervised learning…

Machine Learning · Computer Science 2019-03-25 Kyle Hsu , Sergey Levine , Chelsea Finn

In this work, we used a semi-supervised learning method to train deep learning model that can segment the brain MRI images. The semi-supervised model uses less labeled data, and the performance is competitive with the supervised model with…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Hedong Zhang , Anand A. Joshi

Diffusion models have achieved remarkable success across a wide range of generative tasks, yet their training paradigm largely treats injected noise as uniformly informative. In this work, we challenge this assumption and introduce…

Meta-learning can extract an inductive bias from previous learning experience and assist the training of new tasks. It is often realized through optimizing a meta-model with the evaluation loss of task-specific solvers. Most existing…

Machine Learning · Computer Science 2021-12-20 Su Lu , Han-Jia Ye , Le Gan , De-Chuan Zhan

Computational modeling of naturalistic conversations in clinical applications has seen growing interest in the past decade. An important use-case involves child-adult interactions within the autism diagnosis and intervention domain. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-30 Nithin Rao Koluguri , Manoj Kumar , So Hyun Kim , Catherine Lord , Shrikanth Narayanan

Ambient diffusion is a recently proposed framework for training diffusion models using corrupted data. Both Ambient Diffusion and alternative SURE-based approaches for learning diffusion models from corrupted data resort to approximations…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Giannis Daras , Alexandros G. Dimakis , Constantinos Daskalakis

The success of automated driving deployment is highly depending on the ability to develop an efficient and safe driving policy. The problem is well formulated under the framework of optimal control as a cost optimization problem. Model…

Artificial Intelligence · Computer Science 2017-06-14 Ahmad El Sallab , Mahmoud Saeed , Omar Abdel Tawab , Mohammed Abdou

Image classification has significantly improved using deep learning. This is mainly due to convolutional neural networks (CNNs) that are capable of learning rich feature extractors from large datasets. However, most deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Xiaoyu Lin , Deblina Bhattacharjee , Majed El Helou , Sabine Süsstrunk

Analog hardware implemented deep learning models are promising for computation and energy constrained systems such as edge computing devices. However, the analog nature of the device and the associated many noise sources will cause changes…

Machine Learning · Computer Science 2020-12-18 Omobayode Fagbohungbe , Lijun Qian

While deep neural networks have been shown to perform remarkably well in many machine learning tasks, labeling a large amount of ground truth data for supervised training is usually very costly to scale. Therefore, learning robust…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jianbo Jiao , Linchao Bao , Yunchao Wei , Shengfeng He , Honghui Shi , Rynson Lau , Thomas S. Huang

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Noise is a fundamental problem in learning theory with huge effects in the application of Machine Learning (ML) methods, due to real world data tendency to be noisy. Additionally, introduction of malicious noise can make ML methods fail…

Machine Learning · Computer Science 2024-06-13 Alfredo Ibias , Karol Capala , Varun Ravi Varma , Anna Drozdz , Jose Sousa

Previous robustness approaches for deep learning models such as data augmentation techniques via data transformation or adversarial training cannot capture real-world variations that preserve the semantics of the input, such as a change in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Shuo Wang , Lingjuan Lyu , Surya Nepal , Carsten Rudolph , Marthie Grobler , Kristen Moore

While the traditional formulation of machine learning tasks is in terms of performance on average, in practice we are often interested in how well a trained model performs on rare or difficult data points at test time. To achieve more…

Machine Learning · Computer Science 2025-12-29 Matthew J. Holland , Toma Hamada

Compared with traditional seismic noise attenuation algorithms that depend on signal models and their corresponding prior assumptions, removing noise with a deep neural network is trained based on a large training set, where the inputs are…

Geophysics · Physics 2019-07-23 Siwei Yu , Jianwei Ma , Wenlong Wang

We investigate robustness properties of pre-trained neural models for automatic speech recognition. Real life data in machine learning is usually very noisy and almost never clean, which can be attributed to various factors depending on the…

Computation and Language · Computer Science 2022-08-19 Goutham Rajendran , Wei Zou

A recently-proposed technique called self-adaptive training augments modern neural networks by allowing them to adjust training labels on the fly, to avoid overfitting to samples that may be mislabeled or otherwise non-representative. By…

Machine Learning · Computer Science 2020-06-16 Daniel Chiu , Franklyn Wang , Scott Duke Kominers

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

Machine Learning · Statistics 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

Distant supervision provides a means to create a large number of weakly labeled data at low cost for relation classification. However, the resulting labeled instances are very noisy, containing data with wrong labels. Many approaches have…

Computation and Language · Computer Science 2020-10-27 Zhenzhen Li , Jian-Yun Nie , Benyou Wang , Pan Du , Yuhan Zhang , Lixin Zou , Dongsheng Li

Deep neural networks provide excellent performance for inverse problems such as denoising. However, neural networks can be sensitive to adversarial or worst-case perturbations. This raises the question of whether such networks can be…

Machine Learning · Computer Science 2023-07-25 Anselm Krainovic , Mahdi Soltanolkotabi , Reinhard Heckel