English
Related papers

Related papers: Accelerating Self-Supervised Learning via Efficien…

200 papers

Pretrained models from self-supervision are prevalently used in fine-tuning downstream tasks faster or for better accuracy. However, gaining robustness from pretraining is left unexplored. We introduce adversarial training into…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Tianlong Chen , Sijia Liu , Shiyu Chang , Yu Cheng , Lisa Amini , Zhangyang Wang

This paper investigates two techniques for developing efficient self-supervised vision transformers (EsViT) for visual representation learning. First, we show through a comprehensive empirical study that multi-stage architectures with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Chunyuan Li , Jianwei Yang , Pengchuan Zhang , Mei Gao , Bin Xiao , Xiyang Dai , Lu Yuan , Jianfeng Gao

Robotic systems that rely primarily on self-supervised learning have the potential to decrease the amount of human annotation and engineering effort required to learn control strategies. In the same way that prior robotic systems have…

Machine Learning · Computer Science 2025-06-11 Chongyi Zheng , Benjamin Eysenbach , Homer Walke , Patrick Yin , Kuan Fang , Ruslan Salakhutdinov , Sergey Levine

Despite impressive performance, deep neural networks require significant memory and computation costs, prohibiting their application in resource-constrained scenarios. Sparse training is one of the most common techniques to reduce these…

Machine Learning · Computer Science 2023-12-06 Bowen Lei , Dongkuan Xu , Ruqi Zhang , Shuren He , Bani K. Mallick

Self-supervised pretraining has been shown to yield powerful representations for transfer learning. These performance gains come at a large computational cost however, with state-of-the-art methods requiring an order of magnitude more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Olivier J. Hénaff , Skanda Koppula , Jean-Baptiste Alayrac , Aaron van den Oord , Oriol Vinyals , João Carreira

We propose a self-supervised approach for training multi-frame video denoising networks. These networks predict frame t from a window of frames around t. Our self-supervised approach benefits from the video temporal consistency by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Valéry Dewil , Jérémy Anger , Axel Davy , Thibaud Ehret , Pablo Arias , Gabriele Facciolo

Collaborative training can improve the accuracy of a model for a user by trading off the model's bias (introduced by using data from other users who are potentially different) against its variance (due to the limited amount of data on any…

Machine Learning · Computer Science 2022-06-24 El Mahdi Chayti , Sai Praneeth Karimireddy , Sebastian U. Stich , Nicolas Flammarion , Martin Jaggi

Multi-Modal Self-Supervised Learning from videos has been shown to improve model's performance on various downstream tasks. However, such Self-Supervised pre-training requires large batch sizes and a large amount of computation resources…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Duo Wang , Salah Karout

Video restoration and enhancement are critical not only for improving visual quality, but also as essential pre-processing steps to boost the performance of a wide range of downstream computer vision tasks. This survey presents a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Alexandra Malyugina , Yini Li , Joanne Lin , Nantheera Anantrasirichai

Improving performance of deep learning models and reducing their training times are ongoing challenges in deep neural networks. There are several approaches proposed to address these challenges one of which is to increase the depth of the…

Machine Learning · Computer Science 2020-06-20 Sunitha Basodi , Chunyan Ji , Haiping Zhang , Yi Pan

Adversarial training has shown promise in building robust models against adversarial examples. A major drawback of adversarial training is the computational overhead introduced by the generation of adversarial examples. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xiaojun Jia , Jianshu Li , Jindong Gu , Yang Bai , Xiaochun Cao

Spiking Neural Networks (SNNs) have gained popularity due to their high energy efficiency. Prior works have proposed various methods for training SNNs, including backpropagation-based methods. Training SNNs is computationally expensive…

Signal Processing · Electrical Eng. & Systems 2024-11-18 Sai Sanjeet , Bibhu Datta Sahoo , Keshab K. Parhi

Recently, great progress has been made in 3D deep learning with the emergence of deep neural networks specifically designed for 3D point clouds. These networks are often trained from scratch or from pre-trained models learned purely from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bach Tran , Binh-Son Hua , Anh Tuan Tran , Minh Hoai

We propose a new methodology for parameterized constrained robust optimization, an important class of optimization problems under uncertainty, based on learning with a self-supervised penalty-based loss function. Whereas supervised learning…

Optimization and Control · Mathematics 2025-03-10 Wyame Benslimane , Paul Grigas

Vision Transformer (ViT), as a powerful alternative to Convolutional Neural Network (CNN), has received much attention. Recent work showed that ViTs are also vulnerable to adversarial examples like CNNs. To build robust ViTs, an intuitive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Boxi Wu , Jindong Gu , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Deep learning has been achieving decent performance in computer vision requiring a large volume of images, however, collecting images is expensive and difficult in many scenarios. To alleviate this issue, many image augmentation algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Mingle Xu , Sook Yoon , Alvaro Fuentes , Dong Sun Park

Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to…

Machine Learning · Computer Science 2020-07-03 Huanru Henry Mao

Distant supervision has become the standard method for relation extraction. However, even though it is an efficient method, it does not come at no cost---The resulted distantly-supervised training samples are often very noisy. To combat the…

Computation and Language · Computer Science 2018-05-28 Pengda Qin , Weiran Xu , William Yang Wang

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

Machine Learning · Statistics 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

This paper studies how to train machine-learning models that directly approximate the optimal solutions of constrained optimization problems. This is an empirical risk minimization under constraints, which is challenging as training must…

Machine Learning · Computer Science 2022-11-24 Seonho Park , Pascal Van Hentenryck