中文
相关论文

相关论文: On the Importance of Hyperparameters and Data Augm…

200 篇论文

Self-supervised learning (SSL) leverages large datasets of unlabeled speech to reach impressive performance with reduced amounts of annotated data. The high number of proposed approaches fostered the emergence of comprehensive benchmarks…

音频与语音处理 · 电气工程与系统科学 2024-02-22 Salah Zaiem , Youcef Kemiche , Titouan Parcollet , Slim Essid , Mirco Ravanelli

In semi-supervised learning, unlabeled samples can be utilized through augmentation and consistency regularization. However, we observed certain samples, even undergoing strong augmentation, are still correctly classified with high…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Guan Gui , Zhen Zhao , Lei Qi , Luping Zhou , Lei Wang , Yinghuan Shi

State-of-the-art 3D object detectors are usually trained on large-scale datasets with high-quality 3D annotations. However, such 3D annotations are often expensive and time-consuming, which may not be practical for real applications. A…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Chuandong Liu , Chenqiang Gao , Fangcen Liu , Pengcheng Li , Deyu Meng , Xinbo Gao

Deep Learning (DL) methods have emerged as one of the most powerful tools for functional approximation and prediction. While the representation properties of DL have been well studied, uncertainty quantification remains challenging and…

机器学习 · 统计学 2022-10-25 Yuexi Wang , Nicholas G. Polson , Vadim O. Sokolov

The premise of semi-supervised learning (SSL) is that combining labeled and unlabeled data yields significantly more accurate models. Despite empirical successes, the theoretical understanding of SSL is still far from complete. In this…

机器学习 · 统计学 2024-09-06 Eyar Azar , Boaz Nadler

Data augmentation is widely used as a part of the training process applied to deep learning models, especially in the computer vision domain. Currently, common data augmentation techniques are designed manually. Therefore they require…

计算机视觉与模式识别 · 计算机科学 2019-07-31 Irynei Baran , Orest Kupyn , Arseny Kravchenko

Self-supervised learning (SSL) to learn high-level speech representations has been a popular approach to building Automatic Speech Recognition (ASR) systems in low-resource settings. However, the common assumption made in literature is that…

计算与语言 · 计算机科学 2023-05-19 Ashish Seth , Lodagala V S V Durga Prasad , Sreyan Ghosh , S. Umesh

Self-supervised learning (SSL) is an emerging technique that has been successfully employed to train convolutional neural networks (CNNs) and graph neural networks (GNNs) for more transferable, generalizable, and robust representation…

计算机视觉与模式识别 · 计算机科学 2022-09-13 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

State-of-the-art semi-supervised learning (SSL) approaches rely on highly confident predictions to serve as pseudo-labels that guide the training on unlabeled samples. An inherent drawback of this strategy stems from the quality of the…

机器学习 · 计算机科学 2024-03-26 Shambhavi Mishra , Balamurali Murugesan , Ismail Ben Ayed , Marco Pedersoli , Jose Dolz

Often, applications of self-supervised learning to 3D medical data opt to use 3D variants of successful 2D network architectures. Although promising approaches, they are significantly more computationally demanding to train, and thus reduce…

计算机视觉与模式识别 · 计算机科学 2024-02-27 David Torpey , Richard Klein

Self-supervised learning (SSL) is capable of learning remarkable representations from centrally available data. Recent works further implement federated learning with SSL to learn from rapidly growing decentralized unlabeled images (e.g.,…

机器学习 · 计算机科学 2022-04-12 Weiming Zhuang , Yonggang Wen , Shuai Zhang

In recent years, much work has been done on processing of wireless spectrum data involving machine learning techniques in domain-related problems for cognitive radio networks, such as anomaly detection, modulation classification, technology…

网络与互联网体系结构 · 计算机科学 2024-08-23 Ljupcho Milosheski , Gregor Cerar , Blaž Bertalanič , Carolina Fortuna , Mihael Mohorčič

A recurring problem faced when training neural networks is that there is typically not enough data to maximize the generalization capability of deep neural networks(DNN). There are many techniques to address this, including data…

人工智能 · 计算机科学 2017-04-26 Joseph Lemley , Shabab Bazrafkan , Peter Corcoran

3D point clouds are a crucial type of data collected by LiDAR sensors and widely used in transportation applications due to its concise descriptions and accurate localization. Deep neural networks (DNNs) have achieved remarkable success in…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Changyu Zeng , Wei Wang , Anh Nguyen , Yutao Yue

We propose a technique for declaratively specifying strategies for semi-supervised learning (SSL). The proposed method can be used to specify ensembles of semi-supervised learning, as well as agreement constraints and entropic…

机器学习 · 计算机科学 2018-05-21 Haitian Sun , William W. Cohen , Lidong Bing

Deep learning on graphs has attracted significant interests recently. However, most of the works have focused on (semi-) supervised learning, resulting in shortcomings including heavy label reliance, poor generalization, and weak…

机器学习 · 计算机科学 2022-05-05 Yixin Liu , Ming Jin , Shirui Pan , Chuan Zhou , Yu Zheng , Feng Xia , Philip S. Yu

Localizing keypoints of an object is a basic visual problem. However, supervised learning of a keypoint localization network often requires a large amount of data, which is expensive and time-consuming to obtain. To remedy this, there is an…

计算机视觉与模式识别 · 计算机科学 2022-01-25 Can Wang , Sheng Jin , Yingda Guan , Wentao Liu , Chen Qian , Ping Luo , Wanli Ouyang

Semi-supervised learning (SSL) uses unlabeled data during training to learn better models. Previous studies on SSL for medical image segmentation focused mostly on improving model generalization to unseen data. In some applications,…

Semi-supervised learning (SSL) has tremendous value in practice due to its ability to utilize both labeled data and unlabelled data. An important class of SSL methods is to naturally represent data as graphs such that the label information…

机器学习 · 计算机科学 2021-03-01 Zixing Song , Xiangli Yang , Zenglin Xu , Irwin King

Active Learning (AL) and Semi-supervised Learning are two techniques that have been studied to reduce the high cost of deep learning by using a small amount of labeled data and a large amount of unlabeled data. To improve the accuracy of…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Jaeseung Lim , Jongkeun Na , Nojun Kwak