中文
相关论文

相关论文: Self-Supervised Representation Learning: Introduct…

200 篇论文

Learning useful representations with little or no supervision is a key challenge in artificial intelligence. We provide an in-depth review of recent advances in representation learning with a focus on autoencoder-based models. To organize…

机器学习 · 计算机科学 2018-12-13 Michael Tschannen , Olivier Bachem , Mario Lucic

Representation learning with small labeled data have emerged in many problems, since the success of deep neural networks often relies on the availability of a huge amount of labeled data that is expensive to collect. To address it, many…

计算机视觉与模式识别 · 计算机科学 2021-01-05 Guo-Jun Qi , Jiebo Luo

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

This thesis focuses on representation learning for sequence data over time or space, aiming to improve downstream sequence prediction tasks by using the learned representations. Supervised learning has been the most dominant approach for…

音频与语音处理 · 电气工程与系统科学 2023-08-02 Qingming Tang

The success of most advanced facial expression recognition works relies heavily on large-scale annotated datasets. However, it poses great challenges in acquiring clean and consistent annotations for facial expression datasets. On the other…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Yuxuan Shu , Xiao Gu , Guang-Zhong Yang , Benny Lo

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

计算机视觉与模式识别 · 计算机科学 2017-08-22 Gustav Larsson

Unsupervised visual representation learning remains a largely unsolved problem in computer vision research. Among a big body of recently proposed approaches for unsupervised learning of visual representations, a class of self-supervised…

计算机视觉与模式识别 · 计算机科学 2019-01-28 Alexander Kolesnikov , Xiaohua Zhai , Lucas Beyer

Large-scale labeled data are generally required to train deep neural networks in order to obtain better performance in visual feature learning from images or videos for computer vision applications. To avoid extensive cost of collecting and…

计算机视觉与模式识别 · 计算机科学 2019-02-19 Longlong Jing , Yingli Tian

Collecting large annotated datasets in Remote Sensing is often expensive and thus can become a major obstacle for training advanced machine learning models. Common techniques of addressing this issue, based on the underlying idea of…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Rahul Ghosh , Xiaowei Jia , Chenxi Lin , Zhenong Jin , Vipin Kumar

The goal of supervised representation learning is to construct effective data representations for prediction. Among all the characteristics of an ideal nonparametric representation of high-dimensional complex data, sufficiency, low…

机器学习 · 计算机科学 2022-09-02 Jian Huang , Yuling Jiao , Xu Liao , Jin Liu , Zhou Yu

Since about 100 years ago, to learn the intrinsic structure of data, many representation learning approaches have been proposed, including both linear ones and nonlinear ones, supervised ones and unsupervised ones. Particularly, deep…

机器学习 · 计算机科学 2016-11-28 Guoqiang Zhong , Li-Na Wang , Junyu Dong

Deep semi-supervised learning is a fast-growing field with a range of practical applications. This paper provides a comprehensive survey on both fundamentals and recent advances in deep semi-supervised learning methods from perspectives of…

机器学习 · 计算机科学 2023-10-31 Xiangli Yang , Zixing Song , Irwin King , Zenglin Xu

The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind…

机器学习 · 计算机科学 2014-04-24 Yoshua Bengio , Aaron Courville , Pascal Vincent

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

计算机视觉与模式识别 · 计算机科学 2022-10-10 Zhenyuan Lu

Machine Learning algorithms have had a profound impact on the field of computer science over the past few decades. These algorithms performance is greatly influenced by the representations that are derived from the data in the learning…

Computer vision in agriculture is game-changing with its ability to transform farming into a data-driven, precise, and sustainable industry. Deep learning has empowered agriculture vision to analyze vast, complex visual data, but heavily…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Sudhir Sornapudi , Rajhans Singh

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

Representation learning methods are an important tool for addressing the challenges posed by complex observations spaces in sequential decision making problems. Recently, many methods have used a wide variety of types of approaches for…

机器学习 · 计算机科学 2025-06-24 Ayoub Echchahed , Pablo Samuel Castro

Learning robust and effective representations of visual data is a fundamental task in computer vision. Traditionally, this is achieved by training models with labeled data which can be expensive to obtain. Self-supervised learning attempts…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Mehmet Aygün , Prithviraj Dhar , Zhicheng Yan , Oisin Mac Aodha , Rakesh Ranjan

Unsupervised representation learning aims at describing raw data efficiently to solve various downstream tasks. It has been approached with many techniques, such as manifold learning, diffusion maps, or more recently self-supervised…

机器学习 · 计算机科学 2023-06-02 Vivien Cabannes , Alberto Bietti , Randall Balestriero