中文
相关论文

相关论文: CNN-JEPA: Self-Supervised Pretraining Convolutiona…

200 篇论文

The pursuit algorithms integrated in multi-layer convolutional sparse coding (ML-CSC) can interpret the convolutional neural networks (CNNs). However, many current state-of-art (SOTA) pursuit algorithms require multiple iterations to…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Haitong Tang , Shuang He , Lingbin Bian , Zhiming Cui , Nizhuan Wang

The Joint-Embedding Predictive Architecture (JEPA) is often seen as a non-generative alternative to likelihood-based self-supervised learning, emphasizing prediction in representation space rather than reconstruction in observation space.…

机器学习 · 计算机科学 2026-03-23 Moritz Gögl , Christopher Yau

Convolutional neural networks (CNNs) have been the de facto standard in a diverse set of computer vision tasks for many years. Especially, deep neural networks based on seminal architectures such as U-shaped models with skip-connections or…

图像与视频处理 · 电气工程与系统科学 2022-08-02 Reza Azad , Moein Heidari , Moein Shariatnia , Ehsan Khodapanah Aghdam , Sanaz Karimijafarbigloo , Ehsan Adeli , Dorit Merhof

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

计算与语言 · 计算机科学 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

机器学习 · 计算机科学 2019-05-28 Jiaxing Wang , Yin Zheng , Xiaoshuang Chen , Junzhou Huang , Jian Cheng

Self-Supervised learning (SSL) with Joint-Embedding Architectures (JEA) has led to outstanding performances. All instantiations of this paradigm were trained using strong and well-established hand-crafted data augmentations, leading to the…

机器学习 · 计算机科学 2024-12-02 Théo Moutakanni , Maxime Oquab , Marc Szafraniec , Maria Vakalopoulou , Piotr Bojanowski

Learned image compression research has achieved state-of-the-art compression performance with auto-encoder based neural network architectures, where the image is mapped via convolutional neural networks (CNN) into a latent representation…

图像与视频处理 · 电气工程与系统科学 2022-03-23 Fatih Kamisli

Early and accurate detection through Pap smear analysis is critical to improving patient outcomes and reducing mortality of Cervical cancer. State-of-the-art (SOTA) Convolutional Neural Networks (CNNs) require substantial computational…

组织与器官 · 定量生物学 2025-09-23 Saifuddin Sagor , Md Taimur Ahad , Faruk Ahmed , Rokonozzaman Ayon , Sanzida Parvin

Self-supervised learning (SSL) has become a popular method for generating invariant representations without the need for human annotations. Nonetheless, the desired invariant representation is achieved by utilising prior online…

机器学习 · 计算机科学 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

Semi-supervised learning has emerged as a powerful paradigm for leveraging large amounts of unlabeled data to improve the performance of machine learning models when labeled data are scarce. Among existing approaches, methods derived from…

机器学习 · 计算机科学 2026-04-29 Ali Aghababaei-Harandi , Aude Sportisse , Massih-Reza Amini

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Annoor Sharara Akhand

Electroencephalogram-based motor imagery (MI) classification is an important paradigm of non-invasive brain-computer interfaces. Common spatial pattern (CSP), which exploits different energy distributions on the scalp while performing…

信号处理 · 电气工程与系统科学 2024-11-20 Xue Jiang , Lubin Meng , Xinru Chen , Yifan Xu , Dongrui Wu

Convolutional neural networks (CNN) have led to many state-of-the-art results spanning through various fields. However, a clear and profound theoretical understanding of the forward pass, the core algorithm of CNN, is still lacking. In…

机器学习 · 统计学 2017-02-02 Vardan Papyan , Yaniv Romano , Michael Elad

Many common methods for learning a world model for pixel-based environments use generative architectures trained with pixel-level reconstruction objectives. Recently proposed Joint Embedding Predictive Architectures (JEPA) offer a…

机器学习 · 计算机科学 2022-11-22 Vlad Sobal , Jyothir S , Siddhartha Jalagam , Nicolas Carion , Kyunghyun Cho , Yann LeCun

We propose a deep learning method for single image super-resolution (SR). Our method directly learns an end-to-end mapping between the low/high-resolution images. The mapping is represented as a deep convolutional neural network (CNN) that…

计算机视觉与模式识别 · 计算机科学 2015-08-03 Chao Dong , Chen Change Loy , Kaiming He , Xiaoou Tang

Hyperspectral images (HSI) not only have a broad macroscopic field of view but also contain rich spectral information, and the types of surface objects can be identified through spectral information, which is one of the main applications in…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Sen Jia , Yifan Wang

Self-supervised learning (SSL) has made enormous progress and largely narrowed the gap with the supervised ones, where the representation learning is mainly guided by a projection into an embedding space. During the projection, current…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Lang Huang , Shan You , Mingkai Zheng , Fei Wang , Chen Qian , Toshihiko Yamasaki

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

The popularity of Convolutional Neural Network (CNN) in the field of Image Processing and Computer Vision has motivated researchers and industrialist experts across the globe to solve different challenges with high accuracy. The simplest…

计算机视觉与模式识别 · 计算机科学 2019-07-29 Bulla Rajesh , Mohammed Javed , Ratnesh , Shubham Srivastava

Self-Supervised Learning (SSL) is a valuable and robust training methodology for contemporary Deep Neural Networks (DNNs), enabling unsupervised pretraining on a 'pretext task' that does not require ground-truth labels/annotation. This…