English
Related papers

Related papers: Deep Convolutional Transform Learning -- Extended …

200 papers

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Convolutional Neural Network (CNN) is one of the most important architectures in deep learning. The fundamental building block of a CNN is a trainable filter, represented as a discrete grid, used to perform convolution on discrete input…

Machine Learning · Computer Science 2023-05-26 Dario Coscia , Laura Meneghetti , Nicola Demo , Giovanni Stabile , Gianluigi Rozza

We propose a novel semantic segmentation algorithm by learning a deconvolution network. We learn the network on top of the convolutional layers adopted from VGG 16-layer net. The deconvolution network is composed of deconvolution and…

Computer Vision and Pattern Recognition · Computer Science 2015-05-19 Hyeonwoo Noh , Seunghoon Hong , Bohyung Han

Conventionally, autoencoders are unsupervised representation learning tools. In this work, we propose a novel discriminative autoencoder. Use of supervised discriminative learning ensures that the learned representation is robust to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Anupriya Gogna , Angshul Majumdar

Transfer Learning (TL) plays a crucial role when a given dataset has insufficient labeled examples to train an accurate model. In such scenarios, the knowledge accumulated within a model pre-trained on a source dataset can be transferred to…

Computation and Language · Computer Science 2018-01-22 Tushar Semwal , Gaurav Mathur , Promod Yenigalla , Shivashankar B. Nair

Transfer learning is widely used for training deep neural networks (DNN) for building a powerful representation. Even after the pre-trained model is adapted for the target task, the representation performance of the feature extractor is…

Machine Learning · Computer Science 2023-08-22 Seunghee Koh , Hyounguk Shon , Janghyeon Lee , Hyeong Gwon Hong , Junmo Kim

Disentangled representations have recently been shown to improve fairness, data efficiency and generalisation in simple supervised and reinforcement learning tasks. To extend the benefits of disentangled representations to more complex…

Deep learning (DL) applied to a device's radio-frequency fingerprint~(RFF) has attracted significant attention in physical-layer authentication due to its extraordinary classification performance. Conventional DL-RFF techniques are trained…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Renjie Xie , Wei Xu , Jiabao Yu , Aiqun Hu , Derrick Wing Kwan Ng , A. Lee Swindlehurst

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

In the field of continual learning, models are designed to learn tasks one after the other. While most research has centered on supervised continual learning, there is a growing interest in unsupervised continual learning, which makes use…

Machine Learning · Computer Science 2024-07-18 Daniel Marczak , Sebastian Cygert , Tomasz Trzciński , Bartłomiej Twardowski

We propose a novel formulation of deep networks that do not use dot-product neurons and rely on a hierarchy of voting tables instead, denoted as Convolutional Tables (CT), to enable accelerated CPU-based inference. Convolutional layers are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Shay Dekel , Yosi Keller , Aharon Bar-Hillel

In this paper, we propose a novel multi-task learning method based on the deep convolutional network. The proposed deep network has four convolutional layers, three max-pooling layers, and two parallel fully connected layers. To adjust the…

Machine Learning · Computer Science 2019-04-17 Fang Su , Hai-Yang Shang , Jing-Yan Wang

Recent developed deep unsupervised methods allow us to jointly learn representation and cluster unlabelled data. These deep clustering methods mainly focus on the correlation among samples, e.g., selecting high precision pairs to gradually…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Jianlong Wu , Keyu Long , Fei Wang , Chen Qian , Cheng Li , Zhouchen Lin , Hongbin Zha

Modulation recognition is an important task in radio signal processing. Most of the current researches focus on supervised learning. However, in many real scenarios, it is difficult and cost to obtain the labels of signals. In this letter,…

Signal Processing · Electrical Eng. & Systems 2021-07-27 Qi Xuan , Xiaohui Li , Zhuangzhi Chen , Dongwei Xu , Shilian Zheng , Xiaoniu Yang

Clustering is an essential problem in machine learning and data mining. One vital factor that impacts clustering performance is how to learn or design the data representation (or features). Fortunately, recent advances in deep learning can…

Machine Learning · Computer Science 2015-01-14 Gang Chen

Pre-trained representation is one of the key elements in the success of modern deep learning. However, existing works on continual learning methods have mostly focused on learning models incrementally from scratch. In this paper, we explore…

Machine Learning · Computer Science 2022-08-18 Hyounguk Shon , Janghyeon Lee , Seung Hwan Kim , Junmo Kim

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

Machine Learning · Computer Science 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

Although considerable effort has been dedicated to improving the solution to the hyperspectral unmixing problem, non-idealities such as complex radiation scattering and endmember variability negatively impact the performance of most…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Ricardo Augusto Borsoi , Deniz Erdoğmuş , Tales Imbiriba

Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods…

Machine Learning · Computer Science 2017-11-15 Grégoire Montavon , Sebastian Bach , Alexander Binder , Wojciech Samek , Klaus-Robert Müller