English
Related papers

Related papers: Feedback Alignment Meets Low-Rank Manifolds: A Str…

200 papers

The overfitting is one of the cursing subjects in the deep learning field. To solve this challenge, many approaches were proposed to regularize the learning models. They add some hyper-parameters to the model to extend the generalization;…

Machine Learning · Computer Science 2020-05-06 Mohammad Mahdi Bejani , Mehdi Ghatee

Backpropagation algorithm has been widely used as a mainstream learning procedure for neural networks in the past decade, and has played a significant role in the development of deep learning. However, there exist some limitations…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Gongpei Zhao , Tao Wang , Yidong Li , Yi Jin , Congyan Lang , Haibin Ling

Nowadays deep learning is dominating the field of machine learning with state-of-the-art performance in various application areas. Recently, spiking neural networks (SNNs) have been attracting a great deal of attention, notably owning to…

Machine Learning · Computer Science 2019-02-28 Seongsik Park , Sang-gil Lee , Hyunha Nam , Sungroh Yoon

In this paper, we propose a learning-based framework for non-rigid shape registration without correspondence supervision. Traditional shape registration techniques typically rely on correspondences induced by extrinsic proximity, therefore…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Puhua Jiang , Mingze Sun , Ruqi Huang

We introduce a method for fast estimation of data-adapted, spatio-temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV)-minimization. Our approach is inspired by recent…

Standard deep neural networks (DNNs) are commonly trained in an end-to-end fashion for specific tasks such as object recognition, face identification, or character recognition, among many examples. This specificity often leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Raphaël Achddou , J. Matias di Martino , Guillermo Sapiro

Symbol Level Precoding (SLP) has attracted significant research interest due to its ability to exploit interference for energy-efficient transmission. This paper proposes an unsupervised deep-neural network (DNN) based SLP framework.…

Signal Processing · Electrical Eng. & Systems 2021-11-17 Abdullahi Mohammad , Christos Masouros , Yiannis Andreopoulos

In this paper, we develop a new framework for sensing and recovering structured signals. In contrast to compressive sensing (CS) systems that employ linear measurements, sparse representations, and computationally complex convex/greedy…

Machine Learning · Computer Science 2016-09-01 Ali Mousavi , Ankit B. Patel , Richard G. Baraniuk

Decision-focused learning (DFL) has emerged as a powerful end-to-end alternative to conventional predict-then-optimize (PTO) pipelines by directly optimizing predictive models through downstream decision losses. Existing DFL frameworks are…

Machine Learning · Computer Science 2025-12-01 Xinyu Wang , Jinxiao Du , Yiyang Peng , Wei Ma

Deep neural network (DNN)-based receivers offer a powerful alternative to classical model-based designs for wireless communication, especially in complex and nonlinear propagation environments. However, their adoption is challenged by the…

Signal Processing · Electrical Eng. & Systems 2026-05-26 Yakov Gusakov , Osvaldo Simeone , Tirza Routtenberg , Nir Shlezinger

The subject of deep learning has recently attracted users of machine learning from various disciplines, including: medical diagnosis and bioinformatics, financial market analysis and online advertisement, speech and handwriting recognition,…

Machine Learning · Computer Science 2018-03-12 Charles K. Chui , Shao-Bo Lin , Ding-Xuan Zhou

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem…

Deep Reinforcement Learning (DRL) is emerging as a promising approach to generate adaptive behaviors for robotic platforms. However, a major drawback of using DRL is the data-hungry training regime that requires millions of trial and error…

Deep neural networks have achieved great success both in computer vision and natural language processing tasks. However, mostly state-of-art methods highly rely on external training or computing to improve the performance. To alleviate the…

Machine Learning · Computer Science 2020-09-25 Ming Yan , Xueli Xiao , Joey Tianyi Zhou , Yi Pan

We study low-rank parameterizations of weight matrices with embedded spectral properties in the Deep Learning context. The low-rank property leads to parameter efficiency and permits taking computational shortcuts when computing mappings.…

Machine Learning · Computer Science 2021-07-15 Anton Obukhov , Maxim Rakhuba , Alexander Liniger , Zhiwu Huang , Stamatios Georgoulis , Dengxin Dai , Luc Van Gool

Despite the widespread adoption of Backpropagation algorithm-based Deep Neural Networks, the biological infeasibility of the BP algorithm could potentially limit the evolution of new DNN models. To find a biologically plausible algorithm to…

Neural and Evolutionary Computing · Computer Science 2024-02-29 Jian-Hui Chen , Cheng-Lin Liu , Zuoren Wang

Support vector machine (SVM) based multivariate pattern analysis (MVPA) has delivered promising performance in decoding specific task states based on functional magnetic resonance imaging (fMRI) of the human brain. Conventionally, the…

Backpropagation is widely used to train artificial neural networks, but its relationship to synaptic plasticity in the brain is unknown. Some biological models of backpropagation rely on feedback projections that are symmetric with…

Neurons and Cognition · Quantitative Biology 2023-02-08 Navid Shervani-Tabar , Robert Rosenbaum

The substantial computational demands of modern large-scale deep learning present significant challenges for efficient training and deployment. Recent research has revealed a widespread phenomenon wherein deep networks inherently learn…

Machine Learning · Computer Science 2026-02-04 Laura Balzano , Tianjiao Ding , Benjamin D. Haeffele , Soo Min Kwon , Qing Qu , Peng Wang , Zhangyang Wang , Can Yaras