English
Related papers

Related papers: Novel Saliency Analysis for the Forward Forward Al…

200 papers

Most fair machine learning methods either highly rely on the sensitive information of the training samples or require a large modification on the target models, which hinders their practical application. To address this issue, we propose a…

Machine Learning · Computer Science 2023-12-27 Haonan Wang , Ziwei Wu , Jingrui He

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

Machine Learning · Computer Science 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira

The Backpropagation algorithm has often been criticised for its lack of biological realism. In an attempt to find a more biologically plausible alternative, the recently introduced Forward-Forward algorithm replaces the forward and backward…

Neural and Evolutionary Computing · Computer Science 2025-04-01 Niccolò Tosato , Lorenzo Basile , Emanuele Ballarin , Giuseppe de Alteriis , Alberto Cazzaniga , Alessio Ansuini

Training neural networks has traditionally relied on backpropagation (BP), a gradient-based algorithm that, despite its widespread success, suffers from key limitations in both biological and hardware perspectives. These include backward…

Machine Learning · Computer Science 2025-06-16 Nazmus Saadat As-Saquib , A N M Nafiz Abeer , Hung-Ta Chien , Byung-Jun Yoon , Suhas Kumar , Su-in Yi

Adversarial attacks pose a significant challenge to deploying deep learning models in safety-critical applications. Maintaining model robustness while ensuring interpretability is vital for fostering trust and comprehension in these models.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Amira Guesmi , Nishant Suresh Aswani , Muhammad Shafique

While backpropagation (BP) is the mainstream approach for gradient computation in neural network training, its heavy reliance on the chain rule of differentiation constrains the designing flexibility of network architecture and training…

Machine Learning · Computer Science 2023-10-16 Jinyang Jiang , Zeliang Zhang , Chenliang Xu , Zhaofei Yu , Yijie Peng

Learning to solve complex sequences of tasks--while both leveraging transfer and avoiding catastrophic forgetting--remains a key obstacle to achieving human-level intelligence. The progressive networks approach represents a step forward in…

Saliency prediction can benefit from training that involves scene understanding that may be tangential to the central task; this may include understanding places, spatial layout, objects or involve different datasets and their bias. One can…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Sen Jia , Neil D. B. Bruce

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

Backpropagation algorithm has been widely used as a mainstream learning procedure for neural networks in the past decade, and has played a significant role in the development of deep learning. However, there exist some limitations…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Gongpei Zhao , Tao Wang , Yidong Li , Yi Jin , Congyan Lang , Haibin Ling

Predicting attention is a popular topic at the intersection of human and computer vision. However, even though most of the available video saliency data sets and models claim to target human observers' fixations, they fail to differentiate…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Mikhail Startsev , Michael Dorr

Supervised learning in deep neural networks is commonly performed using error backpropagation. However, the sequential propagation of errors during the backward pass limits its scalability and applicability to low-powered neuromorphic…

Machine Learning · Computer Science 2023-08-22 Florian Bacho , Dominique Chu

Deep Neural Networks are powerful tools to understand complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. While online saliency-guided training methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ali Karkehabadi

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

Learning computational models for visual attention (saliency estimation) is an effort to inch machines/robots closer to human visual cognitive abilities. Data-driven efforts have dominated the landscape since the introduction of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Navyasri Reddy , Samyak Jain , Pradeep Yarlagadda , Vineet Gandhi

Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision. In this CVPR 2015 paper, we discover that a high-quality visual saliency model can be trained with multiscale features…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Guanbin Li , Yizhou Yu

A key problem in salient object detection is how to effectively model the semantic properties of salient objects in a data-driven manner. In this paper, we propose a multi-task deep saliency model based on a fully convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Xi Li , Liming Zhao , Lina Wei , Ming-Hsuan Yang , Fei Wu , Yueting Zhuang , Haibin Ling , Jingdong Wang

The success of deep neural networks has inspired many to wonder whether other learners could benefit from deep, layered architectures. We present a general framework called forward thinking for deep learning that generalizes the…

Machine Learning · Statistics 2017-05-23 Kevin Miller , Chris Hettinger , Jeffrey Humpherys , Tyler Jarvis , David Kartchner

Deep learning techniques have proven highly effective in image classification, but their deployment in resourceconstrained environments remains challenging due to high computational demands. Furthermore, their interpretability is of high…

Machine Learning · Computer Science 2024-12-06 Alireza Maleki , Mahsa Lavaei , Mohsen Bagheritabar , Salar Beigzad , Zahra Abadi

This article studies (multilayer perceptron) neural networks with an emphasis on the transformations involved --- both forward and backward --- in order to develop a semantical/logical perspective that is in line with standard program…

Neural and Evolutionary Computing · Computer Science 2018-03-28 Bart Jacobs , David Sprunger