English
Related papers

Related papers: Flexible Phase Dynamics for Bio-Plausible Contrast…

200 papers

Texture classification is a pivotal task in computer vision, presenting unique challenges due to high inter-class similarity and the sensitivity of structural patterns to scale and illumination changes. While Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Joao B Florindo

Neuromorphic computing is a brainlike information processing paradigm that requires adaptive learning mechanisms. A spiking neuro-evolutionary system is used for this purpose; plastic resistive memories are implemented as synapses in…

Neural and Evolutionary Computing · Computer Science 2015-05-19 Gerard David Howard , Larry Bull , Ben de Lacy Costello , Andrew Adamatzky , Ella Gale

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Continual Learning (CL) refers to a learning setup where data is non stationary and the model has to learn without forgetting existing knowledge. The study of CL for sequential patterns revolves around trained recurrent networks. In this…

Machine Learning · Computer Science 2021-08-18 Andrea Cossu , Davide Bacciu , Antonio Carta , Claudio Gallicchio , Vincenzo Lomonaco

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Graph Contrastive Learning (GCL) establishes a new paradigm for learning graph representations without human annotations. Although remarkable progress has been witnessed recently, the success behind GCL is still left somewhat mysterious. In…

Machine Learning · Computer Science 2021-10-27 Yanqiao Zhu , Yichen Xu , Qiang Liu , Shu Wu

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

Machine Learning · Computer Science 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

The ability to sequentially learn multiple tasks without forgetting is a key skill of biological brains, whereas it represents a major challenge to the field of deep learning. To avoid catastrophic forgetting, various continual learning…

Neural and Evolutionary Computing · Computer Science 2022-12-09 Francesco Lässig , Pau Vilimelis Aceituno , Martino Sorbaro , Benjamin F. Grewe

Continual learning (CL) is a branch of machine learning that aims to enable agents to adapt and generalise previously learned abilities so that these can be reapplied to new tasks or environments. This is particularly useful in multi-task…

Machine Learning · Computer Science 2025-11-20 Kim N. Nolle , Ivana Dusparic , Rhodri Cusack , Vinny Cahill

There has been a growing interest in developing data-driven and in particular deep neural network (DNN) based methods for modern communication tasks. For a few popular tasks such as power control, beamforming, and MIMO detection, these…

Signal Processing · Electrical Eng. & Systems 2021-05-27 Haoran Sun , Wenqiang Pu , Minghe Zhu , Xiao Fu , Tsung-Hui Chang , Mingyi Hong

We consider a neural network with adapting synapses whose dynamics can be analitically computed. The model is made of $N$ neurons and each of them is connected to $K$ input neurons chosen at random in the network. The synapses are…

Disordered Systems and Neural Networks · Physics 2009-10-30 G. Lattanzi , G. Nardulli , G. Pasquariello , S. Stramaglia

This paper explores useful modifications of the recent development in contrastive learning via novel probabilistic modeling. We derive a particular form of contrastive loss named Joint Contrastive Learning (JCL). JCL implicitly involves the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Qi Cai , Yu Wang , Yingwei Pan , Ting Yao , Tao Mei

In this study, we explore an emerging research area of Continual Learning for Temporal Sensitive Question Answering (CLTSQA). Previous research has primarily focused on Temporal Sensitive Question Answering (TSQA), often overlooking the…

Computation and Language · Computer Science 2024-07-18 Wanqi Yang , Yunqiu Xu , Yanda Li , Kunze Wang , Binbin Huang , Ling Chen

Recently, the use of bio-inspired learning techniques such as Hebbian learning and its closely-related Spike-Timing-Dependent Plasticity (STDP) variant have drawn significant attention for the design of compute-efficient AI systems that can…

Neural and Evolutionary Computing · Computer Science 2024-11-19 Ali Safa

The ability to evolve is fundamental for any valuable autonomous agent whose knowledge cannot remain limited to that injected by the manufacturer. Consider for example a home assistant robot: it should be able to incrementally learn new…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Francesco Cappio Borlino , Silvia Bucci , Tatiana Tommasi

Neuromorphic computing seeks to replicate the remarkable efficiency, flexibility, and adaptability of the human brain in artificial systems. Unlike conventional digital approaches, which suffer from the Von Neumann bottleneck and depend on…

Artificial Intelligence · Computer Science 2025-11-04 Marcel van Gerven

Node classification is a key task in temporal graph learning (TGL). Real-life temporal graphs often introduce new node classes over time, but existing TGL methods assume a fixed set of classes. This assumption brings limitations, as…

Machine Learning · Computer Science 2025-03-04 Hanmo Liu , Shimin Di , Haoyang Li , Xun Jian , Yue Wang , Lei Chen

The primary objective of methods in continual learning is to learn tasks in a sequential manner over time (sometimes from a stream of data), while mitigating the detrimental phenomenon of catastrophic forgetting. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Nisha L. Raichur , Lucas Heublein , Tobias Feigl , Alexander Rügamer , Christopher Mutschler , Felix Ott