English
Related papers

Related papers: Temporal Contrastive Learning for Spiking Neural N…

200 papers

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

Information Retrieval · Computer Science 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

Traditional Graph Neural Network (GNN), as a graph representation learning method, is constrained by label information. However, Graph Contrastive Learning (GCL) methods, which tackle the label problem effectively, mainly focus on the…

Machine Learning · Computer Science 2023-08-08 Kai Yang , Yuan Liu , Zijuan Zhao , Peijin Ding , Wenqian Zhao

Graph Contrastive Learning (GCL) excels at managing noise and fluctuations in input data, making it popular in various fields (e.g., social networks, and knowledge graphs). Our study finds that the difference in high-frequency information…

Machine Learning · Computer Science 2024-10-15 Yuntao Shou , Xiangyong Cao , Deyu Meng

Spiking Neural Networks (SNNs) have gained significant attention due to their biological plausibility and energy efficiency, making them promising alternatives to Artificial Neural Networks (ANNs). However, the performance gap between SNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Tianqing Zhang , Kairong Yu , Xian Zhong , Hongwei Wang , Qi Xu , Qiang Zhang

Autonomous robotic systems require advanced control frameworks to achieve complex temporal objectives that extend beyond conventional stability and trajectory tracking. Signal Temporal Logic (STL) provides a formal framework for specifying…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Kazunobu Serizawa , Kazumune Hashimoto , Wataru Hashimoto , Masako Kishida , Shigemasa Takai

Inductive representation learning on temporal heterogeneous graphs is crucial for scalable deep learning on heterogeneous information networks (HINs) which are time-varying, such as citation networks. However, most existing approaches are…

Machine Learning · Computer Science 2024-05-15 Chenglin Li , Yuanzhen Xie , Chenyun Yu , Lei Cheng , Bo Hu , Zang Li , Di Niu

Contrastive learning, especially self-supervised contrastive learning (SSCL), has achieved great success in extracting powerful features from unlabeled data. In this work, we contribute to the theoretical understanding of SSCL and uncover…

Machine Learning · Computer Science 2023-06-05 Tianyang Hu , Zhili Liu , Fengwei Zhou , Wenjia Wang , Weiran Huang

Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. However, when…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Gaoang Wang , Yibing Zhan , Xinchao Wang , Mingli Song , Klara Nahrstedt

Long-tailed recognition with imbalanced class distribution naturally emerges in practical machine learning applications. Existing methods such as data reweighing, resampling, and supervised contrastive learning enforce the class balance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chengkai Hou , Jieyu Zhang , Haonan Wang , Tianyi Zhou

Detectingandsegmentingobjectswithinwholeslideimagesis essential in computational pathology workflow. Self-supervised learning (SSL) is appealing to such annotation-heavy tasks. Despite the extensive benchmarks in natural images for dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Jiawei Yang , Hanbo Chen , Yuan Liang , Junzhou Huang , Lei He , Jianhua Yao

Spiking Neural Networks (SNNs) are considered naturally suited for temporal processing, with membrane potential propagation widely regarded as the core temporal modeling mechanism. However, existing research lack analysis of its actual…

Neural and Evolutionary Computing · Computer Science 2025-12-08 Yiting Dong , Zhaofei Yu , Jianhao Ding , Zijie Xu , Tiejun Huang

Semi-supervised temporal action segmentation (SS-TA) aims to perform frame-wise classification in long untrimmed videos, where only a fraction of videos in the training set have labels. Recent studies have shown the potential of contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Feixiang Zhou , Zheheng Jiang , Huiyu Zhou , Xuelong Li

Temporal models based on recurrent neural networks have proven to be quite powerful in a wide variety of applications. However, training these models often relies on back-propagation through time, which entails unfolding the network over…

Neural and Evolutionary Computing · Computer Science 2019-08-13 Alexander Ororbia , Ankur Mali , C. Lee Giles , Daniel Kifer

The intrinsic dynamics and event-driven nature of spiking neural networks (SNNs) make them excel in processing temporal information by naturally utilizing embedded time sequences as time steps. Recent studies adopting this approach have…

Machine Learning · Computer Science 2024-12-18 Jiaqi Wang , Liutao Yu , Liwei Huang , Chenlin Zhou , Han Zhang , Zhenxi Song , Min Zhang , Zhengyu Ma , Zhiguo Zhang

Graph contrastive learning (GCL), as a popular approach to graph self-supervised learning, has recently achieved a non-negligible effect. To achieve superior performance, the majority of existing GCL methods elaborate on graph data…

Machine Learning · Computer Science 2022-05-03 Yuansheng Wang , Wangbin Sun , Kun Xu , Zulun Zhu , Liang Chen , Zibin Zheng

In recent years, spiking neural networks (SNNs) have attracted substantial interest due to their potential to replicate the energy-efficient and event-driven processing of biological neurons. Despite this, the application of SNNs in graph…

Artificial Intelligence · Computer Science 2024-07-31 Mingkun Xu , Huifeng Yin , Yujie Wu , Guoqi Li , Faqiang Liu , Jing Pei , Shuai Zhong , Lei Deng

Many learning algorithms used as normative models in neuroscience or as candidate approaches for learning on neuromorphic chips learn by contrasting one set of network states with another. These Contrastive Learning (CL) algorithms are…

Machine Learning · Computer Science 2023-09-01 Ezekiel Williams , Colin Bredenberg , Guillaume Lajoie

Encoding static images into spike trains is a fundamental step for enabling Spiking Neural Networks (SNNs) to process visual information. However, widely used methods such as rate coding, Poisson encoding, and time-to-first-spike (TTFS)…

Neural and Evolutionary Computing · Computer Science 2026-04-23 Minchi Hu

Rehearsal-based Continual Learning (CL) has been intensely investigated in Deep Neural Networks (DNNs). However, its application in Spiking Neural Networks (SNNs) has not been explored in depth. In this paper we introduce the first…

Neural and Evolutionary Computing · Computer Science 2024-12-23 Alberto Dequino , Alessio Carpegna , Davide Nadalini , Alessandro Savino , Luca Benini , Stefano Di Carlo , Francesco Conti

Graph contrastive learning (GCL) has recently emerged as a new concept which allows for capitalizing on the strengths of graph neural networks (GNNs) to learn rich representations in a wide variety of applications which involve abundant…

Machine Learning · Computer Science 2024-06-26 Yuzhou Chen , Jose Frias , Yulia R. Gel