English
Related papers

Related papers: Temporal Contrastive Learning for Spiking Neural N…

200 papers

Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real-world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed…

Machine Learning · Computer Science 2021-05-18 Lu Wang , Xiaofu Chang , Shuang Li , Yunfei Chu , Hui Li , Wei Zhang , Xiaofeng He , Le Song , Jingren Zhou , Hongxia Yang

Contrastive representation learning is crucial in time series analysis as it alleviates the issue of data noise and incompleteness as well as sparsity of supervision signal. However, existing constrastive learning frameworks usually focus…

Machine Learning · Computer Science 2024-06-26 Haozhi Gao , Qianqian Ren , Jinbao Li

Spiking Neural Networks (SNNs) are biologically plausible models that have been identified as potentially apt for deploying energy-efficient intelligence at the edge, particularly for sequential learning tasks. However, training of SNNs…

Neural and Evolutionary Computing · Computer Science 2025-01-09 Marco Paul E. Apolinario , Kaushik Roy

While contrastive self-supervised learning has become the de-facto learning paradigm for graph neural networks, the pursuit of higher task accuracy requires a larger hidden dimensionality to learn informative and discriminative…

Neural and Evolutionary Computing · Computer Science 2024-02-20 Jintang Li , Huizhe Zhang , Ruofan Wu , Zulun Zhu , Baokun Wang , Changhua Meng , Zibin Zheng , Liang Chen

Contrastive learning has shown to be effective to learn representations from time series in a self-supervised way. However, contrasting similar time series instances or values from adjacent timestamps within a time series leads to ignore…

Machine Learning · Computer Science 2026-01-15 Seunghan Lee , Taeyoung Park , Kibok Lee

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Spiking neural networks (SNNs) have attracted considerable attention for their event-driven, low-power characteristics and high biological interpretability. Inspired by knowledge distillation (KD), recent research has improved the…

Machine Learning · Computer Science 2024-06-13 Lin Zuo , Yongqi Ding , Mengmeng Jing , Kunshan Yang , Yunqian Yu

Contrastive learning has been successfully leveraged to learn action representations for addressing the problem of semi-supervised skeleton-based action recognition. However, most contrastive learning-based methods only contrast global…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Binqian Xu , Xiangbo Shu

Contrastive learning has nearly closed the gap between supervised and self-supervised learning of image representations, and has also been explored for videos. However, prior work on contrastive learning for video data has not explored the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ishan Dave , Rohit Gupta , Mamshad Nayeem Rizve , Mubarak Shah

Single-cell RNA sequencing (scRNA-seq) enables researchers to analyze gene expression at single-cell level. One important task in scRNA-seq data analysis is unsupervised clustering, which helps identify distinct cell types, laying down the…

Genomics · Quantitative Biology 2023-12-29 Weikang Jiang , Jinxian Wang , Jihong Guan , Shuigeng Zhou

Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Chengting Yu , Zheming Gu , Da Li , Gaoang Wang , Aili Wang , Erping Li

Spiking neural networks (SNNs) have demonstrated excellent capabilities in various intelligent scenarios. Most existing methods for training SNNs are based on the concept of synaptic plasticity; however, learning in the realistic brain also…

Neural and Evolutionary Computing · Computer Science 2023-04-04 Hongze Sun , Wuque Cai , Baoxin Yang , Yan Cui , Yang Xia , Dezhong Yao , Daqing Guo

The effectiveness of contrastive learning methods has been widely recognized in the field of graph learning, especially in contexts where graph data often lack labels or are difficult to label. However, the application of these methods to…

Machine Learning · Computer Science 2026-01-16 Qiang Yu , Xinran Cheng , Shiqiang Xu , Chuanyi Liu

Spiking Neural Networks (SNNs) are attracting widespread interest due to their biological plausibility, energy efficiency, and powerful spatio-temporal information representation ability. Given the critical role of attention mechanisms in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Rui-Jie Zhu , Malu Zhang , Qihang Zhao , Haoyu Deng , Yule Duan , Liang-Jian Deng

In step with the digitalization of transportation, we are witnessing a growing range of path-based smart-city applications, e.g., travel-time estimation and travel path ranking. A temporal path(TP) that includes temporal information, e.g.,…

Machine Learning · Computer Science 2022-04-18 Sean Bin Yang , Chenjuan Guo , Jilin Hu , Bin Yang , Jian Tang , Christian S. Jensen

Computed tomography (CT) samples with pathological annotations are difficult to obtain. As a result, the computer-aided diagnosis (CAD) algorithms are trained on small datasets (e.g., LIDC-IDRI with 1,018 samples), limiting their accuracies…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Penghua Zhai , Enwei Zhu , Baolian Qi , Xin Wei , Jinpeng Li

Node classification is a key task in temporal graph learning (TGL). Real-life temporal graphs often introduce new node classes over time, but existing TGL methods assume a fixed set of classes. This assumption brings limitations, as…

Machine Learning · Computer Science 2025-03-04 Hanmo Liu , Shimin Di , Haoyang Li , Xun Jian , Yue Wang , Lei Chen

The rapid growth of location-based services (LBS) has yielded massive amounts of data on human mobility. Effectively extracting meaningful representations for user-generated check-in sequences is pivotal for facilitating various downstream…

Machine Learning · Computer Science 2024-07-26 Letian Gong , Huaiyu Wan , Shengnan Guo , Xiucheng Li , Yan Lin , Erwen Zheng , Tianyi Wang , Zeyu Zhou , Youfang Lin

Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the…

Machine Learning · Computer Science 2022-12-06 Kaize Ding , Yancheng Wang , Yingzhen Yang , Huan Liu

Meta-reinforcement learning typically requires orders of magnitude more samples than single task reinforcement learning methods. This is because meta-training needs to deal with more diverse distributions and train extra components such as…

Machine Learning · Computer Science 2021-03-12 Bernie Wang , Simon Xu , Kurt Keutzer , Yang Gao , Bichen Wu