English
Related papers

Related papers: Time-step Mixup for Efficient Spiking Knowledge Tr…

200 papers

Modern artificial intelligence systems depend heavily on large datasets for both training and transferring knowledge between models. Knowledge distillation, transfer learning, and dataset distillation have made such transfers more…

Machine Learning · Computer Science 2025-11-25 Pratham Sorte

Spiking neural networks (SNNs) are the third generation of neural networks that are biologically inspired to process data in a fashion that emulates the exchange of signals in the brain. Within the Computer Vision community SNNs have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 William Bjorndahl , Jack Easton , Austin Modoff , Eric C. Larson , Joseph Camp , Prasanna Rangarajan

The combination of Spiking Neural Networks (SNNs) with Vision Transformer architectures has garnered significant attention due to their potential for energy-efficient and high-performance computing paradigms. However, a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Wei Hua , Chenlin Zhou , Jibin Wu , Yansong Chua , Yangyang Shu

Feature discrimination is a crucial aspect of neural network design, as it directly impacts the network's ability to distinguish between classes and generalize across diverse datasets. The accomplishment of achieving high-quality feature…

Neural and Evolutionary Computing · Computer Science 2025-02-18 Katerina Maria Oikonomou , Ioannis Kansizoglou , Antonios Gasteratos

Spiking neural networks (SNNs) offer advantages in computational efficiency via event-driven computing, compared to traditional artificial neural networks (ANNs). While direct training methods tackle the challenge of non-differentiable…

Neural and Evolutionary Computing · Computer Science 2025-08-21 Hangming Zhang , Zheng Li , Qiang Yu

Graph Transformers (GTs), which integrate message passing and self-attention mechanisms simultaneously, have achieved promising empirical results in graph prediction tasks. However, the design of scalable and topology-aware node…

Neural and Evolutionary Computing · Computer Science 2025-12-12 Huizhe Zhang , Jintang Li , Yuchang Zhu , Huazhen Zhong , Liang Chen

Spiking Neural Networks (SNNs) have recently emerged as an alternative to deep learning owing to sparse, asynchronous and binary event (or spike) driven processing, that can yield huge energy efficiency benefits on neuromorphic hardware.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Youngeun Kim , Priyadarshini Panda

Semantic segmentation benchmarks in the realm of autonomous driving are dominated by large pre-trained transformers, yet their widespread adoption is impeded by substantial computational costs and prolonged training durations. To lift this…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Ruiping Liu , Kailun Yang , Alina Roitberg , Jiaming Zhang , Kunyu Peng , Huayao Liu , Yaonan Wang , Rainer Stiefelhagen

Event cameras sense per-pixel intensity changes and produce asynchronous event streams with high dynamic range and less motion blur, showing advantages over conventional cameras. A hurdle of training event-based models is the lack of large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Lin Wang , Yujeong Chae , Sung-Hoon Yoon , Tae-Kyun Kim , Kuk-Jin Yoon

Event-based cameras have recently shown great potential for high-speed motion estimation owing to their ability to capture temporally rich information asynchronously. Spiking Neural Networks (SNNs), with their neuro-inspired event-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Adarsh Kumar Kosta , Kaushik Roy

Event-based vision sensors provide significant advantages for high-speed perception, including microsecond temporal resolution, high dynamic range, and low power consumption. When combined with Spiking Neural Networks (SNNs), they can be…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Maxime Vaillant , Axel Carlier , Lai Xing Ng , Christophe Hurter , Benoit R. Cottereau

Spiking Neural Networks (SNN) and the field of Neuromorphic Engineering has brought about a paradigm shift in how to approach Machine Learning (ML) and Computer Vision (CV) problem. This paradigm shift comes from the adaption of event-based…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Paul Kirkland , Davide L. Manna , Alex Vicente-Sola , Gaetano Di Caterina

Knowledge transfer using convolutional neural networks (CNNs) can help efficiently train a CNN with fewer parameters or maximize the generalization performance under limited supervision. To enable a more efficient transfer of pretrained…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Seungbum Hong , Jihun Yoon , Junmo Kim , Min-Kook Choi

The computer vision community is witnessing an unprecedented rate of new tasks being proposed and addressed, thanks to the deep convolutional networks' capability to find complex mappings from X to Y. The advent of each task often…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Junnan Li , Ziwei Xu , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Event cameras offer significant advantages over traditional frame-based sensors, including higher temporal resolution, lower latency and dynamic range. However, efficiently converting event streams into formats compatible with standard…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Gabriele Magrini , Federico Becattini , Luca Cultrera , Lorenzo Berlincioni , Pietro Pala , Alberto Del Bimbo

In the surveillance and defense domain, multi-target detection and classification (MTD) is considered essential yet challenging due to heterogeneous inputs from diverse data sources and the computational complexity of algorithms designed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ngoc Tuyen Do , Tri Nhu Do

Despite its success in image synthesis, we observe that diffusion probabilistic models (DPMs) often lack contextual reasoning ability to learn the relations among object parts in an image, leading to a slow learning process. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Shanghua Gao , Pan Zhou , Ming-Ming Cheng , Shuicheng Yan

This paper investigates cross-lingual temporal knowledge graph reasoning problem, which aims to facilitate reasoning on Temporal Knowledge Graphs (TKGs) in low-resource languages by transfering knowledge from TKGs in high-resource ones. The…

Machine Learning · Computer Science 2023-03-28 Ruijie Wang , Zheng Li , Jingfeng Yang , Tianyu Cao , Chao Zhang , Bing Yin , Tarek Abdelzaher

Knowledge distillation (KD) transfers knowledge from large teacher models to compact student models, enabling efficient deployment on resource constrained devices. While diverse KD methods, including response based, feature based, and…

Machine Learning · Computer Science 2026-01-23 Yinxi Tian , Changwu Huang , Ke Tang , Xin Yao

Simulated data-assisted SAR target recognition methods are the research hotspot currently, devoted to solving the problem of limited samples. Existing works revolve around simulated images, but the large amount of irrelevant information…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Chenxi Zhao , Daochang Wang , Siqian Zhang , Gangyao Kuang