English
Related papers

Related papers: Positional Embedding-Aware Activations

200 papers

We introduce an interpretable deep learning approach for direction of arrival (DOA) estimation with a single snapshot. Classical subspace-based methods like MUSIC and ESPRIT use spatial smoothing on uniform linear arrays for single snapshot…

Signal Processing · Electrical Eng. & Systems 2023-12-01 Ruxin Zheng , Shunqiao Sun , Hongshan Liu , Honglei Chen , Jian Li

Implicit Neural Representations (INRs) aim to parameterize discrete signals through implicit continuous functions. However, formulating each image with a separate neural network~(typically, a Multi-Layer Perceptron (MLP)) leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Taiqiang Wu , Zhengwu Liu , Yuxin Cheng , Chen Zhang , Ngai Wong

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Recent advancements have focused on directly training high-performance SNNs by estimating the…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Jiaqiang Jiang , Lei Wang , Runhao Jiang , Jing Fan , Rui Yan

We propose a self-supervised machine learning (SSML) framework for multi-fidelity learning and extended predictive soil spectroscopy based on latent space embeddings. A self-supervised representation was pretrained with the large MIR…

Existing deep calibrated photometric stereo networks basically aggregate observations under different lights based on the pre-defined operations such as linear projection and max pooling. While they are effective with the dense capture,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Satoshi Ikehata

Transformer architecture has enabled recent progress in speech enhancement. Since Transformers are position-agostic, positional encoding is the de facto standard component used to enable Transformers to distinguish the order of elements in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-15 Qiquan Zhang , Meng Ge , Hongxu Zhu , Eliathamby Ambikairajah , Qi Song , Zhaoheng Ni , Haizhou Li

Autonomous embedded systems (e.g., robots) typically necessitate intelligent computation with low power/energy processing for completing their tasks. Such requirements can be fulfilled by embodied neuromorphic intelligence with spiking…

Neural and Evolutionary Computing · Computer Science 2025-01-22 Iqra Bano , Rachmad Vidya Wicaksana Putra , Alberto Marchisio , Muhammad Shafique

Deep Linear and Nonlinear learning methods have already been vital machine learning methods for investigating the hierarchical features such as functional connectivity in the human brain via functional Magnetic Resonance signals; however,…

Machine Learning · Computer Science 2022-09-14 Wei Zhang , Yu Bao

The sensor network localization, SNL, problem in embedding dimension r, consists of locating the positions of wireless sensors, given only the distances between sensors that are within radio range and the positions of a subset of the…

Optimization and Control · Mathematics 2010-02-02 Nathan Krislock , Henry Wolkowicz

Surface electromyography (sEMG) has demonstrated significant potential in simultaneous and proportional control (SPC). However, existing algorithms for predicting joint angles based onsEMGoften suffer fromhigh inference costs or are limited…

Human-Computer Interaction · Computer Science 2025-01-27 Xin Zhou , Chuang Lin , Can Wang , Xiaojiang Peng

The adoption of advanced deep learning (DL) architecture in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted…

Sound · Computer Science 2022-04-05 Shakeel Ahmad Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

In this study, a deep-learning-based multi-stage network architecture called Multi-Stage Depth Prediction Network (MSDPN) is proposed to predict a dense depth map using a 2D LiDAR and a monocular camera. Our proposed network consists of a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Hyungtae Lim , Hyeonjae Gil , Hyun Myung

This study adapts the highly-versatile siamese neural network model to the event data domain. We introduce a supervised training framework for optimizing Earth Mover's Distance (EMD) between spike trains with spiking neural networks (SNN).…

Neural and Evolutionary Computing · Computer Science 2022-05-30 Mateusz Pabian , Dominik Rzepka , Mirosław Pawlak

The alignment of serial-section electron microscopy (ssEM) images is critical for efforts in neuroscience that seek to reconstruct neuronal circuits. However, each ssEM plane contains densely packed structures that vary from one section to…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Inwan Yoo , David G. C. Hildebrand , Willie F. Tobin , Wei-Chung Allen Lee , Won-Ki Jeong

In this work, we extend standard neural networks by building upon an assumption that neuronal activations correspond to the angle of a complex number lying on the unit circle, or 'phasor.' Each layer in such a network produces new…

Neural and Evolutionary Computing · Computer Science 2021-09-29 Wilkie Olin-Ammentorp , Maxim Bazhenov

Spiking neural networks are motivated from principles of neural systems and may possess unexplored advantages in the context of machine learning. A class of \textit{convolutional spiking neural networks} is introduced, trained to detect…

Neural and Evolutionary Computing · Computer Science 2018-08-27 Daniel J. Saunders , Hava T. Siegelmann , Robert Kozma , Miklós Ruszinkó

The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Pooyan Safari , Miquel India , Javier Hernando

Speaker identification typically involves three stages. First, a front-end speaker embedding model is trained to embed utterance and speaker profiles. Second, a scoring function is applied between a runtime utterance and each speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Zhenning Tan , Yuguang Yang , Eunjung Han , Andreas Stolcke

Spiking neural networks have shown much promise as an energy-efficient alternative to artificial neural networks. However, understanding the impacts of sensor noises and input encodings on the network activity and performance remains…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Sami Barchid , José Mennesson , Jason Eshraghian , Chaabane Djéraba , Mohammed Bennamoun

Spiking neural networks (SNNs) offer a promising alternative to current artificial neural networks to enable low-power event-driven neuromorphic hardware. Spike-based neuromorphic applications require processing and extracting meaningful…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Deboleena Roy , Priyadarshini Panda , Kaushik Roy