English
Related papers

Related papers: NeuroAI Temporal Neural Networks (NeuTNNs): Microa…

200 papers

Temporal Neural Networks (TNNs), a special class of spiking neural networks, draw inspiration from the neocortex in utilizing spike-timings for information processing. Recent works proposed a microarchitecture framework and custom macro…

Hardware Architecture · Computer Science 2024-12-25 Prabhu Vellaisamy , Harideep Nair , Vamsikrishna Ratnakaram , Dhruv Gupta , John Paul Shen

Temporal Neural Networks (TNNs) are spiking neural networks that exhibit brain-like sensory processing with high energy efficiency. This work presents the ongoing research towards developing a custom design framework for designing efficient…

Emerging Technologies · Computer Science 2022-05-31 Prabhu Vellaisamy , John Paul Shen

Temporal Neural Networks (TNNs), inspired from the mammalian neocortex, exhibit energy-efficient online sensory processing capabilities. Recent works have proposed a microarchitecture framework for implementing TNNs and demonstrated…

Hardware Architecture · Computer Science 2022-05-27 Harideep Nair , Prabhu Vellaisamy , Santha Bhasuthkar , John Paul Shen

Temporal Neural Networks (TNNs) are spiking neural networks that use time as a resource to represent and process information, similar to the mammalian neocortex. In contrast to compute-intensive deep neural networks that employ separate…

Hardware Architecture · Computer Science 2021-11-09 Harideep Nair , John Paul Shen , James E. Smith

A long-standing proposition is that by emulating the operation of the brain's neocortex, a spiking neural network (SNN) can achieve similar desirable features: flexible learning, speed, and efficiency. Temporal neural networks (TNNs) are…

Neural and Evolutionary Computing · Computer Science 2021-02-24 James E. Smith

The computation and storage requirements for Deep Neural Networks (DNNs) are usually high. This issue limits their deployability on ubiquitous computing devices such as smart phones, wearables and autonomous drones. In this paper, we…

Machine Learning · Computer Science 2017-02-28 Hande Alemdar , Vincent Leroy , Adrien Prost-Boucle , Frédéric Pétrot

Deep neural networks (DNNs) are currently widely used for many artificial intelligence (AI) applications including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Vivienne Sze , Yu-Hsin Chen , Tien-Ju Yang , Joel Emer

The rapid growth of artificial intelligence (AI) has brought novel data processing and generative capabilities but also escalating energy requirements. This challenge motivates renewed interest in neuromorphic computing principles, which…

Neural and Evolutionary Computing · Computer Science 2026-01-13 Osvaldo Simeone

Conditional computation for Deep Neural Networks (DNNs) reduce overall computational load and improve model accuracy by running a subset of the network. In this work, we present a runtime throttleable neural network (TNN) that can…

Machine Learning · Computer Science 2020-11-06 Hengyue Liu , Samyak Parajuli , Jesse Hostetler , Sek Chai , Bir Bhanu

Temporal Neural Networks (TNNs) use time as a resource to represent and process information, mimicking the behavior of the mammalian neocortex. This work focuses on implementing TNNs using off-the-shelf digital CMOS technology. A…

Hardware Architecture · Computer Science 2020-09-02 Harideep Nair , John Paul Shen , James E. Smith

Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from…

Hardware Architecture · Computer Science 2023-12-05 Souvik Kundu , Rui-Jie Zhu , Akhilesh Jaiswal , Peter A. Beerel

Neuroscience and Artificial Intelligence (AI) have made significant progress in the past few years but have only been loosely inter-connected. Based on a workshop held in August 2025, we identify current and future areas of synergism…

Artificial Intelligence · Computer Science 2026-01-29 Jean-Marc Fellous , Gert Cauwenberghs , Cornelia Fermüller , Yulia Sandamisrkaya , Terrence Sejnowski

Neural Networks (NNs) are steering a new generation of artificial intelligence (AI) applications at the micro-edge. Examples include wireless sensors, wearables and cybernetic systems that collect data and process them to support real-world…

Signal Processing · Electrical Eng. & Systems 2021-03-17 Sergey Mileiko , Thanasin Bunnam , Fei Xia , Rishad Shafik , Alex Yakovlev , Shidhartha Das

Tensor networks (TNs) and neural networks (NNs) are two fundamental data modeling approaches. TNs were introduced to solve the curse of dimensionality in large-scale tensors by converting an exponential number of dimensions to polynomial…

Machine Learning · Computer Science 2025-03-18 Maolin Wang , Yu Pan , Zenglin Xu , Guangxi Li , Xiangli Yang , Danilo Mandic , Andrzej Cichocki

Edge AI applications increasingly require ultra-low-power, low-latency inference. Neuromorphic computing based on event-driven spiking neural networks (SNNs) offers an attractive path, but practical deployment on resource-constrained…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz , Duygu Erisken , Rana Irem Turhan

This paper introduces a tensor neural network (TNN) to address nonparametric regression problems, leveraging its distinct sub-network structure to effectively facilitate variable separation and enhance the approximation of complex,…

Machine Learning · Statistics 2024-09-16 Yongxin Li , Yifan Wang , Zhongshuo Lin , Hehu Xie

Machine learning has emerged as the dominant tool for implementing complex cognitive tasks that require supervised, unsupervised, and reinforcement learning. While the resulting machines have demonstrated in some cases even super-human…

Emerging Technologies · Computer Science 2019-08-06 Bipin Rajendran , Abu Sebastian , Michael Schmuker , Narayan Srinivasa , Evangelos Eleftheriou

Using unitary (instead of general) matrices in artificial neural networks (ANNs) is a promising way to solve the gradient explosion/vanishing problem, as well as to enable ANNs to learn long-term correlations in the data. This approach…

Machine Learning · Computer Science 2017-04-04 Li Jing , Yichen Shen , Tena Dubček , John Peurifoy , Scott Skirlo , Yann LeCun , Max Tegmark , Marin Soljačić

Throughout history, the development of artificial intelligence, particularly artificial neural networks, has been open to and constantly inspired by the increasingly deepened understanding of the brain, such as the inspiration of…

Neural and Evolutionary Computing · Computer Science 2023-03-14 Feng-Lei Fan , Yingxin Li , Hanchuan Peng , Tieyong Zeng , Fei Wang

Recurrent Neural Networks (RNNs) are a class of machine learning algorithms used for applications with time-series and sequential data. Recently, there has been a strong interest in executing RNNs on embedded devices. However, difficulties…

Neural and Evolutionary Computing · Computer Science 2020-03-23 Nesma M. Rezk , Madhura Purnaprajna , Tomas Nordström , Zain Ul-Abdin
‹ Prev 1 2 3 10 Next ›