English
Related papers

Related papers: Toward High Performance, Programmable Extreme-Edge…

200 papers

Inverse-designed nanophotonic devices offer promising solutions for analog optical computation. High-density photonic integration is critical for scaling such architectures toward more complex computational tasks and large-scale…

Optics · Physics 2025-06-09 Joel Sved , Shijie Song , Liwei Li , George Li , Debin Meng , Xiaoke Yi

The growing need for intelligent, adaptive, and energy-efficient autonomous systems across fields such as robotics, mobile agents (e.g., UAVs), and self-driving vehicles is driving interest in neuromorphic computing. By drawing inspiration…

Machine Learning · Computer Science 2025-07-25 Alberto Marchisio , Muhammad Shafique

This technical report presents a novel DMD-based characterization method for vision sensors, particularly neuromorphic sensors such as event-based vision sensors (EVS) and Tianmouc, a complementary vision sensor. Traditional image sensor…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Yapeng Meng , Taoyi Wang , Yihan Lin

Extending Moore's law by augmenting complementary-metal-oxide semiconductor (CMOS) transistors with emerging nanotechnologies (X) has become increasingly important. One important class of problems involve sampling-based Monte Carlo…

The rapid advancement of neural network applications necessitates hardware that not only accelerates computation but also adapts efficiently to dynamic processing requirements. While processing-in-pixel has emerged as a promising solution…

Hardware Architecture · Computer Science 2024-08-21 Zihan Yin , Akhilesh Jaiswal

Spatial convolution is fundamental in constructing deep Convolutional Neural Networks (CNNs) for visual recognition. While dynamic convolution enhances model accuracy by adaptively combining static kernels, it incurs significant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tianyu Zhang , Fan Wan , Haoran Duan , Kevin W. Tong , Jingjing Deng , Yang Long

This paper introduces a novel approach in neuromorphic computing, integrating heterogeneous hardware nodes into a unified, massively parallel architecture. Our system transcends traditional single-node constraints, harnessing the neural…

Hardware Architecture · Computer Science 2024-10-02 Murat Isik , Jonathan Naoukin , I. Can Dikmen

Photonic neuromorphic computing offers compelling advantages in power efficiency and parallel processing, but often falls short in realizing scalable nonlinearity and long-term memory. We overcome these limitations by employing silicon…

The ever-increasing data demand craves advancements in high-speed and energy-efficient computing hardware. Analog optical neural network (ONN) processors have emerged as a promising solution, offering benefits in bandwidth and energy…

Optics · Physics 2026-04-07 Chao Luan , Ronald Davis , Zaijun Chen , Dirk Englund , Ryan Hamerly

There is a growing necessity for edge training to adapt to dynamically changing environment. Neuromorphic computing represents a significant pathway for high-efficiency intelligent computation in energy-constrained edges, but existing…

Artificial visual systems (AVS) have gained tremendous momentum because of its huge potential in areas such as autonomous vehicles and robotics as part of artificial intelligence (AI) in recent years. However, current machine visual systems…

Optics · Physics 2023-07-26 Tian Zhang , Xin Guo , Pan Wang , Linjun Li , Limin Tong

Compute and memory demands of state-of-the-art deep learning methods are still a shortcoming that must be addressed to make them useful at IoT end-nodes. In particular, recent results depict a hopeful prospect for image processing using…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Beatriz Blanco-Filgueira , Daniel García-Lesta , Mauro Fernández-Sanjurjo , Víctor M. Brea , Paula López

Current video-based computer vision (CV) applications typically suffer from high energy consumption due to reading and processing all pixels in a frame, regardless of their significance. While previous works have attempted to reduce this…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Md Abdullah-Al Kaiser , Sreetama Sarkar , Peter A. Beerel , Akhilesh R. Jaiswal , Gourav Datta

The ability to predict motion in real time is fundamental to many maneuvering activities in animals, particularly those critical for survival, such as attack and escape responses. Given its significance, it is no surprise that motion…

Image and Video Processing · Electrical Eng. & Systems 2025-09-16 Subhradip Chakraborty , Shay Snyder , Md Abdullah-Al Kaiser , Maryam Parsa , Gregory Schwartz , Akhilesh R. Jaiswal

Magnetic domain walls are information tokens in both logic and memory devices, and hold particular interest in applications such as neuromorphic accelerators that combine logic in memory. Here, we show that devices based on the electrical…

Disordered Systems and Neural Networks · Physics 2020-01-03 Saima A Siddiqui , Sumit Dutta , Astera Tang , Luqiao Liu , Caroline A Ross , Marc A Baldo

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

A brain--machine interface (BMI) based on motor imagery (MI) enables the control of devices using brain signals while the subject imagines performing a movement. It plays a vital role in prosthesis control and motor rehabilitation. To…

Signal Processing · Electrical Eng. & Systems 2024-09-20 Xiaying Wang , Michael Hersche , Michele Magno , Luca Benini

High-speed machine vision is increasing its importance in both scientific and technological applications. Neuro-inspired photonic computing is a promising approach to speed-up machine vision processing with ultralow latency. However, the…

Deploying mixed-precision neural networks on edge devices is friendly to hardware resources and power consumption. To support fully mixed-precision neural network inference, it is necessary to design flexible hardware accelerators for…

Hardware Architecture · Computer Science 2025-02-04 Liang Zhao , Kunming Shao , Fengshi Tian , Tim Kwang-Ting Cheng , Chi-Ying Tsui , Yi Zou

Photonic integrated circuits provide a compact platform for ultrafast and energy-efficient matrix-vector multiplications (MVMs) in the optical domain. Recently, schemes based on time-division multiplexing (TDM) have been proposed as…