English
Related papers

Related papers: ReDON: Recurrent Diffractive Optical Neural Proces…

200 papers

Recurrent neural networks (RNNs) are a widely used tool for modeling sequential data, yet they are often treated as inscrutable black boxes. Given a trained recurrent network, we would like to reverse engineer it--to obtain a quantitative,…

Machine Learning · Computer Science 2019-12-06 Niru Maheswaranathan , Alex Williams , Matthew D. Golub , Surya Ganguli , David Sussillo

There exist many problem domains where the interpretability of neural network models is essential for deployment. Here we introduce a recurrent architecture composed of input-switched affine transformations - in other words an RNN without…

Artificial Intelligence · Computer Science 2017-06-14 Jakob N. Foerster , Justin Gilmer , Jan Chorowski , Jascha Sohl-Dickstein , David Sussillo

Understanding, predicting, and generating object motions and transformations is a core problem in artificial intelligence. Modeling sequences of evolving images may provide better representations and models of motion and may ultimately be…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Arnab Ghosh , Viveka Kulharia , Amitabha Mukerjee , Vinay Namboodiri , Mohit Bansal

Recent years have seen a considerable surge of research on developing heuristic approaches to realize analog computing using physical waves. Among these, neuromorphic computing using light waves is envisioned to feature performance metrics…

Optics · Physics 2022-10-18 Cheng-Chia Tsai , Xiaoyan Huang , Zhicheng Wu , Zongfu Yu , Nanfang Yu

Rendering dynamic reverberation in a complicated acoustic space for moving sources and listeners is challenging but crucial for enhancing user immersion in extended-reality (XR) applications. Capturing spatially varying room impulse…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-10 Orchisama Das , Gloria Dal Santo , Sebastian J. Schlecht , Vesa Valimaki , Zoran Cvetkovic

The proliferation of large-scale and structurally complex data has spurred the integration of machine learning methods into statistical modeling. Recurrent neural networks (RNNs), a foundational class of models for time-dependent data, can…

Machine Learning · Statistics 2026-05-05 Yuxi Cai , Lan Li , Feiqing Huang , Guodong Li

Free-space wavefront manipulation devices have emerged as powerful platforms for advanced optical information systems. In response to the challenges posed by the exponential growth of optical information, optical multiplexing and dynamic…

A wide range of practically important problems is nowadays efficiently solved using artificial neural networks. This gave momentum to intensive development of their optical implementations, among which, the so-called diffractive neural…

Hybrid refractive-diffractive lenses combine the light efficiency of refractive lenses with the information encoding power of diffractive optical elements (DOE), showing great potential as the next generation of imaging systems. However,…

Graphics · Computer Science 2025-05-01 Xinge Yang , Matheus Souza , Kunyi Wang , Praneeth Chakravarthula , Qiang Fu , Wolfgang Heidrich

This work focuses on developing methods for approximating the solution operators of a class of parametric partial differential equations via neural operators. Neural operators have several challenges, including the issue of generating…

Numerical Analysis · Mathematics 2023-11-17 Prashant K. Jha

We present a novel end-to-end visual odometry architecture with guided feature selection based on deep convolutional recurrent neural networks. Different from current monocular visual odometry methods, our approach is established on the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Fei Xue , Qiuyuan Wang , Xin Wang , Wei Dong , Junqiu Wang , Hongbin Zha

A multitude of imaging and vision tasks have seen recently a major transformation by deep learning methods and in particular by the application of convolutional neural networks. These methods achieve impressive results, even for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Simon Arridge , Andreas Hauptmann

We present a novel recurrent neural network (RNN) based model that combines the remembering ability of unitary RNNs with the ability of gated RNNs to effectively forget redundant/irrelevant information in its memory. We achieve this by…

Machine Learning · Computer Science 2017-10-26 Li Jing , Caglar Gulcehre , John Peurifoy , Yichen Shen , Max Tegmark , Marin Soljačić , Yoshua Bengio

Tracking the nonlinear behavior of an RF power amplifier (PA) is challenging. To tackle this problem, we build a connection between residual learning and the PA nonlinearity, and propose a novel residual neural network structure, referred…

Signal Processing · Electrical Eng. & Systems 2020-10-20 Yibo Wu , Ulf Gustavsson , Alexandre Graell i Amat , Henk Wymeersch

Existing methods for concealed visual perception (CVP) often leverage reversible strategies to decrease uncertainty, yet these are typically confined to the mask domain, leaving the potential of the RGB domain underexplored. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chunming He , Fengyang Xiao , Rihan Zhang , Chengyu Fang , Deng-Ping Fan , Sina Farsiu

Modern power systems with high penetration of inverter-based resources exhibit complex dynamic behaviors that challenge the scalability and generalizability of traditional stability assessment methods. This paper presents a dynamic…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Guang An Ooi , Otavio Bertozzi , Mohd Asim Aftab , Charalambos Konstantinou , Shehab Ahmed

An accelerator is a specialized integrated circuit designed to perform specific computations faster than if those were performed by CPU or GPU. A Field-Programmable DNN learning and inference accelerator (FProg-DNN) using hybrid systolic…

Machine Learning · Computer Science 2018-03-26 Luiz M Franca-Neto

This review aims to conduct a comparative analysis of liquid neural networks (LNNs) and traditional recurrent neural networks (RNNs) and their variants, such as long short-term memory networks (LSTMs) and gated recurrent units (GRUs). The…

Machine Learning · Computer Science 2025-10-10 Shilong Zong , Alex Bierly , Almuatazbellah Boker , Hoda Eldardiry

Computational models of vision have traditionally been developed in a bottom-up fashion, by hierarchically composing a series of straightforward operations - i.e. convolution and pooling - with the aim of emulating simple and complex cells…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Simone Azeglio , Simone Poetto , Luca Savant Aira , Marco Nurisso

Systems biology is an emerging interdisciplinary area of research that focuses on study of complex interactions in a biological system, such as gene regulatory networks. The discovery of gene regulatory networks leads to a wide range of…

Neural and Evolutionary Computing · Computer Science 2016-10-13 Khalid Raza , Mansaf Alam