English
Related papers

Related papers: Acceleration Method for Learning Fine-Layered Opti…

200 papers

Optical neural networks offer a route to low-latency and energy-efficient inference by encoding computation in light propagation. However, most existing implementations rely on planar photonic circuits or discretely spaced diffractive…

We demonstrate the utility of machine learning algorithms for the design of Oscillatory Neural Networks (ONNs). After constructing a circuit model of the oscillators in a machine-learning-enabled simulator and performing Backpropagation…

Disordered Systems and Neural Networks · Physics 2023-09-07 Tamas Rudner , Wolfgang Porod , Gyorgy Csaba

The ever-growing deep learning technologies are making revolutionary changes for modern life. However, conventional computing architectures are designed to process sequential and digital programs, being extremely burdened with performing…

Emerging Technologies · Computer Science 2022-12-21 Yuyao Huang , Tingzhao Fu , Honghao Huang , Sigang Yang , Hongwei Chen

Spectral methods employing non-standard polynomial bases, such as M\"untz polynomials, have proven effective for accurately solving problems with solutions exhibiting low regularity, notably including sub-diffusion equations. However, due…

Numerical Analysis · Mathematics 2025-05-22 Wei Zeng , Chuanju Xu , Yiming Lu , Qian Wang

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

This paper aims to accelerate the test-time computation of deep convolutional neural networks (CNNs). Unlike existing methods that are designed for approximating linear filters or linear responses, our method takes the nonlinear units into…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Xiangyu Zhang , Jianhua Zou , Xiang Ming , Kaiming He , Jian Sun

Artificial Neural Networks (ANNs) became popular due to their successful application difficult problems such image and speech recognition. However, when practitioners want to design an ANN they need to undergo laborious process of selecting…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Pedro Carvalho , Nuno Lourenço , Penousal Machado

Artificial Neural Networks (ANN) have been popularized in many science and technological areas due to their capacity to solve many complex pattern matching problems. That is the case of Virtual Screening, a research area that studies how to…

Neural and Evolutionary Computing · Computer Science 2020-06-05 Christian F. Frasser , Carola de Benito , Vincent Canals , Miquel Roca , Pedro J. Ballester , Josep L. Rossello

Mass Spectrometry Imaging (MSI), using traditional rectilinear scanning, takes hours to days for high spatial resolution acquisitions. Given that most pixels within a sample's field of view are often neither relevant to underlying…

Image and Video Processing · Electrical Eng. & Systems 2022-10-25 David Helminiak , Hang Hu , Julia Laskin , Dong Hye Ye

Unlearning the data observed during the training of a machine learning (ML) model is an important task that can play a pivotal role in fortifying the privacy and security of ML-based applications. This paper raises the following questions:…

Machine Learning · Computer Science 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

Automotive Cyber-Physical Systems (ACPS) have attracted a significant amount of interest in the past few decades, while one of the most critical operations in these systems is the perception of the environment. Deep learning and,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Stavros Nousias , Erion-Vasilis Pikoulis , Christos Mavrokefalidis , Aris S. Lalos

Deep learning is revolutionizing many areas of science and technology, especially image, text and speech recognition. In this paper, we demonstrate how a deep neural network (NN) trained on quantum mechanical (QM) DFT calculations can learn…

Chemical Physics · Physics 2017-02-10 Justin S. Smith , Olexandr Isayev , Adrian E. Roitberg

Attention-based learning for fine-grained image recognition remains a challenging task, where most of the existing methods treat each object part in isolation, while neglecting the correlations among them. In addition, the multi-stage or…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Ming Sun , Yuchen Yuan , Feng Zhou , Errui Ding

The on-chip implementation of learning algorithms would speed-up the training of neural networks in crossbar arrays. The circuit level design and implementation of backpropagation algorithm using gradient descent operation for neural…

Emerging Technologies · Computer Science 2018-09-03 Olga Krestinskaya , Khaled Nabil Salama , Alex Pappachen James

Diffractive deep neural network (DNNet) is a novel machine learning framework on the modulation of optical transmission. Diffractive network would get predictions at the speed of light. It's pure passive architecture, no additional power…

Machine Learning · Computer Science 2019-12-24 Yingshi Chen , Jinfeng Zhu

In this paper, we propose a multi-layer artificial neural network (ANN) that is trained with the Levenberg-Marquardt algorithm for use in signal detection over multiple-input multiple-output orthogonal frequency-division multiplexing…

Signal Processing · Electrical Eng. & Systems 2020-02-03 Shabnam Rezaei , Sofiene Affes

Deep neural networks (DNNs) have the advantage that they can take into account a large number of parameters, which enables them to solve complex tasks. In computer vision and speech recognition, they have a better accuracy than common…

Machine Learning · Computer Science 2021-04-20 Lukas Baischer , Matthias Wess , Nima TaheriNejad

Recent success in deep neural networks has generated strong interest in hardware accelerators to improve speed and energy consumption. This paper presents a new type of photonic accelerator based on coherent detection that is scalable to…

Emerging Technologies · Computer Science 2019-05-21 Ryan Hamerly , Liane Bernstein , Alexander Sludds , Marin Soljačić , Dirk Englund

Orthogonality is widely used for training deep neural networks (DNNs) due to its ability to maintain all singular values of the Jacobian close to 1 and reduce redundancy in representation. This paper proposes a computationally efficient and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Lei Huang , Li Liu , Fan Zhu , Diwen Wan , Zehuan Yuan , Bo Li , Ling Shao

The accurate diagnosis of Alzheimer's disease (AD) and prognosis of mild cognitive impairment (MCI) conversion are crucial for early intervention. However, existing multimodal methods face several challenges, from the heterogeneity of input…

Machine Learning · Computer Science 2025-03-20 Chenyu Liu , Luca Rossi