English
Related papers

Related papers: Applying the Residue Number System to Network Infe…

200 papers

We give two new expressions of subresultants, nested subresultant and reduced nested subresultant, for the recursive polynomial remainder sequence (PRS) which has been introduced by the author. The reduced nested subresultant reduces the…

Commutative Algebra · Mathematics 2010-07-13 Akira Terui

In several domains, data objects can be decomposed into sets of simpler objects. It is then natural to represent each object as the set of its components or parts. Many conventional machine learning algorithms are unable to process this…

Machine Learning · Computer Science 2020-03-03 Konstantinos Skianis , Giannis Nikolentzos , Stratis Limnios , Michalis Vazirgiannis

Recurrent Neural Networks (RNN) are widely used to solve a variety of problems and as the quantity of data and the amount of available compute have increased, so have model sizes. The number of parameters in recent state-of-the-art networks…

Machine Learning · Computer Science 2017-11-08 Sharan Narang , Erich Elsen , Gregory Diamos , Shubho Sengupta

Reconfigurable intelligent surfaces (RIS) have recently been proposed as an effective means for spatial interference suppression in large reflector antenna systems. Existing RIS weight optimization algorithms typically rely on accurate…

Signal Processing · Electrical Eng. & Systems 2025-12-25 Xinrui Li , R. Michael Buehrer

Deep residual networks have recently shown appealing performance on many challenging computer vision tasks. However, the original residual structure still has some defects making it difficult to converge on very deep networks. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Falong Shen , Gang Zeng

Resonance counting is an intuitive and widely used tool in Random Matrix Theory and Anderson Localization. Its undoubted advantage is its simplicity: in principle, it is easily applicable to any random matrix ensemble. On the downside, the…

Disordered Systems and Neural Networks · Physics 2025-03-12 Anton Kutlin , Carlo Vanoni

Distributed adaptive signal processing has attracted much attention in the recent decade owing to its effectiveness in many decentralized real-time applications in networked systems. Because many natural signals are highly sparse with most…

Optimization and Control · Mathematics 2017-11-22 Xuanyu Cao , K. J. Ray Liu

This paper introduces a tensor neural network (TNN) to address nonparametric regression problems, leveraging its distinct sub-network structure to effectively facilitate variable separation and enhance the approximation of complex,…

Machine Learning · Statistics 2024-09-16 Yongxin Li , Yifan Wang , Zhongshuo Lin , Hehu Xie

We present in this paper a model for forecasting short-term power loads based on deep residual networks. The proposed model is able to integrate domain knowledge and researchers' understanding of the task by virtue of different neural…

Machine Learning · Statistics 2018-05-31 Kunjin Chen , Kunlong Chen , Qin Wang , Ziyu He , Jun Hu , Jinliang He

In this paper we consider utilizing a residual neural network (ResNet) to solve ordinary differential equations. Stochastic gradient descent method is applied to obtain the optimal parameter set of weights and biases of the network. We…

Numerical Analysis · Mathematics 2021-01-12 Changxin Qiu , Aaron Bendickson , Joshua Kalyanapu , Jue Yan

Deep Convolutional Neural Networks (CNNs) i.e. Residual Networks (ResNets) have been used successfully for many computer vision tasks, but are difficult to scale to 3D volumetric medical data. Memory is increasingly often the bottleneck…

Image and Video Processing · Electrical Eng. & Systems 2021-03-17 Kashu Yamazaki , Vidhiwar Singh Rathour , T. Hoang Ngan Le

Recommender Systems (RS) currently represent a fundamental tool in online services, especially with the advent of Online Social Networks (OSN). In this case, users generate huge amounts of contents and they can be quickly overloaded by…

Information Retrieval · Computer Science 2023-07-06 Mattia Giovanni Campana , Franca Delmastro

This article introduces a neural network-based signal processing framework for intelligent reflecting surface (IRS) aided wireless communications systems. By modeling radio-frequency (RF) impairments inside the "meta-atoms" of IRS…

Signal Processing · Electrical Eng. & Systems 2021-02-09 Zhou Zhou , Kangjun Bai , Nima Mohammadi , Yang Yi , Lingjia Liu

Deep Residual Networks have reached the state of the art in many image processing tasks such image classification. However, the cost for a gain in accuracy in terms of depth and memory is prohibitive as it requires a higher number of…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Alexandre Boulch

We propose a novel deep network structure called "Network In Network" (NIN) to enhance model discriminability for local patches within the receptive field. The conventional convolutional layer uses linear filters followed by a nonlinear…

Neural and Evolutionary Computing · Computer Science 2014-03-05 Min Lin , Qiang Chen , Shuicheng Yan

Logarithmic number systems (LNS) are used to represent real numbers in many applications using a constant base raised to a fixed-point exponent making its distribution exponential. This greatly simplifies hardware multiply, divide and…

Numerical Analysis · Mathematics 2022-01-26 Syed Asad Alam , James Garland , David Gregg

Implicit Neural Representations (INRs) are powerful to parameterize continuous signals in computer vision. However, almost all INRs methods are limited to low-level tasks, e.g., image/video compression, super-resolution, and image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yiran Song , Qianyu Zhou , Lizhuang Ma

Although RNNs have been shown to be powerful tools for processing sequential data, finding architectures or optimization strategies that allow them to model very long term dependencies is still an active area of research. In this work, we…

Neural and Evolutionary Computing · Computer Science 2017-03-16 Mikael Henaff , Arthur Szlam , Yann LeCun

Radio Frequency Neural Networks (RFNNs) have demonstrated advantages in realizing intelligent applications across various domains. However, as the model size of deep neural networks rapidly increases, implementing large-scale RFNN in…

Signal Processing · Electrical Eng. & Systems 2023-12-19 Yang Sui , Minning Zhu , Lingyi Huang , Chung-Tse Michael Wu , Bo Yuan

Residual units are wildly used for alleviating optimization difficulties when building deep neural networks. However, the performance gain does not well compensate the model size increase, indicating low parameter efficiency in these…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Chen Yunpeng , Jin Xiaojie , Kang Bingyi , Feng Jiashi , Yan Shuicheng