English
Related papers

Related papers: FPGA Implementation of Multi-Layer Machine Learnin…

200 papers

We propose a multi-level method to increase the accuracy of machine learning algorithms for approximating observables in scientific computing, particularly those that arise in systems modeled by differential equations. The algorithm relies…

Numerical Analysis · Mathematics 2020-07-06 Kjetil O. Lye , Siddhartha Mishra , Roberto Molinaro

We present a global algorithm for training multilayer neural networks in this Letter. The algorithm is focused on controlling the local fields of neurons induced by the input of samples by random adaptations of the synaptic weights. Unlike…

Biological Physics · Physics 2007-05-23 Hong Zhao , Tao Jin

Recent work has shown that 8-bit floating point (FP8) can be used for efficiently training neural networks with reduced computational cost compared to training in FP32/FP16. In this work, we investigate the use of FP8 training in a…

Machine Learning · Computer Science 2025-07-31 Bokun Wang , Axel Berg , Durmus Alp Emre Acar , Chuteng Zhou

A class of mixed-order \emph{PDE}-constraint regularizer for image processing problem is proposed, generalizing the standard first order total variation $(TV)$. A semi-supervised (bilevel) training scheme, which provides a simultaneous…

Analysis of PDEs · Mathematics 2019-03-19 Pan Liu

Embedded system performances are bounded by power consumption. The trend is to offload greedy computations on hardware accelerators as GPU, Xeon Phi or FPGA. FPGA chips combine both flexibility of programmable chips and energy-efficiency of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Christophe Alias

This work proposes a novel adaptive background compensation scheme for frequency interleaved digital-to-analog converters (FI-DACs). The technique is applicable to high speed digital transceivers such as those used in coherent optical…

Signal Processing · Electrical Eng. & Systems 2020-07-07 Agustín C. Galetto , Benjamín T. Reyes , Damián A. Morero , Mario R. Hueda

Indoor localization is of particular interest due to its immense practical applications. However, the rich multipath and high penetration loss of indoor wireless signal propagation make this task arduous. Though recently studied…

Signal Processing · Electrical Eng. & Systems 2019-08-07 Guojun Xiong , Taejoon Kim , Erik Perrins

A new generation of manycore processors is on the rise that offers dozens and more cores on a chip and, in a sense, fuses host processor and accelerator. In this paper we target the efficient training of generalized linear models on these…

Performance · Computer Science 2021-10-29 Eliza Wszola , Celestine Mendler-Dünner , Martin Jaggi , Markus Püschel

Federated Learning (FL) coordinates with numerous heterogeneous devices to collaboratively train a shared model while preserving user privacy. Despite its multiple advantages, FL faces new challenges. One challenge arises when devices drop…

Machine Learning · Computer Science 2021-06-09 Xinran Gu , Kaixuan Huang , Jingzhao Zhang , Longbo Huang

Morphological neural networks, or layers, can be a powerful tool to boost the progress in mathematical morphology, either on theoretical aspects such as the representation of complete lattice operators, or in the development of image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Samy Blusseau

We propose an adaptive scheme for distributed learning of nonlinear functions by a network of nodes. The proposed algorithm consists of a local adaptation stage utilizing multiple kernels with projections onto hyperslabs and a diffusion…

Signal Processing · Electrical Eng. & Systems 2018-09-05 Ban-Sok Shin , Masahiro Yukawa , Renato Luis Garrido Cavalcante , Armin Dekorsy

With the prosperity of mobile devices, the distributed learning approach enabling model training with decentralized data has attracted wide research. However, the lack of training capability for edge devices significantly limits the energy…

Machine Learning · Computer Science 2021-05-14 Ziyang Hong , C. Patrick Yue

In this paper, we introduce a convolutional architecture to perform learning when information is supported on multigraphs. Exploiting algebraic signal processing (ASP), we propose a convolutional signal processing model on multigraphs…

Signal Processing · Electrical Eng. & Systems 2022-10-31 Landon Butler , Alejandro Parada-Mayorga , Alejandro Ribeiro

To enable large model (LM) based edge intelligent service provisioning, on-device fine-tuning with locally personalized data allows for continuous and privacy-preserving LM customization. In this paper, we propose RingAda, a collaborative…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-28 Liang Li , Xiaopei Chen , Wen Wu

We propose a distributed system based on lowpower embedded FPGAs designed for edge computing applications focused on exploring distributing scheduling optimizations for Deep Learning (DL) workloads to obtain the best performance regarding…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-31 Hans Johnson , Tianyang Fang , Alejandro Perez-Vicente , Jafar Saniie

In this letter, we propose a learning based channel estimation scheme for orthogonal frequency division multiplexing (OFDM) systems in the presence of phase noise in doubly-selective fading channels. Two-dimensional (2D) convolutional…

Information Theory · Computer Science 2022-03-24 Sandesh Rao Mattu , A. Chockalingam

Field-programmable gate arrays (FPGAs) are widely used to implement deep learning inference. Standard deep neural network inference involves the computation of interleaved linear maps and nonlinear activation functions. Prior work for…

Machine Learning · Computer Science 2024-02-12 Marta Andronic , George A. Constantinides

Deep Neural Networks (DNNs) have achieved extraordinary performance in various application domains. To support diverse DNN models, efficient implementations of DNN inference on edge-computing platforms, e.g., ASICs, FPGAs, and embedded…

Machine Learning · Computer Science 2020-12-15 Sung-En Chang , Yanyu Li , Mengshu Sun , Runbin Shi , Hayden K. -H. So , Xuehai Qian , Yanzhi Wang , Xue Lin

A morphological perceptron is a multilayer feedforward neural network in which neurons perform elementary operations from mathematical morphology. For multiclass classification tasks, a morphological perceptron with a competitive layer…

Machine Learning · Computer Science 2025-09-09 Iara Cunha , Marcos Eduardo Valle

Implicit Neural Representation (INR) as a mighty representation paradigm has achieved success in various computer vision tasks recently. Due to the low-frequency bias issue of vanilla multi-layer perceptron (MLP), existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Kexuan Shi , Xingyu Zhou , Shuhang Gu