English
Related papers

Related papers: SoftNeuro: Fast Deep Inference using Multi-platfor…

200 papers

Distributed systems can be found in various applications, e.g., in robotics or autonomous driving, to achieve higher flexibility and robustness. Thereby, data flow centric applications such as Deep Neural Network (DNN) inference benefit…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-14 Fabian Kreß , El Mahdi El Annabi , Tim Hotfilter , Julian Hoefer , Tanja Harbaum , Juergen Becker

Deep learning technologies, particularly deep neural networks (DNNs), have demonstrated significant success across many domains. This success has been accompanied by substantial advancements and innovations in the algorithms behind the…

Machine Learning · Computer Science 2025-04-14 Timothy L. Cronin , Sanmukh Kuppannagari

Deep neural networks are widely used in personalized recommendation systems. Unlike regular DNN inference workloads, recommendation inference is memory-bound due to the many random memory accesses needed to lookup the embedding tables. The…

Deep neural networks are powerful tools for solving nonlinear problems in science and engineering, but training highly accurate models becomes challenging as problem complexity increases. Non-convex optimization and sensitivity to…

Machine Learning · Computer Science 2026-04-20 Ethan Mulle , Wei Kang , Qi Gong

Fully Connected Neural Networks (FCNNs) have been the core of most state-of-the-art Machine Learning (ML) applications in recent years and also have been widely used for Intrusion Detection Systems (IDSs). Experimental results from the last…

Machine Learning · Computer Science 2020-10-16 Fares Meghdouri , Maximilian Bachl , Tanja Zseby

In this work we present a new framework for neural networks compression with fine-tuning, which we called Neural Network Compression Framework (NNCF). It leverages recent advances of various network compression methods and implements some…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Alexander Kozlov , Ivan Lazarevich , Vasily Shamporov , Nikolay Lyalyushkin , Yury Gorbachev

Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at…

Neural and Evolutionary Computing · Computer Science 2017-09-07 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

Software frameworks for neural networks play a key role in the development and application of deep learning methods. In this paper, we introduce the Chainer framework, which intends to provide a flexible, intuitive, and high performance…

We present a novel framework for applying deep neural networks (DNN) to soft decoding of linear codes at arbitrary block lengths. Unlike other approaches, our framework allows unconstrained DNN design, enabling the free application of…

Information Theory · Computer Science 2018-02-27 Amir Bennatan , Yoni Choukroun , Pavel Kisilev

Deploying neural networks to different devices or platforms is in general challenging, especially when the model size is large or model complexity is high. Although there exist ways for model pruning or distillation, it is typically…

Machine Learning · Computer Science 2023-12-07 Kai Li , Yi Luo

Artificial intelligence techniques are considered an effective means to accelerate flow field simulations. However, current deep learning methods struggle to achieve generalization to flow field resolutions while ensuring computational…

Fluid Dynamics · Physics 2024-05-15 Kuijun Zuo , Zhengyin Ye , Linyang Zhu , Xianxu Yuan , Weiwei Zhang

Deep learning has delivered its powerfulness in many application domains, especially in image and speech recognition. As the backbone of deep learning, deep neural networks (DNNs) consist of multiple layers of various types with hundreds to…

Machine Learning · Computer Science 2017-12-14 Sheng Lin , Ning Liu , Mahdi Nazemi , Hongjia Li , Caiwen Ding , Yanzhi Wang , Massoud Pedram

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

Machine Learning · Computer Science 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

Edge computing has been emerging as a popular scenario for model inference. However, the inference performance on edge devices (e.g., Multi-Core DSP, FGPA, etc.) suffers from inefficiency due to the lack of highly optimized inference…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-02 Zhang Runhua , Jiang Hongxu , Tian Fangzheng , Geng Jinkun , Li Xiaobin , Ma Yuhang , Zhu Chenhui , Dong Dong , Li Xin , Wang Haojie

While machine learning is traditionally a resource intensive task, embedded systems, autonomous navigation, and the vision of the Internet of Things fuel the interest in resource-efficient approaches. These approaches aim for a carefully…

Reducing inference time and energy usage while maintaining prediction accuracy has become a significant concern for deep neural networks (DNN) inference on resource-constrained edge devices. To address this problem, we propose a novel…

Machine Learning · Computer Science 2024-03-13 Hasanul Mahmud , Peng Kang , Kevin Desai , Palden Lama , Sushil Prasad

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

The inference of Neural Networks is usually restricted by the resources (e.g., computing power, memory, bandwidth) on edge devices. In addition to improving the hardware design and deploying efficient models, it is possible to aggregate the…

Machine Learning · Computer Science 2021-11-05 Jun-Liang Lin , Sheng-De Wang

While machine learning is traditionally a resource intensive task, embedded systems, autonomous navigation and the vision of the Internet-of-Things fuel the interest in resource efficient approaches. These approaches require a carefully…

LightNet is a lightweight, versatile and purely Matlab-based deep learning framework. The idea underlying its design is to provide an easy-to-understand, easy-to-use and efficient computational platform for deep learning research. The…

Machine Learning · Computer Science 2016-08-03 Chengxi Ye , Chen Zhao , Yezhou Yang , Cornelia Fermuller , Yiannis Aloimonos