English
Related papers

Related papers: Embedded Distributed Inference of Deep Neural Netw…

200 papers

Deep neural networks have seen enormous success in various real-world applications. Beyond their predictions as point estimates, increasing attention has been focused on quantifying the uncertainty of their predictions. In this review, we…

Machine Learning · Computer Science 2023-02-06 Chengyu Dong

Network embedding is an effective technique to learn the low-dimensional representations of nodes in networks. Real-world networks are usually with multiplex or having multi-view representations from different relations. Recently, there has…

Machine Learning · Computer Science 2022-03-08 Qifan Wang , Yi Fang , Anirudh Ravula , Ruining He , Bin Shen , Jingang Wang , Xiaojun Quan , Dongfang Liu

Many applications from camera arrays to sensor networks require efficient compression and processing of correlated data, which in general is collected in a distributed fashion. While information-theoretic foundations of distributed…

Information Theory · Computer Science 2024-02-14 Ezgi Ozyilkan , Elza Erkip

Machine learning (ML), especially deep learning is made possible by the availability of big data, enormous compute power and, often overlooked, development tools or frameworks. As the algorithms become mature and efficient, more and more ML…

Machine Learning · Computer Science 2018-06-21 Liangzhen Lai , Naveen Suda

We propose doubly nested network(DNNet) where all neurons represent their own sub-models that solve the same task. Every sub-model is nested both layer-wise and channel-wise. While nesting sub-models layer-wise is straight-forward with…

Machine Learning · Computer Science 2018-06-21 Jaehong Kim , Sungeun Hong , Yongseok Choi , Jiwon Kim

Over the past years, embedding learning on networks has shown tremendous results in link prediction tasks for complex systems, with a wide range of real-life applications. Learning a representation for each node in a knowledge graph allows…

Machine Learning · Computer Science 2026-02-03 Orell Trautmann , Olaf Wolkenhauer , Clémence Réda

Recently, the deep neural network (derived from the artificial neural network) has attracted many researchers' attention by its outstanding performance. However, since this network requires high-performance GPUs and large storage, it is…

Neural and Evolutionary Computing · Computer Science 2016-02-25 Song Wang , Dongchun Ren , Li Chen , Wei Fan , Jun Sun , Satoshi Naoi

Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Haiyang Lin , Mingyu Yan , Xiaochun Ye , Dongrui Fan , Shirui Pan , Wenguang Chen , Yuan Xie

Networks are ubiquitous structure that describes complex relationships between different entities in the real world. As a critical component of prediction task over nodes in networks, learning the feature representation of nodes has become…

Machine Learning · Computer Science 2018-09-10 Hansheng Xue , Jiajie Peng , Xuequn Shang

Edge inference has become more widespread, as its diverse applications range from retail to wearable technology. Clusters of networked resource-constrained edge devices are becoming common, yet no system exists to split a DNN across these…

Networking and Internet Architecture · Computer Science 2023-04-25 Arjun Parthasarathy , Bhaskar Krishnamachari

The increase in network attacks has necessitated the development of robust and efficient intrusion detection systems (IDS) capable of identifying malicious activities in real-time. In the last five years, deep learning algorithms have…

Cryptography and Security · Computer Science 2024-02-28 Richard Kimanzi , Peter Kimanga , Dedan Cherori , Patrick K. Gikunda

Reinforcement learning is a learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in reinforcement learning upon the fast development of deep neural networks. Along with the…

Machine Learning · Computer Science 2023-07-06 Zhuangdi Zhu , Kaixiang Lin , Anil K. Jain , Jiayu Zhou

Deep learning has recently become one of the most popular sub-fields of machine learning owing to its distributed data representation with multiple levels of abstraction. A diverse range of deep learning algorithms are being employed to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Rajat Kumar Sinha , Ruchi Pandey , Rohan Pattnaik

Network embedding methods aim at learning low-dimensional latent representation of nodes in a network. These representations can be used as features for a wide range of tasks on graphs such as classification, clustering, link prediction,…

Social and Information Networks · Computer Science 2018-08-09 Haochen Chen , Bryan Perozzi , Rami Al-Rfou , Steven Skiena

In the era of deep learning (DL), convolutional neural networks (CNNs), and large language models (LLMs), machine learning (ML) models are becoming increasingly complex, demanding significant computational resources for both inference and…

Machine Learning · Computer Science 2024-05-27 Madison Threadgill , Andreas Gerstlauer

The distributed inference paradigm enables the computation workload to be distributed across multiple devices, facilitating the implementations of deep learning based intelligent services on extremely resource-constrained Internet of Things…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-21 Li Wang , Liang Li , Lianming Xu , Xian Peng , Aiguo Fei

Deep Neural Networks (DNNs) achieve state-of-the-art performance on numerous applications. However, it is difficult to tell beforehand if a DNN receiving an input will deliver the correct output since their decision criteria are usually…

Machine Learning · Computer Science 2021-09-07 Julia Lust , Alexandru Paul Condurache

While modern machine learning has transformed numerous application domains, its growing computational demands increasingly constrain scalability and efficiency, particularly on embedded and resource-limited platforms. In practice, neural…

Machine Learning · Computer Science 2025-10-30 Bernhard Klein

With the widespread use of information technologies, information networks are becoming increasingly popular to capture complex relationships across various disciplines, such as social networks, citation networks, telecommunication networks,…

Social and Information Networks · Computer Science 2018-07-20 Daokun Zhang , Jie Yin , Xingquan Zhu , Chengqi Zhang

The recent advances in deep neural networks (DNNs) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-constrained computing devices. Model compression techniques can address…

Machine Learning · Computer Science 2018-10-23 Qing Qin , Jie Ren , Jialong Yu , Ling Gao , Hai Wang , Jie Zheng , Yansong Feng , Jianbin Fang , Zheng Wang