English
Related papers

Related papers: Progressive Transmission and Inference of Deep Lea…

200 papers

Lossless image compression is an important technique for image storage and transmission when information loss is not allowed. With the fast development of deep learning techniques, deep neural networks have been used in this field to…

Image and Video Processing · Electrical Eng. & Systems 2021-08-25 Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Nannan Zou , Emre Aksu , Miska M. Hannuksela

Progressive Neural Network Learning is a class of algorithms that incrementally construct the network's topology and optimize its parameters based on the training data. While this approach exempts the users from the manual task of designing…

Machine Learning · Computer Science 2020-05-26 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

Federated Learning offers a way to train deep neural networks in a distributed fashion. While this addresses limitations related to distributed data, it incurs a communication overhead as the model parameters or gradients need to be…

Machine Learning · Computer Science 2023-05-26 Morten From Elvebakken , Alexandros Iosifidis , Lukas Esterle

We present a simple deep learning-based framework commonly used in computer vision and demonstrate its effectiveness for cross-dataset transfer learning in mental imagery decoding tasks that are common in the field of Brain-Computer…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Pierre Guetschel , Michael Tangermann

In the field of computer vision, visible light images often exhibit low contrast in low-light conditions, presenting a significant challenge. While infrared imagery provides a potential solution, its utilization entails high costs and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yijia Chen , Pinghua Chen , Xiangxin Zhou , Yingtie Lei , Ziyang Zhou , Mingxian Li

Diffusion learning is a framework that endows edge devices with advanced intelligence. By processing and analyzing data locally and allowing each agent to communicate with its immediate neighbors, diffusion effectively protects the privacy…

Machine Learning · Computer Science 2025-05-19 Elsa Rizk , Kun Yuan , Ali H. Sayed

We propose a robust spectrum sensing framework based on deep learning. The received signals at the secondary user's receiver are filtered, sampled and then directly fed into a convolutional neural network. Although this deep sensing is…

Information Theory · Computer Science 2019-08-05 Qihang Peng , Andrew Gilman , Nuno Vasconcelos , Pamela C. Cosman , Laurence B. Milstein

Deep convolutional neural networks have been widely used in numerous applications, but their demanding storage and computational resource requirements prevent their applications on mobile devices. Knowledge distillation aims to optimize a…

Machine Learning · Computer Science 2018-12-18 Hanting Chen , Yunhe Wang , Chang Xu , Chao Xu , Dacheng Tao

We present a novel framework for user representation in large-scale recommender systems, aiming at effectively representing diverse user taste in a generalized manner. Our approach employs a two-stage methodology combining representation…

Information Retrieval · Computer Science 2024-03-04 Ghazal Fazelnia , Sanket Gupta , Claire Keum , Mark Koh , Ian Anderson , Mounia Lalmas

Transfer learning using deep neural networks as feature extractors has become increasingly popular over the past few years. It allows to obtain state-of-the-art accuracy on datasets too small to train a deep neural network on its own, and…

Machine Learning · Computer Science 2017-10-25 Vincent Gripon , Ghouthi B. Hacene , Matthias Löwe , Franck Vermet

We propose a novel pose-guided appearance transfer network for transferring a given reference appearance to a target pose in unprecedented image resolution (1024 * 1024), given respectively an image of the reference and target person. No 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ji Liu , Heshan Liu , Mang-Tik Chiu , Yu-Wing Tai , Chi-Keung Tang

From computer vision and speech recognition to forecasting trajectories in autonomous vehicles, deep learning approaches are at the forefront of so many domains. Deep learning models are developed using plethora of high-level, generic…

Machine Learning · Computer Science 2021-05-07 Hamid Tabani , Ajay Balasubramaniam , Elahe Arani , Bahram Zonooz

We show how the notion of message passing can be used to streamline the algebra and computer coding for fast approximate inference in large Bayesian semiparametric regression models. In particular, this approach is amenable to handling…

Methodology · Statistics 2016-04-07 M. P. Wand

This paper introduces a deep-learning approach to photographic style transfer that handles a large variety of image content while faithfully transferring the reference style. Our approach builds upon the recent work on painterly transfer…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Fujun Luan , Sylvain Paris , Eli Shechtman , Kavita Bala

With the rapid growth in the volume of data sets, models, and devices in the domain of deep learning, there is increasing attention on large-scale distributed deep learning. In contrast to traditional distributed deep learning, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Feng Liang , Zhen Zhang , Haifeng Lu , Victor C. M. Leung , Yanyi Guo , Xiping Hu

Network traffic is growing at an outpaced speed globally. The modern network infrastructure makes classic network intrusion detection methods inefficient to classify an inflow of vast network traffic. This paper aims to present a modern…

Machine Learning · Computer Science 2021-01-05 Harsh Dhillon , Anwar Haque

Most Transformer language models are primarily pretrained on English text, limiting their use for other languages. As the model sizes grow, the performance gap between English and other languages with fewer compute and data resources…

Computation and Language · Computer Science 2023-01-24 Malte Ostendorff , Georg Rehm

Deep learning models have gained great success in many real-world applications. However, most existing networks are typically designed in heuristic manners, thus lack of rigorous mathematical principles and derivations. Several recent…

Computer Vision and Pattern Recognition · Computer Science 2017-12-18 Risheng Liu , Xin Fan , Shichao Cheng , Xiangyu Wang , Zhongxuan Luo

Embedded distributed inference of Neural Networks has emerged as a promising approach for deploying machine-learning models on resource-constrained devices in an efficient and scalable manner. The inference task is distributed across a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-07 Federico Nicolás Peccia , Oliver Bringmann

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars