English
Related papers

Related papers: DDPG-Driven Deep-Unfolding with Adaptive Depth for…

200 papers

We introduce a method for fast estimation of data-adapted, spatio-temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV)-minimization. Our approach is inspired by recent…

Standard deep neural networks (DNNs) are commonly trained in an end-to-end fashion for specific tasks such as object recognition, face identification, or character recognition, among many examples. This specificity often leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Raphaël Achddou , J. Matias di Martino , Guillermo Sapiro

Artificial neural networks have revolutionized machine learning in recent years, but a complete theoretical framework for their learning process is still lacking. Substantial advances were achieved for wide networks, within two disparate…

Machine Learning · Computer Science 2025-05-09 Yehonatan Avidan , Qianyi Li , Haim Sompolinsky

Motivated by extreme multi-label classification applications, we consider training deep learning models over sparse data in multi-GPU servers. The variance in the number of non-zero features across training batches and the intrinsic GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-15 Yujing Ma , Florin Rusu , Kesheng Wu , Alexander Sim

Deploying deep neural networks (DNNs) on edge devices requires strong compression with minimal accuracy loss. This paper introduces Mix-and-Match Pruning, a globally guided, layer-wise sparsification framework that leverages sensitivity…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Danial Monachan , Samira Nazari , Mahdi Taheri , Ali Azarpeyvand , Milos Krstic , Michael Huebner , Christian Herglotz

Deep neural networks (DNNs) achieve remarkable predictive performance but remain difficult to interpret, largely due to overparameterization that obscures the minimal structure required for interpretation. Here we introduce DeepIn, a…

Methodology · Statistics 2026-03-26 Zhiyao Tan , Liu Li , Huazhen Lin

Training a neural network (NN) typically relies on some type of curve-following method, such as gradient descent (GD) (and stochastic gradient descent (SGD)), ADADELTA, ADAM or limited memory algorithms. Convergence for these algorithms…

Machine Learning · Computer Science 2023-05-08 Michael A Kouritzin , Stephen Styles , Beatrice-Helen Vritsiou

Deep learning (DL) based autoencoder has shown great potential to significantly enhance the physical layer performance. In this paper, we present a DL based autoencoder for interference channel. Based on a characterization of a k-user…

Machine Learning · Computer Science 2019-12-18 Dehao Wu , Maziar Nekovee , Yue Wang

Blind image deblurring is an important yet very challenging problem in low-level vision. Traditional optimization based methods generally formulate this task as a maximum-a-posteriori estimation or variational inference problem, whose…

Image and Video Processing · Electrical Eng. & Systems 2021-06-08 Hui Wang , Zongsheng Yue , Qian Zhao , Deyu Meng

Observational studies are based on accurate assessment of human state. A behavior recognition system that models interlocutors' state in real-time can significantly aid the mental health domain. However, behavior recognition from speech…

Machine Learning · Computer Science 2016-06-15 Haoqi Li , Brian Baucom , Panayiotis Georgiou

Deep convolutional neural networks (CNNs) have been intensively used for multi-class segmentation of data from different modalities and achieved state-of-the-art performances. However, a common problem when dealing with large, high…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Chengjia Wang , Tom MacGillivray , Gillian Macnaught , Guang Yang , David Newby

The graph neural network (GNN) has demonstrated its superior performance in various applications. The working mechanism behind it, however, remains mysterious. GNN models are designed to learn effective representations for graph-structured…

Machine Learning · Computer Science 2022-06-10 Zepeng Zhang , Ziping Zhao

Dynamic Bayesian Networks (DBNs), renowned for their interpretability, have become increasingly vital in representing complex stochastic processes in various domains such as gene expression analysis, healthcare, and traffic prediction.…

Machine Learning · Computer Science 2023-12-05 Hui Ouyang , Cheng Chen , Ke Tang

Medical image segmentation using deep neural networks has been highly successful. However, the effectiveness of these networks is often limited by inadequate dense prediction and inability to extract robust features. To achieve refined…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Suraj Mishra , Danny Z. Chen

Deep neural networks (NNs) encounter scalability limitations when confronted with a vast array of neurons, thereby constraining their achievable network depth. To address this challenge, we propose an integration of tensor networks (TN)…

Disordered Systems and Neural Networks · Physics 2024-08-20 Saeed S. Jahromi , Roman Orus

In this chapter, the regulation of Unmanned Aerial Vehicle (UAV) communication network is investigated in the presence of dynamic changes in the UAV lineup and user distribution. We target an optimal UAV control policy which is capable of…

Systems and Control · Electrical Eng. & Systems 2021-08-26 Ran Zhang , Duc Minh , Nguyen , Miao Wang , Lin X. Cai , Xuemin , Shen

Optimization-based solvers play a central role in a wide range of signal processing and communication tasks. However, their applicability in latency-sensitive systems is limited by the sequential nature of iterative methods and the high…

Signal Processing · Electrical Eng. & Systems 2026-03-12 Dvir Avrahami , Amit Milstein , Caroline Chaux , Tirza Routtenberg , Nir Shlezinger

Deep learning has delivered its powerfulness in many application domains, especially in image and speech recognition. As the backbone of deep learning, deep neural networks (DNNs) consist of multiple layers of various types with hundreds to…

Machine Learning · Computer Science 2017-12-14 Sheng Lin , Ning Liu , Mahdi Nazemi , Hongjia Li , Caiwen Ding , Yanzhi Wang , Massoud Pedram

Geometry-aware optimization algorithms, such as Muon, have achieved remarkable success in training deep neural networks (DNNs). These methods leverage the underlying geometry of DNNs by selecting appropriate norms for different layers and…

Machine Learning · Computer Science 2026-02-04 Jie Hao , Xiaochuan Gong , Jie Xu , Zhengdao Wang , Mingrui Liu

We consider the use of deep neural network (DNN) to develop a decision-directed (DD)-channel estimation (CE) algorithm for multiple-input multiple-output (MIMO)-space-time block coded systems in highly dynamic vehicular environments. We…

Signal Processing · Electrical Eng. & Systems 2019-01-14 Mehrtash Mehrabi , Mostafa Mohammadkarimi , Masoud Ardakani , Yindi Jing