English
Related papers

Related papers: A Perspective on Neural Capacity Estimation: Viabi…

200 papers

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Reliable channel estimation (CE) is fundamental for robust communication in dynamic wireless environments, where models must generalize across varying conditions such as signal-to-noise ratios (SNRs), the number of resource blocks (RBs),…

Signal Processing · Electrical Eng. & Systems 2025-09-22 Tianyu Li , Yan Xin , Jianzhong , Zhang

Artificial neural networks have advanced due to scaling dimensions, but conventional computing faces inefficiency due to the von Neumann bottleneck. In-memory computation architectures, like memristors, offer promise but face challenges due…

This work presents a machine learning approach to optimize the energy efficiency (EE) in a multi-cell wireless network. This optimization problem is non-convex and its global optimum is difficult to find. In the literature, either simple…

Signal Processing · Electrical Eng. & Systems 2023-12-18 Bile Peng , Karl-Ludwig Besser , Ramprasad Raghunath , Eduard A. Jorswieck

In the Edge Inference (EI) paradigm, where a Deep Neural Network (DNN) is split across the transceivers to wirelessly communicate goal-defined features in solving a computational task, the wireless medium has been commonly treated as a…

Machine Learning · Computer Science 2025-04-03 Kyriakos Stylianopoulos , Paolo Di Lorenzo , George C. Alexandropoulos

In this work, we present a novel unsupervised image registration algorithm. It is differentiable end-to-end and can be used for both multi-modal and mono-modal registration. This is done using mutual information (MI) as a metric. The…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Abhishek Nan , Matthew Tennant , Uriel Rubin , Nilanjan Ray

Neural networks have demonstrated considerable success on a wide variety of real-world problems. However, networks trained only to optimize for training accuracy can often be fooled by adversarial examples - slightly perturbed inputs that…

Machine Learning · Computer Science 2019-02-19 Vincent Tjeng , Kai Xiao , Russ Tedrake

Conditional Mutual Information (CMI) is a measure of conditional dependence between random variables X and Y, given another random variable Z. It can be used to quantify conditional dependence among variables in many data-driven inference…

Machine Learning · Computer Science 2019-06-10 Sudipto Mukherjee , Himanshu Asnani , Sreeram Kannan

Evaluating the effects of time-varying exposures is essential for longitudinal studies. The effect estimation becomes increasingly challenging when dealing with hundreds of time-dependent confounders. We propose a Marginal Structure…

Methodology · Statistics 2025-10-21 Zhiwei Zhao , Chixiang Chen , Shuo Chen

Imbalanced data occurs in a wide range of scenarios. The skewed distribution of the target variable elicits bias in machine learning algorithms. One of the popular methods to combat imbalanced data is to artificially balance the data…

Machine Learning · Computer Science 2021-10-26 Firuz Kamalov , Ashraf Elnagar

This paper studies the capacity of a general multiple-input multiple-output (MIMO) free-space optical intensity channel under a per-input-antenna peak-power constraint and a total average-power constraint over all input antennas. The focus…

Information Theory · Computer Science 2020-02-04 Longguang Li , Stefan M. Moser , Ligong Wang , Michèle Wigger

Deep neural networks are vulnerable to adversarial attacks. The literature is rich with algorithms that can easily craft successful adversarial examples. In contrast, the performance of defense techniques still lags behind. This paper…

Machine Learning · Computer Science 2019-05-29 Yuzhe Yang , Guo Zhang , Dina Katabi , Zhi Xu

The problem of fast point-to-point MIMO channel mutual information estimation is addressed, in the situation where the receiver undergoes unknown colored interference, whereas the channel with the transmitter is perfectly known. The…

Probability · Mathematics 2012-03-14 Abla Kammoun , Romain Couillet , Jamal Najim , Merouane Debbah

Mutual information is a measure of the dependence between random variables that has been used successfully in myriad applications in many fields. Generalized mutual information measures that go beyond classical Shannon mutual information…

Information Theory · Computer Science 2021-07-30 Kevin R. Moon , Kumar Sricharan , Alfred O. Hero

Capacity is one of the most important performance metrics for wireless communication networks. It describes the maximum rate at which the information can be transmitted of a wireless communication system. To support the growing demand for…

Signal Processing · Electrical Eng. & Systems 2022-09-05 Dandan Jiang , Han Hao , Lu Yang , Rui Wang

Symbol detection for Massive Multiple-Input Multiple-Output (MIMO) is a challenging problem for which traditional algorithms are either impractical or suffer from performance limitations. Several recently proposed learning-based approaches…

Signal Processing · Electrical Eng. & Systems 2019-06-12 Mehrdad Khani , Mohammad Alizadeh , Jakob Hoydis , Phil Fleming

Image classification with neural networks (NNs) is widely used in industrial processes, situations where the model likely encounters unknown objects during deployment, i.e., out-of-distribution (OOD) data. Worryingly, NNs tend to make…

Machine Learning · Computer Science 2025-01-14 Arthur Thuy , Dries F. Benoit

Variational Autoencoder is a scalable method for learning latent variable models of complex data. It employs a clear objective that can be easily optimized. However, it does not explicitly measure the quality of learned representations. We…

Machine Learning · Computer Science 2020-05-29 Andriy Serdega , Dae-Shik Kim

Self-supervised learning methods like masked autoencoders (MAE) have shown significant promise in learning robust feature representations, particularly in image reconstruction-based pretraining task. However, their performance is often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Sua Lee , Joonhun Lee , Myungjoo Kang

Computer simulators can be computationally intensive to run over a large number of input values, as required for optimization and various uncertainty quantification tasks. The standard paradigm for the design and analysis of computer…

Computation · Statistics 2015-09-11 Joakim Beck , Serge Guillas