English
Related papers

Related papers: An Analysis of Minimum Error Entropy Loss Function…

200 papers

Mediumband wireless communication refers to wireless communication through a class of channels known as mediumband that exists on the TmTs-plane. This paper, through statistical analysis and computer simulations, studies the performance…

Information Theory · Computer Science 2023-11-23 Dushyantha A Basnayaka , Jiabin Jia

Recently, substantial research efforts in Deep Metric Learning (DML) focused on designing complex pairwise-distance losses, which require convoluted schemes to ease optimization, such as sample mining or pair weighting. The standard…

Machine Learning · Computer Science 2021-11-29 Malik Boudiaf , Jérôme Rony , Imtiaz Masud Ziko , Eric Granger , Marco Pedersoli , Pablo Piantanida , Ismail Ben Ayed

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible while constrained to match empirically estimated feature expectations. However, in many real-world…

Machine Learning · Computer Science 2022-08-16 Kenneth Bogert , Yikang Gui , Prashant Doshi

In recent years, semantic communication has been a popular research topic for its superiority in communication efficiency. As semantic communication relies on deep learning to extract meaning from raw messages, it is vulnerable to attacks…

Information Theory · Computer Science 2023-08-09 Yuhao Chen , Qianqian Yang , Zhiguo Shi , Jiming Chen

In the field of statistical disclosure control, the tradeoff between data confidentiality and data utility is measured by comparing disclosure risk and information loss metrics. Distance based metrics such as the mean absolute error (MAE),…

Applications · Statistics 2023-05-16 Elias Chaibub Neto

Brain connectivity characterizes interactions between different regions of a brain network during resting-state or performance of a cognitive task. In studying brain signals such as electroencephalograms (EEG), one formal approach to…

Methodology · Statistics 2024-10-30 Paolo Victor Redondo , Raphael Huser , Hernando Ombao

In this paper, we present a detailed framework to analyze the evolution of the random topology of a time-varying wireless network via the information theoretic notion of entropy rate. We consider a propagation channel varying over time with…

Information Theory · Computer Science 2018-11-08 Arta Cika , Mihai-Alin Badiu , Justin P. Coon , Shahriar Etemadi Tajbakhsh

While cross entropy (CE) is the most commonly used loss to train deep neural networks for classification tasks, many alternative losses have been developed to obtain better empirical performance. Among them, which one is the best to use is…

Machine Learning · Computer Science 2022-10-11 Jinxin Zhou , Chong You , Xiao Li , Kangning Liu , Sheng Liu , Qing Qu , Zhihui Zhu

This paper focuses on energy-efficient coordinated multi-point (CoMP) downlink in multi-antenna multi-cell wireless communications systems. We provide an overview of transmit beamforming designs for various energy efficiency (EE) metrics…

Information Theory · Computer Science 2018-08-10 Kien-Giang Nguyen , Oskari Tervo , Quang-Doanh Vu , Le-Nam Tran , Markku Juntti

This paper provides analytical performance of the low-complexity family of affine projection algorithms on the estimation of multipath Rayleigh fading channels in the presence of carrier frequency offsets (CFO) and random channel…

Numerical Analysis · Mathematics 2011-07-08 Sayed A. Hadei , Paeiz Azmi

The joint design of beamforming vector and artificial noise covariance matrix is investigated for the multiple-input-single-output-multiple-eavesdropper simultaneous wireless information and power transferring \mbox{(MISOME-SWIPT)} systems.…

Information Theory · Computer Science 2018-09-12 Yanjie Dong , Md. Jahangir Hossain , Julian Cheng , Victor C. M. Leung

In nonlinear deterministic parameter estimation, the maximum likelihood estimator (MLE) is unable to attain the Cramer-Rao lower bound at low and medium signal-to-noise ratios (SNR) due the threshold and ambiguity phenomena. In order to…

Applications · Statistics 2015-06-19 Achraf Mallat , Sinan Gezici , Davide Dardari , Christophe Craeye , Luc Vandendorpe

This paper investigates the energy efficiency (EE) optimization in downlink multi-cell massive multiple-input multiple-output (MIMO). In our research, the statistical channel state information (CSI) is exploited to reduce the signaling…

Information Theory · Computer Science 2021-09-06 Li You , Yufei Huang , Di Zhang , Zheng Chang , Wenjin Wang , Xiqi Gao

The loss function used to train a neural network is strongly connected to its output layer from a statistical point of view. This technical report analyzes common activation functions for a neural network output layer, like linear, sigmoid,…

Machine Learning · Computer Science 2025-11-10 Fernando Berzal

The design of distributed mechanisms for interference management is one of the key challenges in emerging wireless small cell networks whose backhaul is capacity limited and heterogeneous (wired, wireless and a mix thereof). In this paper,…

Networking and Internet Architecture · Computer Science 2014-01-14 Sumudu Samarakoon , Mehdi Bennis , Walid Saad , Matti Latva-aho

Wireless sensor nodes are powered by batteries, for which replacement is very difficult. That is why, optimization of energy consumption is a major objective in the area of wireless sensor networks (WSNs).On the other hand, noisy channel…

Networking and Internet Architecture · Computer Science 2015-05-22 Rajoua Anane , Kosai Raoof , Ridha Bouallegue

Given the fast growth of intelligent devices, it is expected that a large number of high-stake artificial intelligence (AI) applications, e.g., drones, autonomous cars, tactile robots, will be deployed at the edge of wireless networks in…

Signal Processing · Electrical Eng. & Systems 2020-04-29 Kai Yang , Yong Zhou , Zhanpeng Yang , Yuanming Shi

Although supervised learning based on a deep neural network has recently achieved substantial improvement on speech enhancement, the existing schemes have either of two critical issues: spectrum or metric mismatches. The spectrum mismatch…

Sound · Computer Science 2020-05-12 Jaeyoung Kim , Mostafa El-Khamy , Jungwon Lee

This paper introduces a methodology based on Denoising AutoEncoder (DAE) for missing data imputation. The proposed methodology, called mDAE hereafter, results from a modification of the loss function and a straightforward procedure for…

Machine Learning · Computer Science 2024-11-21 Mariette Dupuy , Marie Chavent , Remi Dubois

We analyze a model of relay-augmented cellular wireless networks. The network users, who move according to a general mobility model based on a Poisson point process of continuous trajectories in a bounded domain, try to communicate with a…

Probability · Mathematics 2016-02-16 Christian Hirsch , Benedikt Jahnel , Paul Keeler , Robert I. A. Patterson