English
Related papers

Related papers: Shannon Entropy Helps Optimize the Performance of …

200 papers

Optical computing systems provide an alternate hardware model which appears to be aligned with the demands of neural network workloads. However, the challenge of implementing energy efficient nonlinearities in optics -- a key requirement…

Optics · Physics 2025-08-04 N. Richardson , C. Bosch , R. P. Adams

The data-embedding process is one of the bottlenecks of quantum machine learning, potentially negating any quantum speedups. In light of this, more effective data-encoding strategies are necessary. We propose a photonic-based bosonic…

Quantum Physics · Physics 2022-06-24 Beng Yee Gan , Daniel Leykam , Dimitris G. Angelakis

Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns with distinct properties across scales. Investigating how…

Information Theory · Computer Science 2025-04-23 Aaron J. Gutknecht , Fernando E. Rosas , David A. Ehrlich , Abdullah Makkeh , Pedro A. M. Mediano , Michael Wibral

Machine learning interatomic potentials (MLIPs) enable large-scale atomistic simulations but remain challenged in describing mixed-valence materials where charge ordering strongly influences thermodynamic stability. Here we investigate the…

We propose a simple, but efficient and accurate machine learning (ML) model for developing high-dimensional potential energy surface. This so-called embedded atom neural network (EANN) approach is inspired by the well-known empirical…

Chemical Physics · Physics 2019-10-23 Yaolong Zhang , Ce Hu , Bin Jiang

Extreme learning machine (ELM) is a new single hidden layer feedback neural network. The weights of the input layer and the biases of neurons in hidden layer are randomly generated, the weights of the output layer can be analytically…

Machine Learning · Computer Science 2018-03-13 Lin Feng , Shuliang Xu , Feilong Wang , Shenglan Liu

Exceptional points (EPs) -- singularities in the parameter space of non-Hermitian systems where two nearby eigenmodes coalesce -- feature unique properties with applications such as sensitivity enhancement and chiral emission. Existing…

Optics · Physics 2024-10-08 Xingwei Gao , Hao He , Scott Sobolewski , Alexander Cerjan , Chia Wei Hsu

The ability to learn continuously in artificial neural networks (ANNs) is often limited by catastrophic forgetting, a phenomenon in which new knowledge becomes dominant. By taking mechanisms of memory encoding in neuroscience (aka. engrams)…

Machine Learning · Computer Science 2025-03-28 Isabelle Aguilar , Luis Fernando Herbozo Contreras , Omid Kavehei

In extreme learning machines (ELM) the hidden-layer coefficients are randomly set and fixed, while the output-layer coefficients of the neural network are computed by a least squares method. The randomly-assigned coefficients in ELM are…

Computational Physics · Physics 2021-08-25 Suchuan Dong , Zongwei Li

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu

Biomedical decision making involves multiple signal processing, either from different sensors or from different channels. In both cases, information fusion plays a significant role. A deep learning based electroencephalogram channels'…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Fábio Mendonça , Sheikh Shanawaz Mostafa , Diogo Freitas , Fernando Morgado-Dias , Antonio G. Ravelo-García

Free-space optical communications with moving targets, such as satellite terminals, demand ultrafast wavefront sensing and correction. This is typically addressed using a Shack-Hartmann sensor, which pairs a high-speed camera with a lenslet…

In this paper will be presented new approach to entropy coding: family of generalizations of standard numeral systems which are optimal for encoding sequence of equiprobable symbols, into asymmetric numeral systems - optimal for freely…

Information Theory · Computer Science 2009-05-21 Jarek Duda

The increased computerization in recent years has resulted in the production of a variety of different software, however measures need to be taken to ensure that the produced software isn't defective. Many researchers have worked in this…

Software Engineering · Computer Science 2023-04-06 Param Khakhar and , Rahul Kumar Dubey

Neuro-encoded expression programming(NEEP) that aims to offer a novel continuous representation of combinatorial encoding for genetic programming methods is proposed in this paper. Genetic programming with linear representation uses…

Neural and Evolutionary Computing · Computer Science 2021-04-12 Aftab Anjum , Fengyang Sun , Lin Wang , Jeff Orchard

Due to the nonlinear distortion in Orthogonal frequency division multiplexing (OFDM) systems, the timing synchronization (TS) performance is inevitably degraded at the receiver. To relieve this issue, an extreme learning machine (ELM)-based…

Signal Processing · Electrical Eng. & Systems 2021-07-29 Chaojin Qing , Shuhai Tang , Chuangui Rao , Qing Ye , Jiafan Wang , Chuan Huang

Recently, referring image segmentation has aroused widespread interest. Previous methods perform the multi-modal fusion between language and vision at the decoding side of the network. And, linguistic feature interacts with visual feature…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Guang Feng , Zhiwei Hu , Lihe Zhang , Huchuan Lu

This paper presents a novel approach for analysing EEG data from drivers in a simulated driving test. We focused on the Hurst exponent, Shannon entropy, and fractal dimension as markers of the nonlinear dynamics of the brain. The results…

Signal Processing · Electrical Eng. & Systems 2023-12-21 Pallabjyoti Kakoti , Mukesh Kumar Kamti , Rauf Iqbal , Eeshankur Saikia

Beta Basis Function Neural Network (BBFNN) is a special kind of kernel basis neural networks. It is a feedforward network typified by the use of beta function as a hidden activation function. Beta is a flexible transfer function…

Machine Learning · Computer Science 2018-11-01 Naima Chouikhi , Adel M. Alimi

We study Sinkhorn EM (sEM), a variant of the expectation maximization (EM) algorithm for mixtures based on entropic optimal transport. sEM differs from the classic EM algorithm in the way responsibilities are computed during the expectation…

Machine Learning · Statistics 2020-07-01 Gonzalo Mena , Amin Nejatbakhsh , Erdem Varol , Jonathan Niles-Weed