English
Related papers

Related papers: Signalling Entropy: a novel network-theoretical fr…

200 papers

We study the notion of approximate entropy within the framework of network theory. Approximate entropy is an uncertainty measure originally proposed in the context of dynamical systems and time series. We firstly define a purely structural…

Disordered Systems and Neural Networks · Physics 2013-05-30 James West , Lucas Lacasa , Simone Severini , Andrew Teschendorff

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

Stratifying cancer patients based on their gene expression levels allows improving diagnosis, survival analysis and treatment planning. However, such data is extremely highly dimensional as it contains expression values for over 20000 genes…

The mutations of a complex systemic disease like cancer can be modeled as stuck-at faults in the Boolean system paradigm. For a class of multiple faults, the fault identification is exceptionally significant under the incomplete access of…

Systems and Control · Computer Science 2018-09-11 Anuj Deshpande , Ritwik Kumar Layek

Studies into the statistical properties of biological networks have led to important biological insights, such as the presence of hubs and hierarchical modularity. There is also a growing interest in studying the statistical properties of…

Molecular Networks · Quantitative Biology 2010-08-03 Andrew Teschendorff , Simone Severini

Inhibiting a signalling pathway concerns controlling the cellular processes of a cancer cell's viability, cell division, and death. Assay protocols created to see if the molecular structures of the drugs being tested have the desired…

Quantitative Methods · Quantitative Biology 2022-07-19 Roumen Anguelov , G Manjunath , Avulundiah E Phiri , Trevor T Nyakudya , Priyesh Bipath , June C Serem , Yvette N Hlophe

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

Entanglement entropy is a fundamental concept with rising importance in different fields ranging from quantum information science, black holes to materials science. In complex materials and systems, entanglement entropy provides insight…

Quantum Physics · Physics 2024-04-02 Zhi-Kang Lin , Yao Zhou , Bin Jiang , Bing-Quan Wu , Li-Mei Chen , Xiao-Yu Liu , Li-Wei Wang , Peng Ye , Jian-Hua Jiang

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

Quantum informatic quantities such as entanglement entropy are useful in detecting quantum phase transitions. Recently, a new entanglement measure called pseudo-entropy was proposed which is a generalization of the more well-known…

High Energy Physics - Theory · Physics 2025-09-23 Song He , Pak Hang Chris Lau , Long Zhao

Similarity-sensitive entropy measures the uncertainty of a probability law relative to a similarity kernel that encodes the distinguishability between states. We develop a measure-theoretic treatment covering both finite similarity matrices…

Probability · Mathematics 2026-05-29 Joseph Samuel Miller

A critical task in systems biology is the identification of genes that interact to control cellular processes by transcriptional activation of a set of target genes. Many methods have been developed to use statistical correlations in…

Quantitative Methods · Quantitative Biology 2010-11-24 Adam A. Margolin , Kai Wang , Andrea Califano , Ilya Nemenman

Background: Transitioning from an old medical coding system to a new one can be challenging, especially when the two coding systems are significantly different. The US experienced such a transition in 2015. Objective: This research aims to…

Information Theory · Computer Science 2020-12-24 Jerome Niyirora

Entropy is a fundamental concept in quantum information theory that allows to quantify entanglement and investigate its properties, for example its monogamy over multipartite systems. Here, we derive variational formulas for relative…

Quantum Physics · Physics 2024-05-21 Mario Berta , Marco Tomamichel

In various chemical systems enthalpy-entropy compensation (EEC) is a well-known rule of behavior, although the physical roots of it are still not completely understood. It has been frequently questioned whether EEC is a truly physical…

Statistical Mechanics · Physics 2015-06-04 E. B. Starikov , B. Norden

Cell signaling networks are complex and often incompletely characterized, making it difficult to obtain a comprehensive picture of the mechanisms they encode. Mathematical modeling of these networks provides important clues, but the models…

Molecular Networks · Quantitative Biology 2022-11-07 Soutick Saha , Hye-ran Moon , Bumsoo Han , Andrew Mugler

Here we deconstruct, and then in a reasoned way reconstruct, the concept of "entropy of a system," paying particular attention to where the randomness may be coming from. We start with the core concept of entropy as a COUNT associated with…

General Physics · Physics 2017-05-10 Tommaso Toffoli

The metaphor of a potential epigenetic differentiation landscape broadly suggests that during differentiation a stem cell follows the steepest descending gradient toward a stable equilibrium state which represents the final cell type. It…

Cell Behavior · Quantitative Biology 2020-09-22 K. Wiesner , J. Teles , M. Hartnor , C. Peterson

'Causal' direction is of great importance when dealing with complex systems. Often big volumes of data in the form of time series are available and it is important to develop methods that can inform about possible causal connections between…

Statistical Mechanics · Physics 2014-01-24 Fatimah Abdul Razak , Henrik Jeldtoft Jensen

Foundation models in genomics have shown mixed success compared to their counterparts in natural language processing. Yet, the reasons for their limited effectiveness remain poorly understood. In this work, we investigate the role of…

Machine Learning · Computer Science 2026-04-07 Maxime Rochkoulets , Lovro Vrček , Mile Šikić