English
Related papers

Related papers: Scaling laws for molecular communication

200 papers

Empirically, large-scale deep learning models often satisfy a neural scaling law: the test error of the trained model improves polynomially as the model size and data size grow. However, conventional wisdom suggests the test error consists…

Machine Learning · Computer Science 2025-06-11 Licong Lin , Jingfeng Wu , Sham M. Kakade , Peter L. Bartlett , Jason D. Lee

In the present paper, we consider the linear wave equation with the scale-invariant damping and mass. It is known that the global behavior of the solution depends on the size of the coefficients in front of the damping and mass at initial…

Analysis of PDEs · Mathematics 2020-05-20 Takahisa Inui , Haruya Mizutani

Quantum communication typically involves a linear chain of repeater stations, each capable of reliable local quantum computation and connected to their nearest neighbors by unreliable communication links. The communication rate in existing…

While the scaling laws of large language models (LLMs) training have been extensively studied, optimal inference configurations of LLMs remain underexplored. We study inference scaling laws (aka test-time scaling laws) and compute-optimal…

Artificial Intelligence · Computer Science 2025-03-04 Yangzhen Wu , Zhiqing Sun , Shanda Li , Sean Welleck , Yiming Yang

In this paper we consider a nonlocal evolution problem and obtain by a scaling method the first term in the asymptotic behavior of the solutions. The method employed treats in different way the smooth and the rough part of the solution.

Analysis of PDEs · Mathematics 2012-10-30 Tatiana I. Ignat

A synopsis is offered of the properties of discrete and integer-valued, hence "natural", cellular automata (CA). A particular class comprises the "Hamiltonian CA" with discrete updating rules that resemble Hamilton's equations. The…

Quantum Physics · Physics 2017-06-06 Hans-Thomas Elze

Molecular communication in nanonetworks is an emerging communication paradigm where molecules are used as information carriers. Concentration Shift Keying (CSK) and Molecule Shift Keying (MoSK) are being studied extensively for the short…

Information Theory · Computer Science 2014-11-13 Md. Humaun Kabir , Kyung Sup Kwak

We study Kleinberg navigation (the search of a target in a d-dimensional lattice, where each site is connected to one other random site at distance r, with probability proportional to r^{-a}) by means of an exact master equation for the…

Statistical Mechanics · Physics 2015-04-01 Shai Carmi , Stephen Carter , Jie Sun , Daniel ben-Avraham

A parallel algorithm has perfect strong scaling if its running time on P processors is linear in 1/P, including all communication costs. Distributed-memory parallel algorithms for matrix multiplication with perfect strong scaling have only…

Data Structures and Algorithms · Computer Science 2012-02-16 Grey Ballard , James Demmel , Olga Holtz , Benjamin Lipshitz , Oded Schwartz

We suggest a mechanism based on spike time dependent plasticity (STDP) of synapses to store, retrieve and predict temporal sequences. The mechanism is demonstrated in a model system of simplified integrate-and-fire type neurons densely…

Adaptation and Self-Organizing Systems · Physics 2009-11-07 Thomas Nowotny , Misha I. Rabinovich , Henry D. I. Abarbanel

In this article we introduce an entropy-based, scale-dependent centrality that is evaluated as the Shannon entropy of the distribution at time t of a continuous-time random walk. It ranks nodes as a function of the time t, which acts as a…

Statistical Mechanics · Physics 2021-08-23 L. R. Schwengber , S. D. Prado , S. R. Dahmen

Shannon's Capacity Theorem is the main concept behind the Theory of Communication. It says that if the amount of information contained in a signal is smaller than the channel capacity of a physical media of communication, it can be…

Chaotic Dynamics · Physics 2009-11-13 M. S. Baptista , J. Kurths

The fits of 0.4 Ca(NO_3)_2 0.6 K(NO_3) (CKN) by schematic mode-coupling models [V. Krakoviack and C. Alba-Simionesco, J. Chem. Phys. 117, 2161-2171 (2002)] are analyzed by asymptotic expansions. The validity of both the power-law and the…

Disordered Systems and Neural Networks · Physics 2007-05-23 Matthias Sperl

Let $W$ be a binary-input memoryless symmetric (BMS) channel with Shannon capacity $I(W)$ and fix any $\alpha > 0$. We construct, for any sufficiently small $\delta > 0$, binary linear codes of block length $O(1/\delta^{2+\alpha})$ and rate…

Information Theory · Computer Science 2022-01-25 Venkatesan Guruswami , Andrii Riazanov , Min Ye

Encoding information about continuous variables using noisy computational units is a challenge; nonetheless, asymptotic theory shows that combining multiple periodic scales for coding can be highly precise despite the corrupting influence…

Neurons and Cognition · Quantitative Biology 2013-08-22 Alexander Mathis , Andreas V. M. Herz , Martin B. Stemmler

Information shared between parties quantifies their correlation. The encoding of correlations across space and time characterises the structure, history, and interactions of systems. One of the most fundamental properties that emerges from…

In this work, we provide a sharp theory of scaling laws for two-layer neural networks trained on a class of hierarchical multi-index targets, in a genuinely representation-limited regime. We derive exact information-theoretic scaling laws…

Machine Learning · Statistics 2026-02-06 Leonardo Defilippis , Florent Krzakala , Bruno Loureiro , Antoine Maillard

Current experimental and theoretical studies on the effect of intermolecular interactions on molecular conduction appear to be in conflict with each other. In particular, some experimental results, e.g., the observation of 2-dimensional…

Mesoscale and Nanoscale Physics · Physics 2007-07-23 A. Landau , L. Kronik , A. Nitzan

Arterial blood pressure is a key vital sign for the health of the human body. As such, accurate and reproducible measurement techniques are necessary for successful diagnosis. Blood pressure measurement is an example of molecular…

Information Theory · Computer Science 2014-10-22 Malcolm Egan , Adam Noel , Yansha Deng , Maged Elkashlan , Trung Q. Duong

Two new asynchronous modulation techniques for molecular timing (MT) channels are proposed. One based on modulating information on the time between two consecutive releases of indistinguishable information particles, and one based on using…

Signal Processing · Electrical Eng. & Systems 2018-12-12 Nariman Farsad , Yonathan Murin , Weisi Guo , Chan-Byoung Chae , Andrew Eckford , Andrea Goldsmith