Related papers: Pruning to Increase Taylor Dispersion in Physarum …

Generative modeling has recently undergone remarkable advancements, primarily propelled by the transformative implications of Diffusion Probabilistic Models (DPMs). The impressive capability of these models, however, often entails…

One aim shared by multiple settings, such as continual learning or transfer learning, is to leverage previously acquired knowledge to converge faster on the current task. Usually this is done through fine-tuning, where an implicit…

Active fluid transport is a hallmark of many biological transport networks. While animal circulatory systems generally rely on a single heart to drive flows, other organisms employ decentralized local pumps to distribute fluids and…

We study transport in synthetic, bi-disperse porous structures, with arrays of microchannels interconnected by a nanoporous layer. These structures are inspired by the xylem tissue in vascular plants, in which sap water travels from the…

The diffusion of particles in confining walls forming a tube is discussed. Such a transport phenomenon is observed in biological cells and porous media. We consider the case in which the tube is winding with curvature and torsion, and the…

Network pruning techniques, including weight pruning and filter pruning, reveal that most state-of-the-art neural networks can be accelerated without a significant performance drop. This work focuses on filter pruning which enables…

The structural complexity of reservoir networks poses a significant challenge, often leading to excessive computational costs and suboptimal performance. In this study, we introduce a systematic, task specific node pruning framework that…

Sucrose is among the main products of photosynthesis that are deemed necessary for plant growth and survival. It is produced in the mesophyll cells of leaves and translocated to different parts of the plant through the phloem. Progress in…

We address the role of topology in the energy transport process that occurs in networks of photosynthetic complexes. We take inspiration from light harvesting networks present in purple bacteria and simulate an incoherent dissipative energy…

Pruning is one of the most effective model reduction techniques. Deep networks require massive computation and such models need to be compressed to bring them on edge devices. Most existing pruning techniques are focused on vision-based…

Evolving network models under a dynamic growth rule which comprises the addition and deletion of nodes are investigated. By adding a node with a probability $P_a$ or deleting a node with the probability $P_d=1-P_a$ at each time step, where…

In fully-developed pressure-driven flow, the spreading of a dissolved solute is enhanced in the flow direction due to transverse velocity variations in a phenomenon now commonly referred to as Taylor-Aris dispersion. It is well understood…

Neural network pruning techniques reduce the number of parameters without compromising predicting ability of a network. Many algorithms have been developed for pruning both over-parameterized fully-connected networks (FCNs) and…

Structured pruning compresses neural networks by reducing channels (filters) for fast inference and low footprint at run-time. To restore accuracy after pruning, fine-tuning is usually applied to pruned networks. However, too few remaining…

We generalize classical dispersion theory for a passive scalar to derive an asymptotic long-time convection-diffusion equation for a solute suspended in a wide, structured channel and subject to a steady low-Reynolds-number shear flow. Our…

The task of accelerating large neural networks on general purpose hardware has, in recent years, prompted the use of channel pruning to reduce network size. However, the efficacy of pruning based approaches has since been called into…

We study a coupled dynamics of a network and a particle system. Particles of density $\rho$ diffuse freely along edges, each of which is rewired at a rate given by a decreasing function of particle flux. We find that the coupled dynamics…

Highly-optimized complex transport networks serve crucial functions in many man-made and natural systems such as power grids and plant or animal vasculature. Often, the relevant optimization functional is non-convex and characterized by…

Neural network pruning is a popular technique used to reduce the inference costs of modern, potentially overparameterized, networks. Starting from a pre-trained network, the process is as follows: remove redundant parameters, retrain, and…

Deep learning algorithms are increasingly employed at the edge. However, edge devices are resource constrained and thus require efficient deployment of deep neural networks. Pruning methods are a key tool for edge deployment as they can…