English
Related papers

Related papers: Softmax as a Lagrangian-Legendrian Seam

200 papers

A neural population responding to multiple appearances of a single object defines a manifold in the neural response space. The ability to classify such manifolds is of interest, as object recognition and other computational tasks require a…

Disordered Systems and Neural Networks · Physics 2022-08-30 Uri Cohen , Haim Sompolinsky

With an eye towards human-centered automation, we contribute to the development of a systematic means to infer features of human decision-making from behavioral data. Motivated by the common use of softmax selection in models of human…

Optimization and Control · Mathematics 2015-09-01 Paul Reverdy , Naomi E. Leonard

Diffusion models learn to reverse the progressive noising of a data distribution to create a generative model. However, the desired continuous nature of the noising process can be at odds with discrete data. To deal with this tension…

Machine Learning · Computer Science 2023-09-13 Griffin Floto , Thorsteinn Jonsson , Mihai Nica , Scott Sanner , Eric Zhengyu Zhu

We present a robust and efficient method for simulating Lagrangian solid-fluid coupling based on a new operator splitting strategy. We use variational formulations to approximate fluid properties and solid-fluid interactions, and introduce…

Graphics · Computer Science 2023-01-06 Tianyi Xie , Minchen Li , Yin Yang , Chenfanfu Jiang

In this work, we introduce a novel method to render, in real-time, Lambertian surfaces with a rough dieletric coating. We show that the appearance of such configurations is faithfully represented with two microfacet lobes accounting for…

Graphics · Computer Science 2022-03-23 Héloïse de Dinechin , Laurent Belcour

In situ interfacial rheology and numerical simulations are used to investigate microgel monolayers in a wide range of packing fractions, $\zeta_{2D}$. The heterogeneous particle compressibility determines two flow regimes characterized by…

Direct pore scale simulations of two-fluid flow on digital rock images provide a promising tool to understand the role of surface wetting phenomena on flow and transport in geologic reservoirs. We present computational protocols that mimic…

Geophysics · Physics 2020-07-27 James E. McClure , Zhe Li , Mark Berrill , Thomas Ramstad

Physical symmetries provide a strong inductive bias for constructing functions to analyze data. In particular, this bias may improve robustness, data efficiency, and interpretability of machine learning models. However, building machine…

High Energy Physics - Phenomenology · Physics 2025-11-05 Pradyun Hebbar , Thandikire Madula , Vinicius Mikuni , Benjamin Nachman , Nadav Outmezguine , Inbar Savoray

Recent works have argued that high-level semantic concepts are encoded "linearly" in the representation space of large language models. In this work, we study the origins of such linear representations. To that end, we introduce a simple…

Computation and Language · Computer Science 2024-03-07 Yibo Jiang , Goutham Rajendran , Pradeep Ravikumar , Bryon Aragam , Victor Veitch

Discrete simulation methods are efficient tools to investigate the complex behaviors of complex fluids made of either dry granular materials or dilute suspensions. By contrast, materials made of soft and/or concentrated units (emulsions,…

Fluid Dynamics · Physics 2008-12-18 Pierre Rognon , Cyprien Gay

In the past few years, Softmax has become a common component in neural network frameworks. In this paper, a gradient decay hyperparameter is introduced in Softmax to control the probability-dependent gradient decay rate during training. By…

Machine Learning · Statistics 2023-10-10 Siyuan Zhang , Linbo Xie , Ying Chen

A fundamental difficulty of studying gas-liquid pipe flows is the prediction of the occurrence and characteristics of the slug flow regime, which plays a crucial role in the safety design of oil pipelines. Current empirical methods and…

Fluid Dynamics · Physics 2024-05-24 Massoud Rezavand , Xiangyu Hu

In this study we present a kinematic approach to modeling needle insertion into soft tissues. The kinematic approach allows the presentation of the problem as Dirichlet-type (i.e. driven by enforced motion of boundaries) and therefore…

Medical Physics · Physics 2021-01-26 Adam Wittek , George Bourantas , Benjamin F. Zwick , Grand Joldes , Lionel Esteban , Karol Miller

The dynamics of a rigid particle above a fluid-fluid interface in shear flow is studied here numerically and analytically as a function of the downward force applied on the particle. It is found here that the particle goes below the…

Soft Condensed Matter · Physics 2025-08-04 Alexander Farutin

Mutual information is widely applied to learn latent representations of observations, whilst its implication in classification neural networks remain to be better explained. We show that optimising the parameters of classification neural…

Machine Learning · Computer Science 2020-09-18 Zhenyue Qin , Dongwoo Kim , Tom Gedeon

Soft Glassy Materials (SGM) consist in dense amorphous assemblies of colloidal particles of multiple shapes, elasticity, and interactions, which confer upon them solid-like properties at rest. They are ubiquitously encountered in modern…

We introduce the Locally Linear Latent Variable Model (LL-LVM), a probabilistic model for non-linear manifold discovery that describes a joint distribution over observations, their manifold coordinates and locally linear maps conditioned on…

Machine Learning · Statistics 2015-12-02 Mijung Park , Wittawat Jitkrittum , Ahmad Qamar , Zoltan Szabo , Lars Buesing , Maneesh Sahani

The effective mixing behavior of solutes in porous media is fundamentally connected to the development of a local mixing interface between the two initial solutions, which is characterized by a complex lamellar structure. The deformation of…

Fluid Dynamics · Physics 2025-02-28 Daniel M C Hallack , Guillem Sole-Mari , Saif Farhat , Diogo Bolster

This work investigates the use of smooth neural networks for modeling dynamic variations of implicit surfaces under the level set equation (LSE). For this, it extends the representation of neural implicit surfaces to the space-time…

Machine Learning · Computer Science 2024-04-15 Tiago Novello , Vinicius da Silva , Guilherme Schardong , Luiz Schirmer , Helio Lopes , Luiz Velho

We consider some basic principles of fluid-induced lubrication at soft interfaces. In particular, we show how the presence of a soft substrate leads to an increase in the physical separation between surfaces sliding past each other. By…

Soft Condensed Matter · Physics 2009-11-10 J. M. Skotheim , L. Mahadevan