English
Related papers

Related papers: Sinkhorn Based Associative Memory Retrieval Using …

200 papers

As the complexity of modern control systems increases, it becomes challenging to derive an accurate model of the uncertainty that affects their dynamics. Wasserstein Distributionally Robust Optimization (DRO) provides a powerful framework…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Riccardo Cescon , Andrea Martin , Giancarlo Ferrari-Trecate

Multi-marginal optimal transport enables one to compare multiple probability measures, which increasingly finds application in multi-task learning problems. One practical limitation of multi-marginal transport is computational scalability…

Clustering is a fundamental unsupervised learning approach. Many clustering algorithms -- such as $k$-means -- rely on the euclidean distance as a similarity measure, which is often not the most relevant metric for high dimensional data…

Machine Learning · Computer Science 2019-10-22 Aude Genevay , Gabriel Dulac-Arnold , Jean-Philippe Vert

Predictive states for stochastic processes are a nonparametric and interpretable construct with relevance across a multitude of modeling paradigms. Recent progress on the self-supervised reconstruction of predictive states from time-series…

Statistical Mechanics · Physics 2022-12-21 Samuel P. Loomis , James P. Crutchfield

Approximate Nearest Neighbor (ANN) search has become fundamental to modern AI infrastructure, powering recommendation systems, search engines, and large language models across industry leaders from Google to OpenAI. Hierarchical Navigable…

Information Retrieval · Computer Science 2026-02-26 Ganap Ashit Tewary , Nrusinga Charan Gantayat , Jeff Zhang

We propose a mathematical methodology to derive a stochastic parameterization of bulk warm cloud micro-physics properties. Unlike previous bulk parameterizations, the stochastic parameterization does not assume any particular droplet size…

Atmospheric and Oceanic Physics · Physics 2016-06-08 David Collins , Boualem Khouider

Time-varying mixture densities occur in many scenarios, for example, the distributions of keywords that appear in publications may evolve from year to year, video frame features associated with multiple targets may evolve in a sequence. Any…

Machine Learning · Statistics 2016-04-19 Cheng Luo , Yang Xiang , Richard Yi Da Xu

We give an explicit stochastic Hamiltonian model of discontinuous unitary evolution for quantum spontaneous jumps like in a system of atoms in quantum optics, or in a system of quantum particles that interacts singularly with "bubbles"…

Quantum Physics · Physics 2009-11-11 V. P. Belavkin , O. Melsheimer

Restricted Boltzmann Machines are described by the Gibbs measure of a bipartite spin glass, which in turn corresponds to the one of a generalised Hopfield network. This equivalence allows us to characterise the state of these systems in…

Disordered Systems and Neural Networks · Physics 2018-02-28 Adriano Barra , Giuseppe Genovese , Peter Sollich , Daniele Tantari

We propose and analyze a solution to the problem of recovering a block sparse signal with sparse blocks from linear measurements. Such problems naturally emerge inter alia in the context of mobile communication, in order to meet the…

Information Theory · Computer Science 2020-09-23 Ingo Roth , Martin Kliesch , Axel Flinth , Gerhard Wunder , Jens Eisert

This paper addresses distributed parameter estimation in stochastic dynamic systems with quantized measurements, constrained by quantized communication and Markovian switching directed topologies. To enable accurate recovery of the original…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Ying Wang , Jian Guo , Yanlong Zhao , Ji-feng Zhang

Flow Matching has recently gained attention in generative modeling as a simple and flexible alternative to diffusion models. While existing statistical guarantees adapt tools from the analysis of diffusion models, we take a different…

Machine Learning · Statistics 2026-03-18 Lea Kunkel , Mathias Trabs

We present a new perspective on the celebrated Sinkhorn algorithm by showing that is a special case of incremental/stochastic mirror descent. In order to see this, one should simply plug Kullback-Leibler divergence in both mirror map and…

Machine Learning · Computer Science 2019-09-17 Konstantin Mishchenko

Quantum coherence and entanglement are fundamental resources in quantum technologies, yet their efficient estimation for unknown states by employing minimal resources in experimental settings remains challenging, particularly in…

Quantum Physics · Physics 2026-01-12 Ting Lin , Zhihua Chen , Kai Wu , Zhihua Guo , Zhihao Ma , Shao-Ming Fei

As computers approach the physical limits of information storable in memory, new methods will be needed to further improve information storage and retrieval. We propose a quantum inspired vector based approach, which offers a contextually…

Neurons and Cognition · Quantitative Biology 2016-11-17 Kirsty Kitto , Peter Bruza , Liane Gabora

We study properties of the Petz recovery map in chaotic systems, such as the Hayden-Preskill setup for evaporating black holes and the SYK model. Since these systems exhibit the phenomenon called scrambling, we expect that the expression of…

High Energy Physics - Theory · Physics 2023-10-31 Yasuaki Nakayama , Akihiro Miyata , Tomonori Ugajin

We study the data selection problem, whose aim is to select a small representative subset of data that can be used to efficiently train a machine learning model. We present a new data selection approach based on $k$-means clustering and…

We examine a previouly introduced attractor neural network model that explains the persistent activities of neurons in the anterior ventral temporal cortex of the brain. In this model, the coexistence of several attractors including…

Disordered Systems and Neural Networks · Physics 2009-11-10 T. Uezu , A. Hirano , M. Okada

Stochastic gradient descent (SGD) is a popular algorithm for minimizing objective functions that arise in machine learning. For constant step-sized SGD, the iterates form a Markov chain on a general state space. Focusing on a class of…

Optimization and Control · Mathematics 2025-03-26 David Shirokoff , Philip Zaleski

Distributionally robust optimization (DRO) has emerged as a powerful paradigm for reliable decision-making under uncertainty. This paper focuses on DRO with ambiguity sets defined via the Sinkhorn discrepancy: an entropy-regularized…

Machine Learning · Statistics 2025-12-16 Jie Wang