English
Related papers

Related papers: Better Models and Algorithms for Learning Ising Mo…

200 papers

We consider the problem of estimating the graph associated with a binary Ising Markov random field. We describe a method based on $\ell_1$-regularized logistic regression, in which the neighborhood of any given node is estimated by…

Statistics Theory · Mathematics 2010-10-05 Pradeep Ravikumar , Martin J. Wainwright , John D. Lafferty

Graph pattern matching algorithms to handle million-scale dynamic graphs are widely used in many applications such as social network analytics and suspicious transaction detections from financial networks. On the other hand, the computation…

Databases · Computer Science 2019-07-10 Hiroki Kanezashi , Toyotaro Suzumura , Dario Garcia-Gasulla , Min-hwan Oh , Satoshi Matsuoka

We investigate the problem of statistical inference for logistic regression with high-dimensional covariates in settings where dependence among individuals is induced by an underlying Markov random field. Going beyond the pairwise…

Statistics Theory · Mathematics 2026-03-23 Josh Miles , Sohom Bhattacharya

We study data-driven learning of robust stochastic control for infinite-horizon systems with potentially continuous state and action spaces. In many managerial settings--supply chains, finance, manufacturing, services, and dynamic…

Machine Learning · Statistics 2025-11-18 Shengbo Wang , Jason Meng , Nian Si , Jose Blanchet , Zhengyuan Zhou

While the phenomenon of grokking, i.e., delayed generalization, has been studied extensively, it remains an open problem whether there is a mathematical framework that characterizes what kind of features will emerge, how and in which…

Machine Learning · Computer Science 2025-12-03 Yuandong Tian

After discussing the relevance of statistical physics in molecular recognition processes, we present a schematic model for ligand-receptor association based on an Ising chain. We discuss the possible behaviors of the affinity when the…

Soft Condensed Matter · Physics 2010-04-09 Fabrice Thalmann

Identifying model parameters from observed configurations poses a fundamental challenge in data science, especially with limited data. Recently, diffusion models have emerged as a novel paradigm in generative machine learning, capable of…

Data Analysis, Statistics and Probability · Physics 2025-03-14 Yechan Lim , Sangwon Lee , Junghyo Jo

The Hidden Markov Model (HMM) is one of the most widely used statistical models for sequential data analysis. One of the key reasons for this versatility is the ability of HMM to deal with missing data. However, standard HMM learning…

Machine Learning · Statistics 2023-07-04 Binyamin Perets , Mark Kozdoba , Shie Mannor

The identifiability of latent variable models has received increasing attention due to its relevance in interpretability and out-of-distribution generalisation. In this work, we study the identifiability of Switching Dynamical Systems,…

Machine Learning · Statistics 2024-06-05 Carles Balsells-Rodas , Yixin Wang , Yingzhen Li

Efficiently learning mixture of Gaussians is a fundamental problem in statistics and learning theory. Given samples coming from a random one out of k Gaussian distributions in Rn, the learning problem asks to estimate the means and the…

Machine Learning · Computer Science 2015-03-11 Rong Ge , Qingqing Huang , Sham M. Kakade

This work builds upon previous efforts in online incremental learning, namely the Incremental Gaussian Mixture Network (IGMN). The IGMN is capable of learning from data streams in a single-pass by improving its model after analyzing each…

Machine Learning · Computer Science 2017-02-08 Rafael Pinto , Paulo Engel

Learning graph representations is a fundamental task aimed at capturing various properties of graphs in vector space. The most recent methods learn such representations for static networks. However, real world networks evolve over time and…

Social and Information Networks · Computer Science 2019-08-22 Palash Goyal , Sujit Rokka Chhetri , Arquimedes Canedo

Time series and signals are attracting more attention across statistics, machine learning and pattern recognition as it appears widely in the industry especially in sensor and IoT related research and applications, but few advances has been…

Machine Learning · Computer Science 2018-08-15 Lu Liu , Zhiguang Wang

We study the mixing time of Glauber dynamics on monotone systems. For monotone systems satisfying the entropic independence condition, we prove a new mixing time comparison result for Glauber dynamics. For concrete applications, we obtain…

Discrete Mathematics · Computer Science 2025-07-16 Weiming Feng , Minji Yang

The vast majority of work in self-supervised learning, both theoretical and empirical (though mostly the latter), have largely focused on recovering good features for downstream tasks, with the definition of "good" often being intricately…

Machine Learning · Computer Science 2022-02-21 Bingbin Liu , Daniel Hsu , Pradeep Ravikumar , Andrej Risteski

We introduce Ising-H\"usler-Reiss processes, a new class of multivariate L\'evy processes that allows for sparse modeling of the path-wise conditional independence structure between marginal stable processes with different stability…

Methodology · Statistics 2026-01-13 Florian Brück , Sebastian Engelke , Stanislav Volgushev

We provide a method to identify system parameters of dynamical systems, called ID-ODE -- Inference by Differentiation and Observing Delay Embeddings. In this setting, we are given a dataset of trajectories from a dynamical system with…

Machine Learning · Computer Science 2022-11-17 Alex Tong Lin , Adrian S. Wong , Robert Martin , Stanley J. Osher , Daniel Eckhardt

Discovering the underlying dynamics of complex systems from data is an important practical topic. Constrained optimization algorithms are widely utilized and lead to many successes. Yet, such purely data-driven methods may bring about…

Dynamical Systems · Mathematics 2023-05-17 Nan Chen , Yinling Zhang

Machine learning models often require large datasets and struggle to generalize beyond their training distribution. These limitations pose significant challenges in scientific and engineering contexts, where generating exhaustive datasets…

Chemical Physics · Physics 2025-06-12 Salman N. Salman , Sergey A. Shteingolts , Ron Levie , Dan Mendels

Variational algorithms have gained prominence over the past two decades as a scalable computational environment for Bayesian inference. In this article, we explore tools from the dynamical systems literature to study convergence of…

Dynamical Systems · Mathematics 2020-12-02 Sean Plummer , Debdeep Pati , Anirban Bhattacharya