English
Related papers

Related papers: Inference of the sparse kinetic Ising model using …

200 papers

In this work, a new two-stage identification method based on dynamic programming and sparsity inducing is proposed for switched linear systems. Our method achieves sparsity inducing in the identification of switched linear systems by the…

Systems and Control · Electrical Eng. & Systems 2024-07-15 Zheng Wenju , Ye Hao

We introduce a two-stage probabilistic framework for statistical downscaling using unpaired data. Statistical downscaling seeks a probabilistic map to transform low-resolution data from a biased coarse-grained numerical scheme to…

Machine Learning · Computer Science 2023-11-01 Zhong Yi Wan , Ricardo Baptista , Yi-fan Chen , John Anderson , Anudhyan Boral , Fei Sha , Leonardo Zepeda-Núñez

In energy-efficient schemes, finding the optimal size of deep learning models is very important and has a broad impact. Meanwhile, recent studies have reported an unexpected phenomenon, the sparse double descent: as the model's sparsity…

Artificial Intelligence · Computer Science 2023-09-01 Victor Quétu , Marta Milovanović

Exact recovery of a sparse solution for an underdetermined system of linear equations implies full search among all possible subsets of the dictionary, which is computationally intractable, while l1 minimization will do the job when a…

Information Theory · Computer Science 2014-12-22 Mohsen Joneidi , Mahdi Barzegar Khalilsarai , Alireza Zaeemzadeh , Nazanin Rahnavard

We discuss a dynamical systems perspective on discrete optimization. Departing from the fact that many combinatorial optimization problems can be reformulated as finding low energy spin configurations in corresponding Ising models, we…

Optimization and Control · Mathematics 2023-05-16 Tong Guanchun , Michael Muehlebach

Network representation learning, as an approach to learn low dimensional representations of vertices, has attracted considerable research attention recently. It has been proven extremely useful in many machine learning tasks over large…

Machine Learning · Computer Science 2019-06-11 Hao Peng , Jianxin Li , Hao Yan , Qiran Gong , Senzhang Wang , Lin Liu , Lihong Wang , Xiang Ren

The antiferromagnetic Ising model samples subsets of vertices of a graph with weight decaying exponentially in the number of edges induced. We study the problem of sampling from this model on the class of bipartite, regular graphs with good…

Combinatorics · Mathematics 2026-03-03 Anna Geisler , Mihyun Kang , Michail Sarantis , Ronen Wdowinski

The traditional sparse modeling approach, when applied to inverse problems with large data such as images, essentially assumes a sparse model for small overlapping data patches. While producing state-of-the-art results, this methodology is…

Information Theory · Computer Science 2017-02-14 Dmitry Batenkov , Yaniv Romano , Michael Elad

In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the…

Methodology · Statistics 2023-05-12 Ghania Fatima , Prabhu Babu , Petre Stoica

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

We tackle the network topology inference problem by utilizing Laplacian constrained Gaussian graphical models, which recast the task as estimating a precision matrix in the form of a graph Laplacian. Recent research \cite{ying2020nonconvex}…

Machine Learning · Computer Science 2023-09-06 Jiaxi Ying , Xi Han , Rui Zhou , Xiwen Wang , Hing Cheung So

In this work we consider algorithms for reconstructing time-varying data into a finite sum of discrete trajectories, alternatively, an off-the-grid sparse-spikes decomposition which is continuous in time. Recent work showed that this…

Optimization and Control · Mathematics 2022-12-26 Vincent Duval , Robert Tovey

Hypergraph matching is a fundamental problem in computer vision. Mathematically speaking, it maximizes a polynomial objective function, subject to assignment constraints. In this paper, we reformulate the hypergraph matching problem as a…

Optimization and Control · Mathematics 2017-11-15 Chunfeng Cui , Qingna Li , Liqun Qi , Hong Yan

Maximum entropy models provide the least constrained probability distributions that reproduce statistical properties of experimental datasets. In this work we characterize the learning dynamics that maximizes the log-likelihood in the case…

Disordered Systems and Neural Networks · Physics 2016-09-21 Ulisse Ferrari

In this paper, we introduce a new nonlinear evolution partial differential equation for sparse deconvolution problems. The proposed PDE has the form of continuity equation that arises in various research areas, e.g. fluid dynamics and…

Optimization and Control · Mathematics 2011-04-04 Yu Mao , Bin Dong , Stanley Osher

In this work we provide a new technique to design fast approximation algorithms for graph problems where the points of the graph lie in a metric space. Specifically, we present a sampling approach for such metric graphs that, using a…

Data Structures and Algorithms · Computer Science 2018-07-26 Hossein Esfandiari , Michael Mitzenmacher

We consider an important class of signal processing problems where the signal of interest is known to be sparse, and can be recovered from data given auxiliary information about how the data was generated. For example, a sparse Green's…

Optimization and Control · Mathematics 2012-12-06 Aleksandr Y. Aravkin , Tristan van Leeuwen , Ning Tu

Ising models originated in statistical physics and are widely used in modeling spatial data and computer vision problems. However, statistical inference of this model remains challenging due to intractable nature of the normalizing constant…

Methodology · Statistics 2021-09-06 Minwoo Kim , Shrijita Bhattacharya , Tapabrata Maiti

When the scale of communication networks has been growing rapidly in the past decades, it becomes a critical challenge to extract fast and accurate estimation of key state parameters of network links, e.g., transmission delays and dropped…

Networking and Internet Architecture · Computer Science 2018-12-04 Hao-Ting Wei , Sung-Hsien Hsieh , Wen-Liang Hwang , Chung-Shou Liao , Chun-Shien Lu

I propose a variational approach to maximum pseudolikelihood inference of the Ising model. The variational algorithm is more computationally efficient, and does a better job predicting out-of-sample correlations than $L_2$ regularized…

Statistical Mechanics · Physics 2014-09-26 Charles K. Fisher