English
Related papers

Related papers: Mutual Information Scaling for Tensor Network Mach…

200 papers

Exponential models of distributions are widely used in machine learning for classiffication and modelling. It is well known that they can be interpreted as maximum entropy models under empirical expectation constraints. In this work, we…

Machine Learning · Computer Science 2012-07-19 Amir Globerson , Naftali Tishby

The use of quantum computing for machine learning is among the most exciting prospective applications of quantum technologies. However, machine learning tasks where data is provided can be considerably different than commonly studied…

Tensor networks (TNs) and neural networks (NNs) are two fundamental data modeling approaches. TNs were introduced to solve the curse of dimensionality in large-scale tensors by converting an exponential number of dimensions to polynomial…

Machine Learning · Computer Science 2025-03-18 Maolin Wang , Yu Pan , Zenglin Xu , Guangxi Li , Xiangli Yang , Danilo Mandic , Andrzej Cichocki

We study the problem of community detection when there is covariate information about the node labels and one observes multiple correlated networks. We provide an asymptotic upper bound on the per-node mutual information as well as a…

Information Theory · Computer Science 2019-12-12 Vaishakhi Mayya , Galen Reeves

Tensor networks (TN) have found a wide use in machine learning, and in particular, TN and deep learning bear striking similarities. In this work, we propose the quantum-classical hybrid tensor networks (HTN) which combine tensor networks…

Machine Learning · Computer Science 2024-08-15 Ding Liu , Jiaqi Yao , Zekun Yao , Quan Zhang

We develop new algorithms for estimating heterogeneous treatment effects, combining recent developments in transfer learning for neural networks with insights from the causal inference literature. By taking advantage of transfer learning,…

Classification using variational quantum circuits is a promising frontier in quantum machine learning. Quantum supervised learning (QSL) applied to classical data using variational quantum circuits involves embedding the data into a quantum…

Quantum Physics · Physics 2026-03-16 Yujin Kim , Changjae Im , Taehyun Kim , Tak Hur , Daniel K. Park

Recent advancements have highlighted the limitations of current quantum systems, particularly the restricted number of qubits available on near-term quantum devices. This constraint greatly inhibits the range of applications that can…

We perform quantum simulation on classical and quantum computers and set up a machine learning framework in which we can map out phase diagrams of known and unknown quantum many-body systems in an unsupervised fashion. The classical…

Quantum Physics · Physics 2022-10-21 Korbinian Kottmann

Quantifying the dependence between high-dimensional random variables is central to statistical learning and inference. Two classical methods are canonical correlation analysis (CCA), which identifies maximally correlated projected versions…

Machine Learning · Computer Science 2023-09-29 Dor Tsur , Ziv Goldfeld , Kristjan Greenewald

Graph-based multi-view clustering has become an active topic due to the efficiency in characterizing both the complex structure and relationship between multimedia data. However, existing methods have the following shortcomings: (1) They…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Tianyu Jiang , Quanxue Gao , Xinbo Gao

Quantum resources, such as entanglement or quantum communication, offer significant communication advantages in information processing. We develop an operational framework for realizing these communication advantages in resource-constrained…

Quantum Physics · Physics 2026-04-16 Brian Doolittle , Felix Leditzky , Eric Chitambar

Information theoretic measures have helped to sharpen our understanding of many-body quantum states. As perhaps the most well-known example, the entanglement entropy (or more generally, the bipartite mutual information) has become a…

Quantum Physics · Physics 2024-02-22 Andrea Pizzi , Norman Y. Yao

Tensor networks are a compressed format for multi-dimensional data. One-dimensional tensor networks -- often referred to as tensor trains (TT) or matrix product states (MPS) -- are increasingly being used as a numerical ansatz for continuum…

Quantum Physics · Physics 2025-12-09 Joseph Tindall , E. Miles Stoudenmire , Ryan Levy

We consider rank-one non-symmetric tensor estimation and derive simple formulas for the mutual information. We start by the order 2 problem, namely matrix factorization. We treat it completely in a simpler fashion than previous proofs using…

Information Theory · Computer Science 2018-11-28 Jean Barbier , Nicolas Macris , Léo Miolane

In many applications, such as classification of images or videos, it is of interest to develop a framework for tensor data instead of an ad-hoc way of transforming data to vectors due to the computational and under-sampling issues. In this…

Machine Learning · Statistics 2020-11-13 You-Lin Chen , Mladen Kolar , Ruey S. Tsay

For most networks, the connection between two nodes is the result of their mutual affinity and attachment. In this paper, we propose a mutual selection model to characterize the weighted networks. By introducing a general mechanism of…

Statistical Mechanics · Physics 2009-11-11 Wen-Xu Wang , Bu Hu , Tao Zhou , Bing-Hong Wang , Yan-Bo Xie

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections. A few examples where this problem is relevant are compressed sensing, sparse superposition codes, and code division multiple access.…

Information Theory · Computer Science 2020-08-31 Jean Barbier , Nicolas Macris , Mohamad Dia , Florent Krzakala

Quantum machine learning (QML) has attracted considerable research interest, yet whether it offers practical benefits over classical approaches remains an open question. The choice of data encoding significantly influences QML performance,…

Quantum Physics · Physics 2026-05-19 Lena Tokuhiro , Amine Bentellis , Jeanette Miriam Lorenz

Tensor networks (TNs) have become one of the most essential building blocks for various fields of theoretical physics such as condensed matter theory, statistical mechanics, quantum information, and quantum gravity. This review provides a…

Statistical Mechanics · Physics 2022-05-10 Kouichi Okunishi , Tomotoshi Nishino , Hiroshi Ueda