English
Related papers

Related papers: Tensor Networks for Probabilistic Sequence Modelin…

200 papers

This is a partly non-technical introduction to selected topics on tensor network methods, based on several lectures and introductory seminars given on the subject. It should be a good place for newcomers to get familiarized with some of the…

Strongly Correlated Electrons · Physics 2014-07-07 Roman Orus

The Recurrent Neural Networks and their variants have shown promising performances in sequence modeling tasks such as Natural Language Processing. These models, however, turn out to be impractical and difficult to train when exposed to very…

Computer Vision and Pattern Recognition · Computer Science 2017-07-07 Yinchong Yang , Denis Krompass , Volker Tresp

Once developed for quantum theory, tensor networks have been established as a successful machine learning paradigm. Now, they have been ported back to the quantum realm in the emerging field of quantum machine learning to assess problems…

Quantum Physics · Physics 2023-08-09 Hans-Martin Rieser , Frank Köster , Arne Peter Raulf

Tensor networks such as matrix product states (MPS) and projected entangled pair states (PEPS) are commonly used to approximate quantum systems. These networks are optimized in methods such as DMRG or evolved by local operators. We provide…

Numerical Analysis · Mathematics 2020-01-07 Yifan Zhang , Edgar Solomonik

Originating from condensed matter physics, tensor networks are compact representations of high-dimensional tensors. In this paper, the prowess of tensor networks is demonstrated on the particular task of one-class anomaly detection. We…

Machine Learning · Computer Science 2020-06-18 Jinhui Wang , Chase Roberts , Guifre Vidal , Stefan Leichenauer

A deep neural network is a parametrization of a multilayer mapping of signals in terms of many alternatively arranged linear and nonlinear transformations. The linear transformations, which are generally used in the fully connected as well…

Machine Learning · Computer Science 2020-07-01 Ze-Feng Gao , Song Cheng , Rong-Qiang He , Z. Y. Xie , Hui-Hai Zhao , Zhong-Yi Lu , Tao Xiang

Tensor networks establish an adaptable framework for the emulation of quantum circuits. By partitioning exponentially large registers and gates into smaller tensors, this unlocks fast transformations through tensor algebra, and grants fine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-13 Jakub Adamski , Oliver Thomson Brown

Recurrent neural networks (RNN) such as long-short-term memory (LSTM) networks are essential in a multitude of daily live tasks such as speech, language, video, and multimodal learning. The shift from cloud to edge computation intensifies…

Machine Learning · Computer Science 2020-06-11 Alejandro Murua , Ramchalam Ramakrishnan , Xinlin Li , Rui Heng Yang , Vahid Partovi Nia

Tensor Network States are ans\"atze for the efficient description of quantum many-body systems. Their success for one dimensional problems, together with the fact that they do not suffer from the sign problem and can address the simulation…

High Energy Physics - Lattice · Physics 2022-09-21 Mari Carmen Bañuls , Krzysztof Cichy , J. Ignacio Cirac , Karl Jansen , Stefan Kühn

Casting neural networks in generative frameworks is a highly sought-after endeavor these days. Contemporary methods, such as Generative Adversarial Networks, capture some of the generative capabilities, but not all. In particular, they lack…

Machine Learning · Computer Science 2018-03-28 Or Sharir , Ronen Tamari , Nadav Cohen , Amnon Shashua

Tensor networks are generated by a set of small rank tensors and define many-body quantum states in a succinct form. The corresponding map is not one-to-one: different sets of tensors may generate the very same state. A fundamental question…

Strongly Correlated Electrons · Physics 2018-11-27 Andras Molnar , José Garre-Rubio , David Pérez-García , Norbert Schuch , J. Ignacio Cirac

We present an algorithm for supervised learning using tensor networks, employing a step of preprocessing the data by coarse-graining through a sequence of wavelet transformations. We represent these transformations as a set of tensor…

Machine Learning · Statistics 2020-01-24 Justin Reyes , Miles Stoudenmire

In recent years, interest in expressing the success of neural networks to the quantum computing has increased significantly. Tensor network theory has become increasingly popular and widely used to simulate strongly entangled correlated…

Quantum Physics · Physics 2019-05-07 Amandeep Singh Bhatia , Mandeep Kaur Saggi , Ajay Kumar , Sushma Jain

Probabilistic inference is a fundamental task in modern machine learning. Recent advances in tensor network (TN) contraction algorithms have enabled the development of better exact inference methods. However, many common inference tasks in…

Machine Learning · Computer Science 2024-09-10 Martin Roa-Villescas , Xuanzhao Gao , Sander Stuijk , Henk Corporaal , Jin-Guo Liu

Tensor methods have become a promising tool to solve high-dimensional problems in the big data era. By exploiting possible low-rank tensor factorization, many high-dimensional model-based or data-driven problems can be solved to facilitate…

Optimization and Control · Mathematics 2019-08-22 Chunfeng Cui , Cole Hawkins , Zheng Zhang

Probabilistic graphical models (PGMs) are widely used to discover latent structure in data, but their success hinges on selecting an appropriate model design. In practice, model specification is difficult and often requires iterative…

Machine Learning · Computer Science 2026-04-08 Kevin Zhang , Yixin Wang

Matrix models, as quantum mechanical systems without explicit spatial dependence, provide valuable insights into higher-dimensional gauge and gravitational theories, especially within the framework of string theory, where they can describe…

High Energy Physics - Theory · Physics 2024-12-06 Enrico M. Brehm , Yibin Guo , Karl Jansen , Enrico Rinaldi

Efficient probability density estimation is a core challenge in statistical machine learning. Tensor-based probabilistic graph methods address interpretability and stability concerns encountered in neural network approaches. However, a…

Machine Learning · Computer Science 2023-12-14 Ruituo Wu , Jiani Liu , Ce Zhu , Anh-Huy Phan , Ivan V. Oseledets , Yipeng Liu

We present a tensorization algorithm for constructing tensor train/matrix product state (MPS) representations of functions, drawing on sketching and cross interpolation ideas. The method only requires black-box access to the target function…

Numerical Analysis · Mathematics 2026-01-21 José Ramón Pareja Monturiol , Alejandro Pozas-Kerstjens , David Pérez-García

Active inference provides a general framework for behavior and learning in autonomous agents. It states that an agent will attempt to minimize its variational free energy, defined in terms of beliefs over observations, internal states and…

Machine Learning · Computer Science 2022-09-12 Samuel T. Wauthier , Bram Vanhecke , Tim Verbelen , Bart Dhoedt