English
Related papers

Related papers: Tree Tensor Networks for Generative Modeling

200 papers

Decision trees have been widely used as classifiers in many machine learning applications thanks to their lightweight and interpretable decision process. This paper introduces Tree in Tree decision graph (TnT), a framework that extends the…

Machine Learning · Computer Science 2021-11-01 Bingzhao Zhu , Mahsa Shoaran

Data in the form of images or higher-order tensors is ubiquitous in modern deep learning applications. Owing to their inherent high dimensionality, the need for subquadratic layers processing such data is even more pressing than for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Joscha Diehl , Rasheed Ibraheem , Leonard Schmitz , Yue Wu

Deep neural networks (DNNs) and decision trees (DTs) are both state-of-the-art classifiers. DNNs perform well due to their representational learning capabilities, while DTs are computationally efficient as they perform inference along one…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Noam Gottlieb , Michael Werman

While overfitting and, more generally, double descent are ubiquitous in machine learning, increasing the number of parameters of the most widely used tensor network, the matrix product state (MPS), has generally lead to monotonic…

Machine Learning · Computer Science 2022-08-10 Artem Strashko , E. Miles Stoudenmire

We propose a simple connection between matrix quantum mechanics and tensor networks. This allows us to imbue tensor networks with some interesting additional structure. The geometry of the graph describing the tensor network state is…

High Energy Physics - Theory · Physics 2024-07-25 Alexander Frenkel

Recurrent neural networks (RNNs) can learn continuous vector representations of symbolic structures such as sequences and sentences; these representations often exhibit linear regularities (analogies). Such regularities motivate our…

Computation and Language · Computer Science 2019-03-06 R. Thomas McCoy , Tal Linzen , Ewan Dunbar , Paul Smolensky

This work is concerned with tree tensor network operators (TTNOs) for representing quantum Hamiltonians. We first establish a mathematical framework connecting tree topologies with state diagrams. Based on these, we devise an algorithm for…

Quantum Physics · Physics 2024-07-09 Richard M. Milbradt , Qunsheng Huang , Christian B. Mendl

We proposed the tensor-input tree (TT) method for scalar-on-tensor and tensor-on-tensor regression problems. We first address scalar-on-tensor problem by proposing scalar-output regression tree models whose input variable are tensors (i.e.,…

Machine Learning · Computer Science 2025-07-10 Hengrui Luo , Akira Horiguchi , Li Ma

Tree tensor network (TTN) provides an essential theoretical framework for the practical simulation of quantum many-body systems, where the network structure defined by the connectivity of the isometry tensors plays a crucial role in…

Statistical Mechanics · Physics 2023-01-24 Toshiya Hikihara , Hiroshi Ueda , Kouichi Okunishi , Kenji Harada , Tomotoshi Nishino

Sum-product networks (SPNs) represent an emerging class of neural networks with clear probabilistic semantics and superior inference speed over graphical models. This work reveals a strikingly intimate connection between SPNs and tensor…

Machine Learning · Computer Science 2018-11-12 Ching-Yun Ko , Cong Chen , Yuke Zhang , Kim Batselier , Ngai Wong

We demonstrate the use of matrix product state (MPS) models for discriminating quantum data on quantum computers using holographic algorithms, focusing on classifying a translationally invariant quantum state based on $L$ qubits of quantum…

Quantum Physics · Physics 2022-07-13 Michael L. Wall , Paraj Titum , Gregory Quiroz , Michael Foss-Feig , Kaden R. A. Hazzard

We argue and demonstrate that projected entangled-pair states (PEPS) outperform matrix product states significantly for the task of generative modeling of datasets with an intrinsic two-dimensional structure such as images. Our approach…

Quantum Physics · Physics 2022-02-17 Tom Vieijra , Laurens Vanderstraeten , Frank Verstraete

Deep neural networks (NNs) encounter scalability limitations when confronted with a vast array of neurons, thereby constraining their achievable network depth. To address this challenge, we propose an integration of tensor networks (TN)…

Disordered Systems and Neural Networks · Physics 2024-08-20 Saeed S. Jahromi , Roman Orus

We introduce complex-valued tensor network models for sequence processing motivated by correspondence to probabilistic graphical models, interpretability and resource compression. Inductive bias is introduced to our models via network…

Quantum Physics · Physics 2023-08-16 Carys Harvey , Richie Yeung , Konstantinos Meichanetzidis

This research introduces an improved framework for constructing matrix product operators (MPOs) and tree tensor network operators (TTNOs), crucial tools in quantum simulations. A given (Hamiltonian) operator typically has a known symbolic…

Quantum Physics · Physics 2025-07-04 Hazar Çakır , Richard M. Milbradt , Christian B. Mendl

An augmented tree tensor network (aTTN) is a tensor network ansatz constructed by applying a layer of unitary disentanglers to a tree tensor network. The disentanglers absorb a part of the system's entanglement. This makes aTTNs suitable…

Quantum Physics · Physics 2025-07-30 Nora Reinić , Luka Pavešić , Daniel Jaschke , Simone Montangero

Neural Tensor Networks (NTNs), which are structured to encode the degree of relationship among pairs of entities, are used in Logic Tensor Networks (LTNs) to facilitate Statistical Relational Learning (SRL) in first-order logic. In this…

Machine Learning · Computer Science 2020-10-07 Jinyung Hong , Theodore P. Pavlic

Multilayer perceptrons (MLP), or fully connected artificial neural networks, are known for performing vector-matrix multiplications using learnable weight matrices; however, their practical application in many machine learning tasks,…

Machine Learning · Computer Science 2025-04-22 Mehmet Yamaç , Muhammad Numan Yousaf , Serkan Kiranyaz , Moncef Gabbouj

The interplay of quantum and classical simulation and the delicate divide between them is in the focus of massively parallelized tensor network state (TNS) algorithms designed for high performance computing (HPC). In this contribution, we…

Quantum Physics · Physics 2023-05-10 Andor Menczer , Örs Legeza

Recurrent neural networks (RNNs) are powerful tools for sequential modeling, but typically require significant overparameterization and regularization to achieve optimal performance. This leads to difficulties in the deployment of large…

Machine Learning · Computer Science 2021-11-11 Charles C. Onu , Jacob E. Miller , Doina Precup