English
Related papers

Related papers: Accelerating two-dimensional tensor network contra…

200 papers

The fully-connected tensor network (FCTN) decomposition has gained prominence in the field of tensor completion owing to its powerful capacity to capture the low-rank characteristics of tensors. Nevertheless, the recovery of local details…

Numerical Analysis · Mathematics 2025-10-28 Wenchao Xie , Qingsong Wang , Chengcheng Yan , Zheng Peng

The interplay of quantum and classical simulation and the delicate divide between them is in the focus of massively parallelized tensor network state (TNS) algorithms designed for high performance computing (HPC). In this contribution, we…

Quantum Physics · Physics 2023-05-10 Andor Menczer , Örs Legeza

Network alignment is useful for multiple applications that require increasingly large graphs to be processed. Existing research approaches this as an optimization problem or computes the similarity based on node representations. However,…

Social and Information Networks · Computer Science 2020-08-03 Kyle K. Qin , Flora D. Salim , Yongli Ren , Wei Shao , Mark Heimann , Danai Koutra

We introduce tensor network contraction algorithms for counting satisfying assignments of constraint satisfaction problems (#CSPs). We represent each arbitrary #CSP formula as a tensor network, whose full contraction yields the number of…

Statistical Mechanics · Physics 2019-11-14 Stefanos Kourtis , Claudio Chamon , Eduardo R. Mucciolo , Andrei E. Ruckenstein

Recommendation systems, social network analysis, medical imaging, and data mining often involve processing sparse high-dimensional data. Such high-dimensional data are naturally represented as tensors, and they cannot be efficiently…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-22 Weiyun Jiang , Kaiqi Zhang , Colin Yu Lin , Feng Xing , Zheng Zhang

The canonical polyadic (CP) decomposition is one of the most widely used tensor decomposition techniques. The conventional CP decomposition algorithm combines alternating least squares (ALS) with the normal equation. However, the normal…

Numerical Analysis · Mathematics 2025-10-28 Wenchao Xie , Jiawei Xu , Zheng Peng , Qingsong Wang

Tensor network contraction on arbitrary graphs is a fundamental computational challenge with applications ranging from quantum simulation to error correction. While belief propagation (BP) provides a powerful approximation algorithm for…

Quantum Physics · Physics 2025-10-28 Siddhant Midha , Yifan F. Zhang

Many of today's deep neural network accelerators, e.g., Google's TPU and NVIDIA's tensor core, are built around accelerating the general matrix multiplication (i.e., GEMM). However, supporting convolution on GEMM-based accelerators is not…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-11 Yangjie Zhou , Mengtian Yang , Cong Guo , Jingwen Leng , Yun Liang , Quan Chen , Minyi Guo , Yuhao Zhu

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…

Machine Learning · Computer Science 2019-05-28 Cole Hawkins , Zheng Zhang

Simulating strongly-correlated quantum many-body systems at finite temperatures is a significant challenge in computational physics. In this work, we present a scalable finite-temperature tensor network algorithm for two-dimensional quantum…

Strongly Correlated Electrons · Physics 2024-09-10 Meng Zhang , Hao Zhang , Chao Wang , Lixin He

We propose an algorithm to convert a projected entangled pair state (PEPS) into a canonical form, analogous to the well-known canonical form of a matrix product state. Our approach is based on a variational gauging ansatz for the QR tensor…

Strongly Correlated Electrons · Physics 2019-08-15 R. Haghshenas , Matthew J. O'Rourke , Garnet Kin-Lic Chan

The necessary decarbonization efforts in energy sectors entail the integration of flexibility assets, as well as increased levels of uncertainty for the planning and operation of power systems. To cope with this in a cost-effective manner,…

Systems and Control · Electrical Eng. & Systems 2024-09-25 Stefan Borozan , Spyros Giannelos , Paola Falugi , Alexandre Moreira , Goran Strbac

The inference and training stages of Graph Neural Networks (GNNs) are often dominated by the time required to compute a long sequence of matrix multiplications between the sparse graph adjacency matrix and its embedding. To accelerate these…

Data Structures and Algorithms · Computer Science 2024-09-05 João N. F. Alves , Samir Moustafa , Siegfried Benkner , Alexandre P. Francisco , Wilfried N. Gansterer , Luís M. S. Russo

Tensor contractions are ubiquitous in computational chemistry and physics, where tensors generally represent states or operators and contractions express the algebra of these quantities. In this context, the states and operators often…

Computational Physics · Physics 2022-09-27 Yang Gao , Phillip Helms , Garnet Kin-Lic Chan , Edgar Solomonik

We extend the celebrated QR algorithm for matrices to symmetric tensors. The algorithm, named QR algorithm for symmetric tensors (QRST), exhibits similar properties to its matrix version, and allows the derivation of a shifted…

Numerical Analysis · Mathematics 2014-11-10 Kim Batselier , Ngai Wong

Despite foreseeing tremendous speedups over conventional deep neural networks, the performance advantage of binarized neural networks (BNNs) has merely been showcased on general-purpose processors such as CPUs and GPUs. In fact, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-16 Ang Li , Simon Su

We tackle the problem of graph partitioning for image segmentation using correlation clustering (CC), which we treat as an integer linear program (ILP). We reformulate optimization in the ILP so as to admit efficient optimization via…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Margret Keuper , Jovita Lukasik , Maneesh Singh , Julian Yarkony

Convolutional Neural Networks (CNNs) have demonstrated great results for the single-image super-resolution (SISR) problem. Currently, most CNN algorithms promote deep and computationally expensive models to solve SISR. However, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Vandit Jain , Prakhar Bansal , Abhinav Kumar Singh , Rajeev Srivastava

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

This paper proposes a deep Convolutional Neural Network(CNN) with strong generalization ability for structural topology optimization. The architecture of the neural network is made up of encoding and decoding parts, which provide down- and…

Machine Learning · Computer Science 2020-04-01 Yiquan Zhang , Bo Peng , Xiaoyi Zhou , Cheng Xiang , Dalei Wang