English
Related papers

Related papers: STN-GPR: A Singularity Tensor Network Framework fo…

200 papers

Hyperparameter optimization (HPO) is a central pillar in the automation of machine learning solutions and is mainly performed via Bayesian optimization, where a parametric surrogate is learned to approximate the black box response function…

Machine Learning · Computer Science 2021-01-20 Martin Wistuba , Josif Grabocka

As an emerging network model, spiking neural networks (SNNs) have aroused significant research attentions in recent years. However, the energy-efficient binary spikes do not augur well with gradient descent-based training approaches.…

Machine Learning · Computer Science 2023-04-27 Siqi Wang , Tee Hiang Cheng , Meng-Hiot Lim

Gaussian process regression (GPR) is a powerful machine learning method which has recently enjoyed wider use, in particular in physical sciences. In its original formulation, GPR uses a square matrix of covariances among training data and…

Numerical Analysis · Mathematics 2023-09-08 Sergei Manzhos , Manabu Ihara

Low-rank tensor completion aims to recover a tensor from partially observed entries, and it is widely applicable in fields such as quantum computing and image processing. Due to the significant advantages of the tensor train (TT) format in…

Machine Learning · Computer Science 2025-01-24 Fengmiao Bian , Jian-Feng Cai , Xiaoqun Zhang , Yuanwei Zhang

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

This paper proposes a novel formulation of the tensor completion problem to impute missing entries of data represented by tensors. The formulation is introduced in terms of tensor train (TT) rank which can effectively capture global…

Numerical Analysis · Computer Science 2016-01-07 Ho N. Phien , Hoang D. Tuan , Johann A. Bengua , Minh N. Do

We are interested in building low-dimensional surrogate models to reduce optimization costs, while having theoretical guarantees that the optimum will satisfy the constraints of the full-size model, by making conservative approximations.…

Numerical Analysis · Mathematics 2025-11-12 Philippe-André Luneau

With the explosive deployment of non-terrestrial networks (NTNs), the computational complexity of network performance analysis is rapidly escalating. As one of the most suitable mathematical tools for analyzing large-scale network…

Networking and Internet Architecture · Computer Science 2025-08-07 Ruibo Wang , Baha Eddine Youcef Belmekki , Howard H. Yang , Mohamed Slim Alouini

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems.…

Machine Learning · Computer Science 2024-01-31 Tao Wen , Elynn Chen , Yuzhou Chen

Risk assessment and in particular derivatives pricing is one of the core areas in computational finance and accounts for a sizeable fraction of the global computing resources of the financial industry. We outline a quantum-inspired…

Quantum Physics · Physics 2022-03-08 Michael Kastoryano , Nicola Pancotti

We propose a tensor neural network ($t$-NN) framework that offers an exciting new paradigm for designing neural networks with multidimensional (tensor) data. Our network architecture is based on the $t$-product (Kilmer and Martin, 2011), an…

Machine Learning · Computer Science 2018-11-19 Elizabeth Newman , Lior Horesh , Haim Avron , Misha Kilmer

An increasing amount of collected data are high-dimensional multi-way arrays (tensors), and it is crucial for efficient learning algorithms to exploit this tensorial structure as much as possible. The ever-present curse of dimensionality…

Machine Learning · Computer Science 2021-08-04 Kirandeep Kour , Sergey Dolgov , Martin Stoll , Peter Benner

We propose a hybrid stochastic method for the tensor renormalization group (TRG) approach. TRG is known as a powerful tool to study the many-body systems and quantum field theory on the lattice. It is based on a low-rank approximation of…

High Energy Physics - Lattice · Physics 2021-10-25 Hiroshi Ohki , Erika Arai , Masaaki Tomii

We introduce a learning-based framework to optimize tensor programs for deep learning workloads. Efficient implementations of tensor operators, such as matrix multiplication and high dimensional convolution, are key enablers of effective…

Machine Learning · Computer Science 2019-01-10 Tianqi Chen , Lianmin Zheng , Eddie Yan , Ziheng Jiang , Thierry Moreau , Luis Ceze , Carlos Guestrin , Arvind Krishnamurthy

We propose a real-space renormalization group algorithm for accurately coarse-graining two-dimensional tensor networks. The central innovation of our method lies in utilizing variational boundary tensors as a globally optimized environment…

Statistical Mechanics · Physics 2026-03-03 Feng-Feng Song , Naoki Kawashima

This work proposes a novel tensor train random projection (TTRP) method for dimension reduction, where pairwise distances can be approximately preserved. Our TTRP is systematically constructed through a tensor train (TT) representation with…

Machine Learning · Statistics 2021-10-22 Yani Feng , Kejun Tang , Lianxing He , Pingqiang Zhou , Qifeng Liao

Option pricing is a significant problem for option risk management and trading. In this article, we utilize a framework to present financial data from different sources. The data is processed and represented in a form of 2D tensors in three…

Computational Finance · Quantitative Finance 2021-09-24 Muyang Ge , Shen Zhou , Shijun Luo , Boping Tian

We present a systematic study of Tensor Network (TN) models $\unicode{x2013}$ Matrix Product States (MPS) and Tree Tensor Networks (TTN) $\unicode{x2013}$ for real-time jet tagging in high-energy physics, with a focus on low-latency…

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

Tensor network (TN) representation is a powerful technique for computer vision and machine learning. TN structure search (TN-SS) aims to search for a customized structure to achieve a compact representation, which is a challenging NP-hard…

Machine Learning · Computer Science 2024-04-15 Yu-Bang Zheng , Xi-Le Zhao , Junhua Zeng , Chao Li , Qibin Zhao , Heng-Chao Li , Ting-Zhu Huang