English
Related papers

Related papers: Global optimization of tensor renormalization grou…

200 papers

We propose tensorial neural networks (TNNs), a generalization of existing neural networks by extending tensor operations on low order operands to those on high order ones. The problem of parameter learning is challenging, as it corresponds…

Machine Learning · Statistics 2018-12-11 Jiahao Su , Jingling Li , Bobby Bhattacharjee , Furong Huang

Tensor networks have demonstrated significant value for machine learning in a myriad of different applications. However, optimizing tensor networks using standard gradient descent has proven to be difficult in practice. Tensor networks…

Machine Learning · Computer Science 2022-03-08 Fergus Barratt , James Dborin , Lewis Wright

Weight optimization of frame structures with continuous cross-section parametrization is a challenging non-convex problem that has traditionally been solved by local optimization techniques. Here, we exploit its inherent semi-algebraic…

Optimization and Control · Mathematics 2025-01-29 Marek Tyburec , Michal Kočvara , Martin Kružík

Tensor networks are powerful factorization techniques which reduce resource requirements for numerically simulating principal quantum many-body systems and algorithms. The computational complexity of a tensor network simulation depends on…

Data Structures and Algorithms · Computer Science 2019-03-06 Eugene F. Dumitrescu , Allison L. Fisher , Timothy D. Goodrich , Travis S. Humble , Blair D. Sullivan , Andrew L. Wright

We study two-dimensional ferromagnetic Ising model on a series of regular lattices, which are represented as the tessellation of polygons with p>=5 sides, such as pentagons (p=5), hexagons (p=6), etc. Such lattices are on hyperbolic planes,…

Statistical Mechanics · Physics 2008-03-31 Roman Krcmar , Andrej Gendiar , Kouji Ueda , Tomotoshi Nishino

Using a recently proposed new renormalization group method (tensor renormalization group), we analyze the Ising model on the 2-dimensional square lattice. For the lowest order approximation with two domain wall states, it realizes the idea…

Statistical Mechanics · Physics 2015-05-30 Ken-Ichi Aoki , Tamao Kobayashi , Hiroshi Tomita

The global optimization of atomic clusters represents a fundamental challenge in computational chemistry and materials science due to the exponential growth of local minima with system size (i.e., the curse of dimensionality). We introduce…

One of the major optimizations employed in deep learning frameworks is graph rewriting. Production frameworks rely on heuristics to decide if rewrite rules should be applied and in which order. Prior research has shown that one can discover…

Artificial Intelligence · Computer Science 2021-03-18 Yichen Yang , Phitchaya Mangpo Phothilimtha , Yisu Remy Wang , Max Willsey , Sudip Roy , Jacques Pienaar

We propose a method to construct the initial tensor representation of partition functions and observables for the tensor renormalization group (TRG). The TRG is a numerical calculation technique that utilizes a tensor network…

High Energy Physics - Lattice · Physics 2025-01-22 Katsumasa Nakayama , Manuel Schneider

Quantum computers are expected to enable fast solving of large-scale combinatorial optimization problems. However, their limitations in fidelity and the number of qubits prevent them from handling real-world problems. Recently, a…

Statistical Mechanics · Physics 2025-07-23 Hyakka Nakada , Kotaro Tanahashi , Shu Tanaka

The renormalization group method is employed to study the effective potential in curved spacetime with torsion. The renormalization-group improved effective potential corresponding to a massless gauge theory in such a spacetime is found and…

High Energy Physics - Theory · Physics 2009-09-17 A. A. Bytsenko , E. Elizalde , S. D. Odintsov

The optimization algorithms for solving multi-parameter inverse problem for the mathematical model of parabolic equations arising in social networks, epidemiology and economy are investigated. The data fitting is formulated as optimization…

Optimization and Control · Mathematics 2019-06-13 Kabanikhin Sergey , Krivorotko Olga , Zhang Shuhua , Kashtanova Victoriya , Wang Yufang

We introduce efficient solutions to optimize the cost of tree-like tensor network state method calculations when an expensive GPU-accelerated hardware is utilized. By supporting a main powerful compute node with additional auxiliary, but…

Computational Physics · Physics 2024-12-09 Andor Menczer , Örs Legeza

Metasurfaces are subwavelength-structured artificial media that can shape and localize electromagnetic waves in unique ways. The inverse design of these devices is a non-convex optimization problem in a high dimensional space, making global…

Computational Physics · Physics 2019-11-22 Jiaqi Jiang , Jonathan A. Fan

Tensor network methods are powerful and efficient tools to study the properties and dynamics of statistical and quantum systems, in particular in one and two dimensions. In recent years, these methods were applied to lattice gauge theories,…

High Energy Physics - Theory · Physics 2020-02-28 William J. Cunningham , Bianca Dittrich , Sebastian Steinhaus

Tensor diagonalization means transforming a given tensor to an exactly or nearly diagonal form through multiplying the tensor by non-orthogonal invertible matrices along selected dimensions of the tensor. It is generalization of approximate…

Numerical Analysis · Computer Science 2016-07-04 Petr Tichavsky , Anh Huy Phan , Andrzej Cichocki

Higher-order low-rank tensors naturally arise in many applications including hyperspectral data recovery, video inpainting, seismic data recon- struction, and so on. We propose a new model to recover a low-rank tensor by simultaneously…

Numerical Analysis · Computer Science 2015-07-07 Yangyang Xu , Ruru Hao , Wotao Yin , Zhixun Su

The paper provides global optimization algorithms for two particularly difficult nonconvex problems raised by hybrid system identification: switching linear regression and bounded-error estimation. While most works focus on local…

Machine Learning · Computer Science 2017-11-27 Fabien Lauer

Multiple Tensor-Times-Matrix (Multi-TTM) is a key computation in algorithms for computing and operating with the Tucker tensor decomposition, which is frequently used in multidimensional data analysis. We establish communication lower…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-03 Hussam Al Daas , Grey Ballard , Laura Grigori , Suraj Kumar , Kathryn Rouse

On the lattice, a renormalization group (RG) flow for two-dimensional partition functions expressed as a tensor network can be obtained using the tensor network renormalization (TNR) algorithm [G. Evenbly, G. Vidal, Phys. Rev. Lett. 115…

High Energy Physics - Theory · Physics 2018-09-17 Qi Hu , Adrian Franco-Rubio , Guifre Vidal