Related papers: Holography Transformer
Recently it has been proposed that the Bekenstein-Hawking formula for the entropy of spacetime horizons has a larger significance as the leading contribution to the entanglement entropy of general spacetime regions, in the underlying…
Transform and entropy models are the two core components in deep image compression neural networks. Most existing learning-based image compression methods utilize convolutional-based transform, which lacks the ability to model long-range…
This dissertation reviews several recent advances at the intersection of quantum information and holography. In holography, properties of quantum systems admit a gravitational interpretation via the AdS/CFT correspondence. For holographic…
The holographic duality relates a field theory to a theory of (quantum) gravity in one dimension more. The extra dimension represents the scale of the RG transformation in the field theory. It has been conjectured that the tensor networks…
Entity alignment is the task of linking entities with the same real-world identity from different knowledge graphs (KGs), which has been recently dominated by embedding-based methods. Such approaches work by learning KG representations so…
Sentence matching is a fundamental task of natural language processing with various applications. Most recent approaches adopt attention-based neural models to build word- or phrase-level alignment between two sentences. However, these…
The modeling of high-dimensional spatio-temporal processes presents a fundamental dichotomy between the probabilistic rigor of classical geostatistics and the flexible, high-capacity representations of deep learning. While Gaussian…
We propose a novel transformer-based styled handwritten text image generation approach, HWT, that strives to learn both style-content entanglement as well as global and local writing style patterns. The proposed HWT captures the long and…
Transformer, based on the encoder-decoder framework, has achieved state-of-the-art performance on several natural language generation tasks. The encoder maps the words in the input sentence into a sequence of hidden states, which are then…
Most pretrained language models rely on subword tokenization, which processes text as a sequence of subword tokens. However, different granularities of text, such as characters, subwords, and words, can contain different kinds of…
Prior methods for controlling image generation are limited in their ability to be taught new tasks. In contrast, vision-language models, or VLMs, can learn tasks in-context and produce the correct outputs for a given input. We propose a…
A minimal requirement for any strongly coupled gauge field theory to have a classical dual bulk gravity description is that one should in principle be able to recover the full geometry as encoded on the asymptotics of the spacetime. Even…
Image synthesis is a core problem in modern deep learning, and many recent architectures such as autoencoders and Generative Adversarial networks produce spectacular results on highly complex data, such as images of faces or landscapes.…
This paper describes the design and implementation of a new machine learning model for online learning systems. We aim at improving the intelligent level of the systems by enabling an automated math word problem solver which can support a…
Recently, the reflected entropy is proposed in holographic approach to describe the entanglement of a bipartite quantum system in a mixed state, which is identified as the area of the reflected minimal surface inside the entanglement wedge.…
We investigate the holographic entanglement entropy (HEE) of a strip geometry in four dimensional Q-lattice backgrounds, which exhibit metal-insulator transitions in the dual field theory. Remarkably, we find that the HEE always displays a…
We construct a family of holographic duals to anisotropic states in a strongly coupled gauge theory. On the field theory side the anisotropy is generated by giving a vacuum expectation value to a dimension three operator. We obtain our…
We study holographic entanglement entropy in spatially anisotropic field theory. We observe that for the background we consider in this paper, to a good approximation, the holographic entanglement entropy can be decomposed into two terms.…
We study holographic entanglement entropy for certain logarithmic conformal field theories by making use of their gravity descriptions. The corresponding gravity descriptions are provided by higher derivative gravity at critical points…
We present a deep generative model of bilingual sentence pairs for machine translation. The model generates source and target sentences jointly from a shared latent representation and is parameterised by neural networks. We perform…