English
Related papers

Related papers: Decomposing Textual Information For Style Transfer

200 papers

Learning visual representations with interpretable features, i.e., disentangled representations, remains a challenging problem. Existing methods demonstrate some success but are hard to apply to large-scale vision datasets like ImageNet. In…

Machine Learning · Computer Science 2023-06-01 Lilian Ngweta , Subha Maity , Alex Gittens , Yuekai Sun , Mikhail Yurochkin

Recently, style transfer has received a lot of attention. While much of this research has aimed at speeding up processing, the approaches are still lacking from a principled, art historical standpoint: a style is more than just a single…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Artsiom Sanakoyeu , Dmytro Kotovenko , Sabine Lang , Björn Ommer

In this paper, we introduce a new perspective for improving image restoration by removing degradation in the textual representations of a given degraded image. Intuitively, restoration is much easier on text modality than image one. For…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Jingbo Lin , Zhilu Zhang , Yuxiang Wei , Dongwei Ren , Dongsheng Jiang , Wangmeng Zuo

In this work we propose a photorealistic style transfer method for image and video that is based on vision science principles and on a recent mathematical formulation for the deterministic decoupling of sample statistics. The novel aspects…

Image and Video Processing · Electrical Eng. & Systems 2023-04-11 Trevor D. Canham , Adrián Martín , Marcelo Bertalmío , Javier Portilla

Human motion data is inherently rich and complex, containing both semantic content and subtle stylistic features that are challenging to model. We propose a novel method for effective disentanglement of the style and content in human motion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fatemeh Zargarbashi , Dhruv Agrawal , Jakob Buhmann , Martin Guay , Stelian Coros , Robert W. Sumner

The curse of knowledge can impede communication between experts and laymen. We propose a new task of expertise style transfer and contribute a manually annotated dataset with the goal of alleviating such cognitive biases. Solving this task…

Computation and Language · Computer Science 2020-05-05 Yixin Cao , Ruihao Shui , Liangming Pan , Min-Yen Kan , Zhiyuan Liu , Tat-Seng Chua

An ongoing debate in the NLG community concerns the best way to evaluate systems, with human evaluation often being considered the most reliable method, compared to corpus-based metrics. However, tasks involving subtle textual differences,…

Computation and Language · Computer Science 2021-01-06 Lorenzo De Mattei , Michele Cafagna , Huiyuan Lai , Felice Dell'Orletta , Malvina Nissim , Albert Gatt

In this paper, we focus on a new practical task, document-scale text content manipulation, which is the opposite of text style transfer and aims to preserve text styles while altering the content. In detail, the input is a set of structured…

Computation and Language · Computer Science 2020-02-25 Xiaocheng Feng , Yawei Sun , Bing Qin , Heng Gong , Yibo Sun , Wei Bi , Xiaojiang Liu , Ting Liu

Style transfer aims to combine the content of one image with the artistic style of another. It was discovered that lower levels of convolutional networks captured style information, while higher levels captures content information. The…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Michael Maring , Kaustav Chakraborty

Images can be viewed as layered compositions, foreground objects over background, with potential occlusions. This layered representation enables independent editing of elements, offering greater flexibility for content creation. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jingxi Chen , Yixiao Zhang , Xiaoye Qian , Zongxia Li , Cornelia Fermuller , Caren Chen , Yiannis Aloimonos

This paper creates a novel method of deep neural style transfer by generating style images from freeform user text input. The language model and style transfer model form a seamless pipeline that can create output images with similar losses…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Tejas Santanam , Mengyang Liu , Jiangyue Yu , Zhaodong Yang

Our research extends the Bilingual Evaluation Understudy (BLEU) evaluation technique for statistical machine translation to make it more adjustable and robust. We intend to adapt it to resemble human evaluation more. We perform experiments…

Computation and Language · Computer Science 2015-10-01 Krzysztof Wołk , Krzysztof Marasek

How can we learn, transfer and extract handwriting styles using deep neural networks? This paper explores these questions using a deep conditioned autoencoder on the IRON-OFF handwriting data-set. We perform three experiments that…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Omar Mohammed , Gerard Bailly , Damien Pellier

In this paper, we present a method for adversarial decomposition of text representation. This method can be used to decompose a representation of an input sentence into several independent vectors, each of them responsible for a specific…

Computation and Language · Computer Science 2019-04-11 Alexey Romanov , Anna Rumshisky , Anna Rogers , David Donahue

Image compression is a fundamental technology for Internet communication engineering. However, a high compression rate with general methods may degrade images, resulting in unreadable texts. In this paper, we propose an image compression…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Shohei Uchigasaki , Tomo Miyazaki , Shinichiro Omachi

Text style transfer is the task that generates a sentence by preserving the content of the input sentence and transferring the style. Most existing studies are progressing on non-parallel datasets because parallel datasets are limited and…

Computation and Language · Computer Science 2020-11-30 Joosung Lee

Attribute-controlled text rewriting, also known as text style-transfer, has a crucial role in regulating attributes and biases of textual training data and a machine generated text. In this work we present SimpleStyle, a minimalist yet…

Computation and Language · Computer Science 2022-12-23 Elron Bandel , Yoav Katz , Noam Slonim , Liat Ein-Dor

Text-to-image diffusion models have demonstrated an unparalleled ability to generate high-quality, diverse images from a textual prompt. However, the internal representations learned by these models remain an enigma. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Hila Chefer , Oran Lang , Mor Geva , Volodymyr Polosukhin , Assaf Shocher , Michal Irani , Inbar Mosseri , Lior Wolf

Inspired by recent work on compression with and for young humans, the success of transform-based approaches to information processing, and the rise of powerful language-based AI, we propose \emph{textual transform coding}. It shares some of…

Information Theory · Computer Science 2023-05-04 Tsachy Weissman

We investigate the task of retrieving information from compositional distributed representations formed by Hyperdimensional Computing/Vector Symbolic Architectures and present novel techniques which achieve new information rate bounds.…

Neural and Evolutionary Computing · Computer Science 2023-05-29 Denis Kleyko , Connor Bybee , Ping-Chen Huang , Christopher J. Kymn , Bruno A. Olshausen , E. Paxon Frady , Friedrich T. Sommer