English
Related papers

Related papers: Semantics-Preserving Sketch Embedding for Face Gen…

200 papers

Reference-based sketch colorization methods have garnered significant attention for the potential application in animation and digital illustration production. However, most existing methods are trained with image triplets of sketch,…

Graphics · Computer Science 2025-08-26 Dingkun Yan , Xinrui Wang , Zhuoru Li , Suguru Saito , Yusuke Iwasawa , Yutaka Matsuo , Jiaxian Guo

In this paper, we study learning semantic representations for million-scale free-hand sketches. This is highly challenging due to the domain-unique traits of sketches, e.g., diverse, sparse, abstract, noisy. We propose a dual-branch CNNRNN…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Peng Xu , Yongye Huang , Tongtong Yuan , Tao Xiang , Timothy M. Hospedales , Yi-Zhe Song , Liang Wang

Considering the existence of very large amount of available data repositories and reach to the very advanced system of hardware, systems meant for facial identification ave evolved enormously over the past few decades. Sketch recognition is…

Machine Learning · Computer Science 2019-11-20 Sukhada Chokkadi , Sannidhan M S , Sudeepa K B , Abhir Bhandary

Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to computer animation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Ayush Tewari , Mohamed Elgharib , Mallikarjun B R. , Florian Bernard , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Sketch-based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in…

Graphics · Computer Science 2023-09-13 Jie Zhou , Zhongjin Luo , Qian Yu , Xiaoguang Han , Hongbo Fu

Generating sketches guided by reference styles requires precise transfer of stroke attributes, such as line thickness, deformation, and texture sparsity, while preserving semantic structure and content fidelity. To this end, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Rui Yang , Huining Li , Yiyi Long , Xiaojun Wu , Shengfeng He

We introduce a novel approach that takes a single semantic mask as input to synthesize multi-view consistent color images of natural scenes, trained with a collection of single images from the Internet. Prior works on 3D-aware image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Tianrun Chen , Linzhan Mou , Haotong Lin , Kaicheng Yu , Yiyi Liao , Xiaowei Zhou

We introduce a novel problem of scene sketch zero-shot learning (SSZSL), which is a challenging task, since (i) different from photo, the gap between common semantic domain (e.g., word vector) and sketch is too huge to exploit common…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yao Xie , Peng Xu , Zhanyu Ma

Contextual embeddings represent a new generation of semantic representations learned from Neural Language Modelling (NLM) that addresses the issue of meaning conflation hampering traditional word embeddings. In this work, we show that…

Computation and Language · Computer Science 2019-06-25 Daniel Loureiro , Alipio Jorge

Images with visual and scene text content are ubiquitous in everyday life. However, current image interpretation systems are mostly limited to using only the visual features, neglecting to leverage the scene text content. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Arka Ujjal Dey , Suman Kumar Ghosh , Ernest Valveny , Gaurav Harit

Interactive computer vision (CV) plays a crucial role in various real-world applications, whose performance is highly dependent on communication networks. Nonetheless, the data-oriented characteristics of conventional communications often…

Information Theory · Computer Science 2026-03-30 Bin Chen , Wenbo Yu , Qinshan Zhang , Tianqu Zhuang , Hao Wu , Yong Jiang , Shu-Tao Xia

Faces generated using generative adversarial networks (GANs) have reached unprecedented realism. These faces, also known as "Deep Fakes", appear as realistic photographs with very little pixel-level distortions. While some work has enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Manan Oza , Sukalpa Chanda , David Doermann

The requirement of large amounts of annotated images has become one grand challenge while training deep neural network models for various visual detection and recognition tasks. This paper presents a novel image synthesis technique that…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Fangneng Zhan , Shijian Lu , Chuhui Xue

We propose a method for scene-level sketch-to-photo synthesis with text guidance. Although object-level sketch-to-photo synthesis has been widely studied, whole-scene synthesis is still challenging without reference photos that adequately…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 AprilPyone MaungMaung , Makoto Shing , Kentaro Mitsui , Kei Sawada , Fumio Okura

Editing facial expressions by only changing what we want is a long-standing research problem in Generative Adversarial Networks (GANs) for image manipulation. Most of the existing methods that rely only on a global generator usually suffer…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Rumeysa Bodur , Binod Bhattarai , Tae-Kyun Kim

Compression artifacts from standard video codecs often degrade perceptual quality. We propose a lightweight, semantic-aware pre-processing framework that enhances perceptual fidelity by selectively addressing these distortions. Our method…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Han-Yu Lin , Li-Wei Chen , Hung-Shin Lee

Visual generative models based on latent space have achieved great success, underscoring the significance of visual tokenization. Mapping images to latents boosts efficiency and enables multimodal alignment for scaling up in downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yunpeng Qu , Kaidong Zhang , Yukang Ding , Ying Chen , Jian Wang

The research topic of sketch-to-portrait generation has witnessed a boost of progress with deep learning techniques. The recently proposed StyleGAN architectures achieve state-of-the-art generation ability but the original StyleGAN is not…

Graphics · Computer Science 2022-06-01 Wanchao Su , Hui Ye , Shu-Yu Chen , Lin Gao , Hongbo Fu

While large-scale pre-trained text-to-image models can synthesize diverse and high-quality human-centric images, an intractable problem is how to preserve the face identity for conditioned face images. Existing methods either require…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhuowei Chen , Shancheng Fang , Wei Liu , Qian He , Mengqi Huang , Yongdong Zhang , Zhendong Mao

We propose new static word embeddings optimised for sentence semantic representation. We first extract word embeddings from a pre-trained Sentence Transformer, and improve them with sentence-level principal component analysis, followed by…

Computation and Language · Computer Science 2025-10-01 Takashi Wada , Yuki Hirakawa , Ryotaro Shimizu , Takahiro Kawashima , Yuki Saito