English
Related papers

Related papers: Towards End-to-End In-Image Neural Machine Transla…

200 papers

Since the advent of deep convolutional neural networks (DNNs), computer vision has seen an extremely rapid progress that has led to huge advances in medical imaging. This article does not aim to cover all aspects of the field but focuses on…

Medical Physics · Physics 2019-06-11 Shizuo Kaji , Satoshi Kida

We approach instantaneous mapping, converting images to a top-down view of the world, as a translation problem. We show how a novel form of transformer network can be used to map from images and video directly to an overhead map or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Avishkar Saha , Oscar Mendez Maldonado , Chris Russell , Richard Bowden

We address the task of multi-view image-to-image translation for person image generation. The goal is to synthesize photo-realistic multi-view images with pose-consistency across all views. Our proposed end-to-end framework is based on a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Idit Diamant , Oranit Dror , Hai Victor Habi , Arnon Netzer

Image-to-image translation has drawn great attention during the past few years. It aims to translate an image in one domain to a given reference image in another domain. Due to its effectiveness and efficiency, many applications can be…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Weihao Xia , Yujiu Yang , Jing-Hao Xue

Unsupervised neural machine translation (UNMT) has recently achieved remarkable results with only large monolingual corpora in each language. However, the uncertainty of associating target with source sentences makes UNMT theoretically an…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Yuanhang Su , Kai Fan , Nguyen Bach , C. -C. Jay Kuo , Fei Huang

Machine Translation (MT) is a zone of concentrate in Natural Language processing which manages the programmed interpretation of human language, starting with one language then onto the next by the PC. Having a rich research history…

Computation and Language · Computer Science 2019-09-24 Siddhant Srivastava , Ritu Tiwari

Text image machine translation (TIMT) aims to translate texts embedded in images from one source language to another target language. Existing methods, both two-stage cascade and one-stage end-to-end architectures, suffer from different…

Computation and Language · Computer Science 2023-05-11 Cong Ma , Yaping Zhang , Mei Tu , Yang Zhao , Yu Zhou , Chengqing Zong

An increasing share of image and video content is analyzed by machines rather than viewed by humans, and therefore it becomes relevant to optimize codecs for such applications where the analysis is performed remotely. Unfortunately,…

Image and Video Processing · Electrical Eng. & Systems 2020-11-13 Lahiru D. Chamain , Fabien Racapé , Jean Bégaint , Akshay Pushparaja , Simon Feltman

Direct speech-to-image translation without text is an interesting and useful topic due to the potential applications in human-computer interaction, art creation, computer-aided design. etc. Not to mention that many languages have no writing…

Multimedia · Computer Science 2020-07-15 Jiguo Li , Xinfeng Zhang , Chuanmin Jia , Jizheng Xu , Li Zhang , Yue Wang , Siwei Ma , Wen Gao

Image-to-image translation (I2I) aims to transfer images from a source domain to a target domain while preserving the content representations. I2I has drawn increasing attention and made tremendous progress in recent years because of its…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Yingxue Pang , Jianxin Lin , Tao Qin , Zhibo Chen

We study the task of image inpainting, which is to fill in the missing region of an incomplete image with plausible contents. To this end, we propose a learning-based approach to generate visually coherent completion given a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yuhang Song , Chao Yang , Zhe Lin , Xiaofeng Liu , Qin Huang , Hao Li , C. -C. Jay Kuo

Unsupervised image-to-image translation aims to learn the mapping between two visual domains with unpaired samples. Existing works focus on disentangling domain-invariant content code and domain-specific style code individually for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Yunfei Liu , Haofei Wang , Yang Yue , Feng Lu

In many scenarios in computer vision, machine learning, and computer graphics, there is a requirement to learn the mapping from an image of one domain to an image of another domain, called Image-to-image translation. For example, style…

Image and Video Processing · Electrical Eng. & Systems 2020-03-09 Mohammad Akif Beg , Jia Yuan Yu

Multimodal machine translation involves drawing information from more than one modality, based on the assumption that the additional modalities will contain useful alternative views of the input data. The most prominent tasks in this area…

Computation and Language · Computer Science 2019-12-02 Umut Sulubacak , Ozan Caglayan , Stig-Arne Grönroos , Aku Rouhe , Desmond Elliott , Lucia Specia , Jörg Tiedemann

Speech-to-text translation pertains to the task of converting speech signals in a language to text in another language. It finds its application in various domains, such as hands-free communication, dictation, video lecture transcription,…

Computation and Language · Computer Science 2024-06-11 Nivedita Sethiya , Chandresh Kumar Maurya

Recent image-to-image translation works have been transferred from supervised to unsupervised settings due to the expensive cost of capturing or labeling large amounts of paired data. However, current unsupervised methods using the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Pan Zhang , Jianmin Bao , Ting Zhang , Dong Chen , Fang Wen

In this paper, we address the task of spoken language understanding. We present a method for translating spoken sentences from one language into spoken sentences in another language. Given spectrogram-spectrogram pairs, our model can be…

Computation and Language · Computer Science 2019-04-25 Michelle Guo , Albert Haque , Prateek Verma

Neural machine translation is a recently proposed approach to machine translation. Unlike the traditional statistical machine translation, the neural machine translation aims at building a single neural network that can be jointly tuned to…

Computation and Language · Computer Science 2016-05-23 Dzmitry Bahdanau , Kyunghyun Cho , Yoshua Bengio

Image-to-image translation is significant to many computer vision and machine learning tasks such as image synthesis and video synthesis. It has primary applications in the graphics editing and animation industries. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Heng Wang , Donghao Zhang , Yang Song , Heng Huang , Mei Chen , Weidong Cai

We propose a new and fully end-to-end approach for multimodal translation where the source text encoder modulates the entire visual input processing using conditional batch normalization, in order to compute the most informative image…

Computation and Language · Computer Science 2018-06-01 Jean-Benoit Delbrouck , Stéphane Dupont