English
Related papers

Related papers: GANBERT: Generative Adversarial Networks with Bidi…

200 papers

The field of natural language processing (NLP) has made significant progress with the rapid development of deep learning technologies. One of the research directions in text sentiment analysis is sentiment analysis of medical texts, which…

Computation and Language · Computer Science 2024-12-04 Yinan Chen

Advances in computer vision are pushing the limits of im-age manipulation, with generative models sampling detailed images on various tasks. However, a specialized model is often developed and trained for each specific task, even though…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Thibaut Issenhuth , Ugo Tanielian , Jérémie Mary , David Picard

Recent approaches in generative adversarial networks (GANs) can automatically synthesize realistic images from descriptive text. Despite the overall fair quality, the generated images often expose visible flaws that lack structural…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 Miriam Cha , Youngjune Gwon , H. T. Kung

Large scale self-supervised pre-training of Transformer language models has advanced the field of Natural Language Processing and shown promise in cross-application to the biological `languages' of proteins and DNA. Learning effective…

Machine Learning · Computer Science 2021-12-15 Meredith V. Trotter , Cuong Q. Nguyen , Stephen Young , Rob T. Woodruff , Kim M. Branson

Fine-tuned Bidirectional Encoder Representations from Transformers (BERT)-based sequence classification models have proven to be effective for detecting Alzheimer's Disease (AD) from transcripts of human speech. However, previous research…

Computation and Language · Computer Science 2020-11-13 Aparna Balagopalan , Jekaterina Novikova

An effective perception system is a fundamental component for farming robots, as it enables them to properly perceive the surrounding environment and to carry out targeted operations. The most recent methods make use of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Mulham Fawakherji , Ciro Potena , Alberto Pretto , Domenico D. Bloisi , Daniele Nardi

Recent advances in automatic evaluation metrics for text have shown that deep contextualized word representations, such as those generated by BERT encoders, are helpful for designing metrics that correlate well with human judgements. At the…

Computation and Language · Computer Science 2020-10-14 Xi Chen , Nan Ding , Tomer Levinboim , Radu Soricut

The success of bidirectional encoders using masked language models, such as BERT, on numerous natural language processing tasks has prompted researchers to attempt to incorporate these pre-trained models into neural machine translation…

Computation and Language · Computer Science 2021-09-13 Haoran Xu , Benjamin Van Durme , Kenton Murray

Representations derived from models such as BERT (Bidirectional Encoder Representations from Transformers) and HuBERT (Hidden units BERT), have helped to achieve state-of-the-art performance in dimensional speech emotion recognition.…

Sound · Computer Science 2023-12-29 Vikramjit Mitra , Jingping Nie , Erdrin Azemi

Attenuation correction is an essential requirement of positron emission tomography (PET) image reconstruction to allow for accurate quantification. However, attenuation correction is particularly challenging for PET-MRI as neither PET nor…

Biomedical Named Entity Recognition (NER) is a fundamental task of Biomedical Natural Language Processing for extracting relevant information from biomedical texts, such as clinical records, scientific publications, and electronic health…

Computation and Language · Computer Science 2023-12-27 Fahime Shahrokh , Nasser Ghadiri , Rasoul Samani , Milad Moradi

Generating images via the generative adversarial network (GAN) has attracted much attention recently. However, most of the existing GAN-based methods can only produce low-resolution images of limited quality. Directly generating…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Yong Guo , Qi Chen , Jian Chen , Qingyao Wu , Qinfeng Shi , Mingkui Tan

Although BERT-style encoder models are heavily used in NLP research, many researchers do not pretrain their own BERTs from scratch due to the high cost of training. In the past half-decade since BERT first rose to prominence, many advances…

Computation and Language · Computer Science 2024-01-17 Jacob Portes , Alex Trott , Sam Havens , Daniel King , Abhinav Venigalla , Moin Nadeem , Nikhil Sardana , Daya Khudia , Jonathan Frankle

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further improve the performance of the pre-trained language models. In…

Computation and Language · Computer Science 2020-12-14 Yiming Cui , Wanxiang Che , Ting Liu , Bing Qin , Shijin Wang , Guoping Hu

The integrated positron emission tomography/magnetic resonance imaging (PET/MRI) scanner facilitates the simultaneous acquisition of metabolic information via PET and morphological information with high soft-tissue contrast using MRI.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Hidetoshi Matsuo , Mizuho Nishio , Munenobu Nogami , Feibi Zeng , Takako Kurimoto , Sandeep Kaushik , Florian Wiesinger , Atsushi K Kono , Takamichi Murakami

Positron emission tomography (PET) is a cornerstone of modern radiology. The ability to detect cancer and metastases in whole body scans fundamentally changed cancer diagnosis and treatment. One of the main bottlenecks in the clinical…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Ida Häggström , C. Ross Schmidtlein , Gabriele Campanella , Thomas J. Fuchs

The Bidirectional Encoder Representations from Transformers (BERT) were proposed in the natural language process (NLP) and shows promising results. Recently researchers applied the BERT to source-code representation learning and reported…

Computation and Language · Computer Science 2023-08-14 Lan Zhang , Chen Cao , Zhilong Wang , Peng Liu

Medical image processing has been highlighted as an area where deep learning-based models have the greatest potential. However, in the medical field in particular, problems of data availability and privacy are hampering research progress…

Image and Video Processing · Electrical Eng. & Systems 2023-10-27 Christoph Angermann , Johannes Bereiter-Payr , Kerstin Stock , Markus Haltmeier , Gerald Degenhart

Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN inversion, they have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Cheng Yu , Wenmin Wang , Roberto Bugiolacchi