English
Related papers

Related papers: Pre-Trained Language Transformers are Universal Im…

200 papers

While large-scale pre-trained text-to-image models can synthesize diverse and high-quality human-centric images, an intractable problem is how to preserve the face identity for conditioned face images. Existing methods either require…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhuowei Chen , Shancheng Fang , Wei Liu , Qian He , Mengqi Huang , Yongdong Zhang , Zhendong Mao

Deep Neural Network (DNN) has recently achieved outstanding performance in a variety of computer vision tasks, including facial attribute classification. The great success of classifying facial attributes with DNN often relies on a massive…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Ni Zhuang , Yan Yan , Si Chen , Hanzi Wang , Chunhua Shen

In recent years, deep learning has greatly streamlined the process of manipulating photographic face images. Aware of the potential dangers, researchers have developed various tools to spot these counterfeits. Yet, none asks the fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Mian Zou , Baosheng Yu , Yibing Zhan , Siwei Lyu , Kede Ma

Large-scale, transformer-based language models such as GPT-2 are pretrained on diverse corpora scraped from the internet. Consequently, they are prone to generating non-normative text (i.e. in violation of social norms). We introduce a…

Computation and Language · Computer Science 2020-11-02 Xiangyu Peng , Siyan Li , Spencer Frazier , Mark Riedl

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

We present an automatic face verification system inspired by known properties of biological systems. In the proposed algorithm the whole image is converted from the spatial to polar frequency domain by a Fourier-Bessel Transform (FBT).…

Computer Vision and Pattern Recognition · Computer Science 2009-09-29 Yossi Zana , Roberto M. Cesar-Jr , Regis de A. Barbosa

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Advances in Artificial Intelligence and Image Processing are changing the way people interacts with digital images and video. Widespread mobile apps like FACEAPP make use of the most advanced Generative Adversarial Networks (GAN) to produce…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Luca Guarnera , Oliver Giudice , Sebastiano Battiato

With the growth of the academic engines, the mining and analysis acquisition of massive researcher data, such as collaborator recommendation and researcher retrieval, has become indispensable. It can improve the quality of services and…

Information Retrieval · Computer Science 2022-03-02 Ziyue Qiao , Yanjie Fu , Pengyang Wang , Meng Xiao , Zhiyuan Ning , Denghui Zhang , Yi Du , Yuanchun Zhou

Transformer-based language models create hidden representations of their inputs at every layer, but only use final-layer representations for prediction. This obscures the internal decision-making process of the model and the utility of its…

Computation and Language · Computer Science 2024-06-21 Alexander Yom Din , Taelin Karidi , Leshem Choshen , Mor Geva

Knowledge is acquired by humans through experience, and no boundary is set between the kinds of knowledge or skill levels we can achieve on different tasks at the same time. When it comes to Neural Networks, that is not the case. The…

Computation and Language · Computer Science 2022-02-08 Charaf Eddine Benarab

Identifying adverse and hostile content on the web and more particularly, on social media, has become a problem of paramount interest in recent years. With their ever increasing popularity, fine-tuning of pretrained Transformer-based…

Computation and Language · Computer Science 2021-01-12 Tathagata Raha , Sayar Ghosh Roy , Ujwal Narayan , Zubair Abid , Vasudeva Varma

Recent period of pandemic has brought person identification even with occluded face image a great importance with increased number of mask usage. This paper aims to recognize the occlusion of one of four types in face images. Various…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Mohamed Mohana , Prasanalakshmi B , Salem Alelyani , Mohammed Saleh Alsaqer

Face recognition in unconstrained environments such as surveillance, video, and web imagery must contend with extreme variation in pose, blur, illumination, and occlusion, where conventional visual quality metrics fail to predict whether…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Allen Tu , Kartik Narayan , Joshua Gleason , Jennifer Xu , Matthew Meyn , Tom Goldstein , Vishal M. Patel

Aphasia is a language disorder that can lead to speech errors known as paraphasias, which involve the misuse, substitution, or invention of words. Automatic paraphasia detection can help those with Aphasia by facilitating clinical…

Computation and Language · Computer Science 2024-07-17 Matthew Perez , Aneesha Sampath , Minxue Niu , Emily Mower Provost

Face deidentification is an active topic amongst privacy and security researchers. Early deidentification methods relying on image blurring or pixelization were replaced in recent years with techniques based on formal anonymity models that…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Blaž Meden , Refik Can Mallı , Sebastjan Fabijan , Hazım Kemal Ekenel , Vitomir Štruc , Peter Peer

We present Video Pre-trained Transformer. VPT uses four SOTA encoder models from prior work to convert a video into a sequence of compact embeddings. Our backbone, based on a reference Flan-T5-11B architecture, learns a universal…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Kastan Day , Daniel Christl , Rohan Salvi , Pranav Sriram

Transformers are remarkably versatile, suggesting the existence of generic inductive biases beneficial across modalities. In this work, we explore a new way to instil such biases in vision transformers (ViTs) through pretraining on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zachary Shinnick , Liangze Jiang , Hemanth Saratchandran , Damien Teney , Anton van den Hengel

Transformer models have shown impressive performance on a variety of NLP tasks. Off-the-shelf, pre-trained models can be fine-tuned for specific NLP classification tasks, reducing the need for large amounts of additional training data.…

Computation and Language · Computer Science 2020-10-06 Maaike Burghoorn , Maaike H. T. de Boer , Stephan Raaijmakers