中文
相关论文

相关论文: Efficient Image Generation with Variadic Attention…

200 篇论文

Deeply learned representations have achieved superior image retrieval performance in a retrieve-then-rerank manner. Recent state-of-the-art single stage model, which heuristically fuses local and global features, achieves promising…

计算机视觉与模式识别 · 计算机科学 2022-07-04 Yuxin Song , Ruolin Zhu , Min Yang , Dongliang He

The strong performance of vision transformers on image classification and other vision tasks is often attributed to the design of their multi-head attention layers. However, the extent to which attention is responsible for this strong…

计算机视觉与模式识别 · 计算机科学 2021-05-07 Luke Melas-Kyriazi

This work aims to improve the efficiency of vision transformers (ViT). While ViTs use computationally expensive self-attention operations in every layer, we identify that these operations are highly correlated across layers -- a key…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Shashanka Venkataramanan , Amir Ghodrati , Yuki M. Asano , Fatih Porikli , Amirhossein Habibian

Deep learning technology has made great progress in multi-view 3D reconstruction tasks. At present, most mainstream solutions establish the mapping between views and shape of an object by assembling the networks of 2D encoder and 3D decoder…

计算机视觉与模式识别 · 计算机科学 2023-05-15 Zhenwei Zhu , Liying Yang , Xuxin Lin , Chaohao Jiang , Ning Li , Lin Yang , Yanyan Liang

In recent years, transformer models have revolutionized Natural Language Processing (NLP) and shown promising performance on Computer Vision (CV) tasks. Despite their effectiveness, transformers' attention operations are hard to accelerate…

硬件体系结构 · 计算机科学 2022-04-26 Zhe Zhou , Junlin Liu , Zhenyu Gu , Guangyu Sun

Built on top of self-attention mechanisms, vision transformers have demonstrated remarkable performance on a variety of vision tasks recently. While achieving excellent performance, they still require relatively intensive computational cost…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Lingchen Meng , Hengduo Li , Bor-Chun Chen , Shiyi Lan , Zuxuan Wu , Yu-Gang Jiang , Ser-Nam Lim

Extracting robust feature representation is critical for object re-identification to accurately identify objects across non-overlapping cameras. Although having a strong representation ability, the Vision Transformer (ViT) tends to overfit…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Lei Tan , Pingyang Dai , Jie Chen , Liujuan Cao , Yongjian Wu , Rongrong Ji

Unlike Object Detection, Visual Grounding task necessitates the detection of an object described by complex free-form language. To simultaneously model such complex semantic and visual representations, recent state-of-the-art studies adopt…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Weitai Kang , Luowei Zhou , Junyi Wu , Changchang Sun , Yan Yan

This work introduced a novel GAN architecture for unsupervised image translation on the task of face style transform. A spectral attention-based mechanism is embedded into the design along with spatial attention on the image contents. We…

计算机视觉与模式识别 · 计算机科学 2021-10-07 Qizhou Wang , Maksim Makarenko

Convolutional Neural Networks (CNNs) have dominated computer vision for years, due to its ability in capturing locality and translation invariance. Recently, many vision transformer architectures have been proposed and they show promising…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Pichao Wang , Xue Wang , Fan Wang , Ming Lin , Shuning Chang , Hao Li , Rong Jin

Leveraging the power of deep learning to design nanophotonic devices has been an area of active research in recent times, with Generative Adversarial Networks (GANs) being a popular choice alongside autoencoder-based methods. However, both…

Learned image compression methods have exhibited superior rate-distortion performance than classical image compression standards. Most existing learned image compression models are based on Convolutional Neural Networks (CNNs). Despite…

图像与视频处理 · 电气工程与系统科学 2022-04-12 Renjie Zou , Chunfeng Song , Zhaoxiang Zhang

Training Generative Adversarial Networks (GAN) on high-fidelity images usually requires large-scale GPU-clusters and a vast number of training images. In this paper, we study the few-shot image synthesis task for GAN with minimum computing…

计算机视觉与模式识别 · 计算机科学 2021-01-14 Bingchen Liu , Yizhe Zhu , Kunpeng Song , Ahmed Elgammal

Generative Adversarial Networks (GANs) have shown remarkable performance in image synthesis tasks, but typically require a large number of training samples to achieve high-quality synthesis. This paper proposes a simple and effective…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Esther Robb , Wen-Sheng Chu , Abhishek Kumar , Jia-Bin Huang

Modern large language models become multimodal, analyzing various data formats like text and images. While fine-tuning is effective for adapting these multimodal language models (MLMs) to downstream tasks, full fine-tuning is…

计算与语言 · 计算机科学 2025-12-01 Alexander Sergeev , Evgeny Kotelnikov

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

计算机视觉与模式识别 · 计算机科学 2022-01-26 Pranav Jeevan , Amit sethi

Purpose Medical imaging diagnosis faces challenges, including low-resolution images due to machine artifacts and patient movement. This paper presents the Frequency-Guided U-Net (GFNet), a novel approach for medical image segmentation that…

图像与视频处理 · 电气工程与系统科学 2024-05-03 Haytham Al Ewaidat , Youness El Brag , Ahmad Wajeeh Yousef E'layan , Ali Almakhadmeh

Vision Transformers and their variants have achieved remarkable success in diverse visual perception tasks. Despite their effectiveness, they suffer from two significant limitations. First, the quadratic computational complexity of…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Ali K. Rahimian , Manish K. Govind , Subhajit Maity , Dominick Reilly , Christian Kümmerle , Srijan Das , Aritra Dutta

One-shot talking face generation aims at synthesizing a high-quality talking face video from an arbitrary portrait image, driven by a video or an audio segment. One challenging quality factor is the resolution of the output video: higher…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Fei Yin , Yong Zhang , Xiaodong Cun , Mingdeng Cao , Yanbo Fan , Xuan Wang , Qingyan Bai , Baoyuan Wu , Jue Wang , Yujiu Yang

Recently, Transformer-based image restoration networks have achieved promising improvements over convolutional neural networks due to parameter-independent global interactions. To lower computational cost, existing works generally limit…

计算机视觉与模式识别 · 计算机科学 2023-02-06 Jiale Zhang , Yulun Zhang , Jinjin Gu , Yongbing Zhang , Linghe Kong , Xin Yuan