English
Related papers

Related papers: Efficient generative adversarial networks using li…

200 papers

A class of recent approaches for generating images, called Generative Adversarial Networks (GAN), have been used to generate impressively realistic images of objects, bedrooms, handwritten digits and a variety of other image modalities.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Swaminathan Gurumurthy , Ravi Kiran Sarvadevabhatla , Venkatesh Babu Radhakrishnan

Synthetic data can be used in various applications, such as correcting bias datasets or replacing scarce original data for simulation purposes. Generative Adversarial Networks (GANs) are considered state-of-the-art for developing generative…

Machine Learning · Computer Science 2022-03-08 Gael Lederrey , Tim Hillel , Michel Bierlaire

In recent studies, Generative Adversarial Network (GAN) is one of the popular schemes to augment the image dataset. However, in our study we find the generator G in the GAN fails to generate numerical data in lower-dimensional spaces, and…

Machine Learning · Computer Science 2020-10-27 Wei Wang , Yimeng Chai , Tao Cui , Chuang Wang , Baohua Zhang , Yue Li , Yi An

We present a new multi-modal face image generation method that converts a text prompt and a visual input, such as a semantic mask or scribble map, into a photo-realistic face image. To do this, we combine the strengths of Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Jihyun Kim , Changjae Oh , Hoseok Do , Soohyun Kim , Kwanghoon Sohn

With the increasing demand for practical applications of Large Language Models (LLMs), many attention-efficient models have been developed to balance performance and computational cost. However, the adversarial robustness of these models…

Computation and Language · Computer Science 2024-09-17 Xiaojing Fan , Chunliang Tao

Transformer-based models have made remarkable progress in image restoration (IR) tasks. However, the quadratic complexity of self-attention in Transformer hinders its applicability to high-resolution images. Existing methods mitigate this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Yuang Ai , Huaibo Huang , Tao Wu , Qihang Fan , Ran He

Recent advances in Generative Artificial Intelligence have fueled numerous applications, particularly those involving Generative Adversarial Networks (GANs), which are essential for synthesizing realistic photos and videos. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-07 Ziji Shi , Jialin Li , Yang You

Transformers have improved the state-of-the-art across numerous tasks in sequence modeling. Besides the quadratic computational and memory complexity w.r.t the sequence length, the self-attention mechanism only processes information at the…

Machine Learning · Computer Science 2021-08-12 Yao Zhang , Yunpu Ma , Thomas Seidl , Volker Tresp

Conditional generative adversarial networks (cGAN) have led to large improvements in the task of conditional image generation, which lies at the heart of computer vision. The major focus so far has been on performance improvement, while…

Machine Learning · Computer Science 2019-03-14 Grigorios G. Chrysos , Jean Kossaifi , Stefanos Zafeiriou

Inferring transient molecular structural dynamics from diffraction data is an ambiguous task that often requires different approximation methods. In this paper we present an attempt to tackle this problem using machine learning. While most…

Chemical Physics · Physics 2023-08-09 Hazem Daoud , Dhruv Sirohi , Endri Mjeku , John Feng , Saeed Oghbaey , R. J. Dwayne Miller

Generative Adversarial Networks (GANs) have shown promise in augmenting datasets and boosting convolutional neural networks' (CNN) performance on image classification tasks. But they introduce more hyperparameters to tune as well as the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Amil Dravid , Florian Schiffers , Yunan Wu , Oliver Cossairt , Aggelos K. Katsaggelos

In this paper, we investigate the dynamics-aware adversarial attack problem in deep neural networks. Most existing adversarial attack algorithms are designed under a basic assumption -- the network architecture is fixed throughout the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 An Tao , Yueqi Duan , He Wang , Ziyi Wu , Pengliang Ji , Haowen Sun , Jie Zhou , Jiwen Lu

Developing efficient time series anomaly detection techniques is important to maintain service quality and provide early alarms. Generative neural network methods are one class of the unsupervised approaches that are achieving increasing…

Machine Learning · Computer Science 2022-10-07 Yueyan Gu , Farrokh Jazizadeh

The advent of Transformers marked a significant breakthrough in sequence modelling, providing a highly performant architecture capable of leveraging GPU parallelism. However, Transformers are computationally expensive at inference time,…

Machine Learning · Computer Science 2024-05-29 Leo Feng , Frederick Tung , Hossein Hajimirsadeghi , Mohamed Osama Ahmed , Yoshua Bengio , Greg Mori

Modern diffusion models, particularly those utilizing a Transformer-based UNet for denoising, rely heavily on self-attention operations to manage complex spatial relationships, thus achieving impressive generation performance. However, this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Songhua Liu , Weihao Yu , Zhenxiong Tan , Xinchao Wang

Recent advances in diffusion-based controllable visual generation have led to remarkable improvements in image quality. However, these powerful models are typically deployed on cloud servers due to their large computational demands, raising…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yuhe Liu , Zhenxiong Tan , Yujia Hu , Songhua Liu , Xinchao Wang

Transformers face quadratic complexity and memory issues with long sequences, prompting the adoption of linear attention mechanisms using fixed-size hidden states. However, linear models often suffer from limited recall performance, leading…

Computation and Language · Computer Science 2025-07-10 Dustin Wang , Rui-Jie Zhu , Steven Abreu , Yong Shan , Taylor Kergan , Yuqi Pan , Yuhong Chou , Zheng Li , Ge Zhang , Wenhao Huang , Jason Eshraghian

In this paper, we introduce Logic Tensor Network-Enhanced Generative Adversarial Network (LTN-GAN), a novel framework that enhances Generative Adversarial Networks (GANs) by incorporating Logic Tensor Networks (LTNs) to enforce…

Machine Learning · Computer Science 2026-01-08 Nijesh Upreti , Vaishak Belle

Latest Generative Adversarial Networks (GANs) are gathering outstanding results through a large-scale training, thus employing models composed of millions of parameters requiring extensive computational capabilities. Building such huge…

Machine Learning · Computer Science 2022-12-16 Eleonora Grassucci , Edoardo Cicero , Danilo Comminiello

This paper proposes the decision tree latent controller generative adversarial network (DTLC-GAN), an extension of a GAN that can learn hierarchically interpretable representations without relying on detailed supervision. To impose a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Takuhiro Kaneko , Kaoru Hiramatsu , Kunio Kashino