English
Related papers

Related papers: Pretrained Reversible Generation as Unsupervised V…

200 papers

Adversarially trained generative models (GANs) have recently achieved compelling image synthesis results. But despite early successes in using GANs for unsupervised representation learning, they have since been superseded by approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Jeff Donahue , Karen Simonyan

While generative modeling has become prevalent across numerous research fields, its integration into the realm of image retrieval remains largely unexplored and underjustified. In this paper, we present a novel methodology, reframing image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Yidan Zhang , Ting Zhang , Dong Chen , Yujing Wang , Qi Chen , Xing Xie , Hao Sun , Weiwei Deng , Qi Zhang , Fan Yang , Mao Yang , Qingmin Liao , Jingdong Wang , Baining Guo

State-of-the-art under-determined audio source separation systems rely on supervised end-end training of carefully tailored neural network architectures operating either in the time or the spectral domain. However, these methods are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-29 Vivek Narayanaswamy , Jayaraman J. Thiagarajan , Rushil Anirudh , Andreas Spanias

The traditional approach of hand-crafting priors (such as sparsity) for solving inverse problems is slowly being replaced by the use of richer learned priors (such as those modeled by generative adversarial networks, or GANs). In this work,…

Machine Learning · Computer Science 2018-10-09 Chinmay Hegde

Retrieval-Augmented Generation (RAG) is increasingly employed in generative AI-driven scientific workflows to integrate rapidly evolving scientific knowledge bases, yet its reliability is frequently compromised by non-determinism in their…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-24 Baiqiang Wang , Dongfang Zhao , Nathan R Tallent , Luanzheng Guo

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

Retrieval-augmented generation (RAG) is a powerful technique that enhances downstream task execution by retrieving additional information, such as knowledge, skills, and tools from external sources. Graph, by its intrinsic "nodes connected…

The classical problem of phase retrieval arises in various signal acquisition systems. Due to the ill-posed nature of the problem, the solution requires assumptions on the structure of the signal. In the last several years, sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Rakib Hyder , Viraj Shah , Chinmay Hegde , M. Salman Asif

Self-supervised learning has achieved remarkable success in acquiring high-quality representations from unlabeled data. The widely adopted contrastive learning framework aims to learn invariant representations by minimizing the distance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Xiaojie Li , Yibo Yang , Xiangtai Li , Jianlong Wu , Yue Yu , Bernard Ghanem , Min Zhang

Predicting how cells respond to genetic perturbations is fundamental to understanding gene function, disease mechanisms, and therapeutic development. While recent deep learning approaches have shown promise in modeling single-cell…

Machine Learning · Computer Science 2026-03-10 Andrea Giuseppe Di Francesco , Andrea Rubbi , Pietro Liò

There remains an important need for the development of image reconstruction methods that can produce diagnostically useful images from undersampled measurements. In magnetic resonance imaging (MRI), for example, such methods can facilitate…

Image and Video Processing · Electrical Eng. & Systems 2021-06-28 Varun A. Kelkar , Sayantan Bhadra , Mark A. Anastasio

In this paper, we propose a self-supervised visual representation learning approach which involves both generative and discriminative proxies, where we focus on the former part by requiring the target network to recover the original image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Yunjie Tian , Lingxi Xie , Xiaopeng Zhang , Jiemin Fang , Haohang Xu , Wei Huang , Jianbin Jiao , Qi Tian , Qixiang Ye

Sample-efficient online reinforcement learning often uses replay buffers to store experience for reuse when updating the value function. However, uniform replay is inefficient, since certain classes of transitions can be more relevant to…

Machine Learning · Computer Science 2025-05-12 Renhao Wang , Kevin Frans , Pieter Abbeel , Sergey Levine , Alexei A. Efros

Existing text-to-image generative models reflect or even amplify societal biases ingrained in their training data. This is especially concerning for human image generation where models are biased against certain demographic groups. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Robik Shrestha , Yang Zou , Qiuyu Chen , Zhiheng Li , Yusheng Xie , Siqi Deng

Deep generative replay has emerged as a promising approach for continual learning in decision-making tasks. This approach addresses the problem of catastrophic forgetting by leveraging the generation of trajectories from previously…

Machine Learning · Computer Science 2024-06-18 William Yue , Bo Liu , Peter Stone

Modern vision models excel at general purpose downstream tasks. It is unclear, however, how they may be used for personalized vision tasks, which are both fine-grained and data-scarce. Recent works have successfully applied synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Shobhita Sundaram , Julia Chae , Yonglong Tian , Sara Beery , Phillip Isola

Retrieval-Augmented Generation (RAG) systems traditionally treat retrieval and generation as separate processes, requiring explicit textual queries to connect them. This separation can limit the ability of models to generalize across…

Computation and Language · Computer Science 2025-09-19 Wenzheng Zhang , Xi Victoria Lin , Karl Stratos , Wen-tau Yih , Mingda Chen

Deep generative models (DGMs) are data-eager because learning a complex model on limited data suffers from a large variance and easily overfits. Inspired by the classical perspective of the bias-variance tradeoff, we propose regularized…

Machine Learning · Computer Science 2023-04-11 Yong Zhong , Hongtao Liu , Xiaodong Liu , Fan Bao , Weiran Shen , Chongxuan Li

Recently, Retrieval Augmented Generation (RAG) has shifted focus to multi-retrieval approaches to tackle complex tasks such as multi-hop question answering. However, these systems struggle to decide when to stop searching once enough…

Information Retrieval · Computer Science 2026-04-23 Gabriel Iturra-Bocaz , Petra Galuscakova

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

Machine Learning · Computer Science 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee