中文
相关论文

相关论文: Diffusion Based Augmentation for Captioning and Re…

200 篇论文

Scaling laws dictate that the performance of AI models is proportional to the amount of available data. Data augmentation is a promising solution to expanding the dataset size. Traditional approaches focused on augmentation using rotation,…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Fazle Rahat , M Shifat Hossain , Md Rubel Ahmed , Sumit Kumar Jha , Rickard Ewetz

Diffusion models enable high-quality and diverse visual content synthesis. However, they struggle to generate rare or unseen concepts. To address this challenge, we explore the usage of Retrieval-Augmented Generation (RAG) with image…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Rotem Shalev-Arkushin , Rinon Gal , Amit H. Bermano , Ohad Fried

Story visualization is an under-explored task that falls at the intersection of many important research directions in both computer vision and natural language processing. In this task, given a series of natural language captions which…

计算与语言 · 计算机科学 2021-05-24 Adyasha Maharana , Darryl Hannan , Mohit Bansal

Pre-trained diffusion models have demonstrated remarkable proficiency in synthesizing images across a wide range of scenarios with customizable prompts, indicating their effective capacity to capture universal features. Motivated by this,…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Yuxiang Ji , Boyong He , Chenyuan Qu , Zhuoyue Tan , Chuan Qin , Liaoni Wu

While diffusion models excel at image synthesis, useful representations have been shown to emerge from generative pre-training, suggesting a path towards unified generative and discriminative learning. However, suboptimal semantic flow…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Weilai Xiang , Hongyu Yang , Di Huang , Yunhong Wang

Despite significant advancements in image generation using advanced generative frameworks, cross-image integration of content and style remains a key challenge. Current generative models, while powerful, frequently depend on vague textual…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Shaoxu Li , Ye Pan

Diffusion models are generative models with impressive text-to-image synthesis capabilities and have spurred a new wave of creative methods for classical machine learning tasks. However, the best way to harness the perceptual knowledge of…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Neehar Kondapaneni , Markus Marks , Manuel Knott , Rogerio Guimaraes , Pietro Perona

Deep generative models produce data according to a learned representation, e.g. diffusion models, through a process of approximation computing possible samples. Approximation can be understood as reconstruction and the large datasets used…

人机交互 · 计算机科学 2023-09-25 Luís Arandas , Mick Grierson , Miguel Carvalhais

The latest developments in Artificial Intelligence include diffusion generative models, quite popular tools which can produce original images both unconditionally and, in some cases, conditioned by some inputs provided by the user. Apart…

计算机视觉与模式识别 · 计算机科学 2023-02-13 Stefano Scotta , Alberto Messina

Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual…

Generative data augmentation has demonstrated gains in several vision tasks, but its impact on object re-identification - where preserving fine-grained visual details is essential - remains largely unexplored. In this work, we assess the…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Leonardo Santiago Benitez Pereira , Arathy Jeevan

Diffusion Models represent a significant advancement in generative modeling, employing a dual-phase process that first degrades domain-specific information via Gaussian noise and restores it through a trainable model. This framework enables…

神经与进化计算 · 计算机科学 2024-11-21 Benedikt Hartl , Yanbo Zhang , Hananel Hazan , Michael Levin

While diffusion models demonstrate a remarkable capability for generating high-quality images, their tendency to `replicate' training data raises privacy concerns. Although recent research suggests that this replication may stem from the…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Chenghao Li , Dake Chen , Yuke Zhang , Peter A. Beerel

Automatically generating a human-like description for a given image is a potential research in artificial intelligence, which has attracted a great of attention recently. Most of the existing attention methods explore the mapping…

计算机视觉与模式识别 · 计算机科学 2020-11-03 Feicheng Huang , Zhixin Li , Haiyang Wei , Canlong Zhang , Huifang Ma

Recent advances in diffusion models have led to impressive image generation capabilities, but aligning these models with human preferences remains challenging. Reward-based fine-tuning using models trained on human feedback improves…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Dmitrii Sorokin , Maksim Nakhodnov , Andrey Kuznetsov , Aibek Alanov

Language models are known to exhibit various forms of cultural bias in decision-making tasks, yet much less is known about their degree of cultural familiarity in open-ended text generation tasks. In this paper, we introduce the task of…

计算与语言 · 计算机科学 2026-04-06 Lingjun Zhao , Dayeon Ki , Marine Carpuat , Hal Daumé

Artificial neural networks typically struggle in generalizing to out-of-context examples. One reason for this limitation is caused by having datasets that incorporate only partial information regarding the potential correlational structure…

计算机视觉与模式识别 · 计算机科学 2023-11-20 Valentin Barriere , Felipe del Rio , Andres Carvallo De Ferari , Carlos Aspillaga , Eugenio Herrera-Berg , Cristian Buc Calderon

Diffusion models, capable of high-quality image generation, receive unparalleled popularity for their ease of extension. Active users have created a massive collection of domain-specific diffusion models by fine-tuning base models on…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Haoming Liu , Yuanhe Guo , Shengjie Wang , Hongyi Wen

Humans have an incredible ability to process and understand information from multiple sources such as images, video, text, and speech. Recent success of deep neural networks has enabled us to develop algorithms which give machines the…

计算机视觉与模式识别 · 计算机科学 2019-03-18 Dheeraj Peri , Shagan Sah , Raymond Ptucha

Large models, encompassing large language and diffusion models, have shown exceptional promise in approximating human-level intelligence, garnering significant interest from both academic and industrial spheres. However, the training of…

机器学习 · 计算机科学 2024-03-05 Yue Zhou , Chenlu Guo , Xu Wang , Yi Chang , Yuan Wu