中文
相关论文

相关论文: Cross-Modal Generative Augmentation for Visual Que…

200 篇论文

Advances in natural language processing, such as transfer learning from pre-trained language models, have impacted how models are trained for programming language tasks too. Previous research primarily explored code pre-training and…

计算与语言 · 计算机科学 2023-02-08 Pinzhen Chen , Gerasimos Lampouras

We propose a simple yet novel data augmentation method for general data modalities based on energy-based modeling and principles from information geometry. Unlike most existing learning-based data augmentation methods, which rely on…

机器学习 · 计算机科学 2026-01-28 Pingbang Hu , Mahito Sugiyama

Deep learning has rapidly become the state-of-the-art approach for music generation. However, training a deep model typically requires a large training set, which is often not available for specific musical styles. In this paper, we present…

声音 · 计算机科学 2020-07-22 Alisa Liu , Alexander Fang , Gaëtan Hadjeres , Prem Seetharaman , Bryan Pardo

Data augmentation using generative models has emerged as a powerful paradigm for enhancing performance in computer vision tasks. However, most existing augmentation approaches primarily focus on optimizing intrinsic data attributes -- such…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Jiyu Guo , Shuo Yang , Yiming Huang , Yancheng Long , Xiaobo Xia , Xiu Su , Bo Zhao , Zeke Xie , Liqiang Nie

Generative models in molecular design tend to be richly parameterized, data-hungry neural models, as they must create complex structured objects as outputs. Estimating such models from data may be challenging due to the lack of sufficient…

机器学习 · 计算机科学 2021-08-17 Kevin Yang , Wengong Jin , Kyle Swanson , Regina Barzilay , Tommi Jaakkola

Augmentation by generative modelling yields a promising alternative to the accumulation of surgical data, where ethical, organisational and regulatory aspects must be considered. Yet, the joint synthesis of (image, mask) pairs for…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Yannik Frisch , Christina Bornberg , Moritz Fuchs , Anirban Mukhopadhyay

Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual…

Current medical image synthetic augmentation techniques rely on intensive use of generative adversarial networks (GANs). However, the nature of GAN architecture leads to heavy computational resources to produce synthetic images and the…

图像与视频处理 · 电气工程与系统科学 2022-12-21 Meng Li , Brian Lovell

As Large Language Models (LLMs) become popular, there emerged an important trend of using multimodality to augment the LLMs' generation ability, which enables LLMs to better interact with the world. However, there lacks a unified perception…

Data augmentation is an effective way to diversify corpora in machine translation, but previous methods may introduce semantic inconsistency between original and augmented data because of irreversible operations and random subword sampling…

计算与语言 · 计算机科学 2025-02-21 Jiashu Yao , Heyan Huang , Zeming Liu , Yuhang Guo

Recently, unified multimodal models (UMMs) have made remarkable progress in integrating visual understanding and generation, demonstrating strong potential for complex text-to-image (T2I) tasks. Despite their theoretical promise, a…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Jiadong Pan , Liang Li , Yuxin Peng , Yu-Ming Tang , Shuohuan Wang , Yu Sun , Hua Wu , Qingming Huang , Haifeng Wang

In the domain of Visual Question Answering (VQA), studies have shown improvement in users' mental model of the VQA system when they are exposed to examples of how these systems answer certain Image-Question (IQ) pairs. In this work, we show…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Kamran Alipour , Arijit Ray , Xiao Lin , Michael Cogswell , Jurgen P. Schulze , Yi Yao , Giedrius T. Burachas

Generalization to unseen real-world scenarios for robot manipulation requires exposure to diverse datasets during training. However, collecting large real-world datasets is intractable due to high operational costs. For robot learning to…

机器人学 · 计算机科学 2024-09-04 Zoey Chen , Zhao Mandi , Homanga Bharadhwaj , Mohit Sharma , Shuran Song , Abhishek Gupta , Vikash Kumar

Skeleton-based human action recognition is a powerful approach for understanding human behaviour from pose data, but collecting large-scale, diverse, and well-annotated 3D skeleton datasets is both expensive and labor-intensive. To address…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Xu Dong , Wanqing Li , Anthony Adeyemi-Ejeye , Andrew Gilbert

In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their…

机器学习 · 计算机科学 2022-07-27 Nihir Vedd , Zixu Wang , Marek Rei , Yishu Miao , Lucia Specia

The development of high-dimensional generative models has recently gained a great surge of interest with the introduction of variational auto-encoders and generative adversarial neural networks. Different variants have been proposed where…

计算机视觉与模式识别 · 计算机科学 2019-04-18 Mickaël Chen , Ludovic Denoyer , Thierry Artières

Despite the rapid growth in model architecture, the scarcity of large parallel corpora remains the main bottleneck in Neural Machine Translation. Data augmentation is a technique that enhances the performance of data-hungry models by…

计算与语言 · 计算机科学 2023-11-14 Seokjin Oh , Su Ah Lee , Woohwan Jung

Scaling laws dictate that the performance of AI models is proportional to the amount of available data. Data augmentation is a promising solution to expanding the dataset size. Traditional approaches focused on augmentation using rotation,…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Fazle Rahat , M Shifat Hossain , Md Rubel Ahmed , Sumit Kumar Jha , Rickard Ewetz

We present an empirical evaluation of fMRI data augmentation via synthesis. For synthesis we use generative mod-els trained on real neuroimaging data to produce novel task-dependent functional brain images. Analyzed generative mod-els…

计算机视觉与模式识别 · 计算机科学 2019-07-16 Peiye Zhuang , Alexander G. Schwing , Sanmi Koyejo

Adaptable models could greatly benefit robotic agents operating in the real world, allowing them to deal with novel and varying conditions. While approaches such as Bayesian inference are well-studied frameworks for adapting models to…

机器学习 · 计算机科学 2023-10-20 Orr Krupnik , Elisei Shafer , Tom Jurgenson , Aviv Tamar