中文
相关论文

相关论文: Alchemist: Unlocking Efficiency in Text-to-Image M…

200 篇论文

Self-supervised Multi-modal Contrastive Learning (SMCL) remarkably advances modern Vision-Language Pre-training (VLP) models by aligning visual and linguistic modalities. Due to noises in web-harvested text-image pairs, however, scaling up…

机器学习 · 计算机科学 2024-02-27 Chaoya Jiang , Wei ye , Haiyang Xu , Qinghao Ye , Ming Yan , Ji Zhang , Shikun Zhang

State-of-the-arts text-to-image generation models such as Imagen and Stable Diffusion Model have succeed remarkable progresses in synthesizing high-quality, feature-rich images with high resolution guided by human text prompts. Since…

计算机视觉与模式识别 · 计算机科学 2025-01-31 Ziyi Dong , Pengxu Wei , Liang Lin

The burgeoning field of generative artificial intelligence has fundamentally reshaped our approach to content creation, with Large Vision-Language Models (LVLMs) standing at its forefront. While current LVLMs have demonstrated impressive…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Spencer Ramsey , Jeffrey Lee , Amina Grant

Model-Agnostic Meta-Learning (MAML) is one of the most successful meta-learning techniques for few-shot learning. It uses gradient descent to learn commonalities between various tasks, enabling the model to learn the meta-initialization of…

机器学习 · 计算机科学 2022-08-18 Lin Ding , Peng Liu , Wenfeng Shen , Weijia Lu , Shengbo Chen

Recent text-to-image (T2I) generation models have demonstrated impressive capabilities in creating images from text descriptions. However, these T2I generation models often fall short of generating images that precisely match the details of…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Jialu Li , Jaemin Cho , Yi-Lin Sung , Jaehong Yoon , Mohit Bansal

While Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm for boosting large language models (LLMs) in knowledge-intensive tasks, it often overlooks the crucial aspect of text chunking within its workflow. This paper…

计算与语言 · 计算机科学 2025-05-22 Jihao Zhao , Zhiyuan Ji , Yuchen Feng , Pengnian Qi , Simin Niu , Bo Tang , Feiyu Xiong , Zhiyu Li

In recent years, there has been significant progress in the development of text-to-image generative models. Evaluating the quality of the generative models is one essential step in the development process. Unfortunately, the evaluation…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Lin Zhao , Tianchen Zhao , Zinan Lin , Xuefei Ning , Guohao Dai , Huazhong Yang , Yu Wang

Image-to-image (I2I) translation methods based on generative adversarial networks (GANs) typically suffer from overfitting when limited training data is available. In this work, we propose a data augmentation method (ReMix) to tackle this…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Jie Cao , Luanxuan Hou , Ming-Hsuan Yang , Ran He , Zhenan Sun

Shared training approaches, such as multi-task learning (MTL) and gradient-based meta-learning, are widely used in various machine learning applications, but they often suffer from negative transfer, leading to performance degradation in…

机器学习 · 计算机科学 2024-12-10 Anshul Thakur , Yichen Huang , Soheila Molaei , Yujiang Wang , David A. Clifton

Image-text matching is gaining a leading role among tasks involving the joint understanding of vision and language. In literature, this task is often used as a pre-training objective to forge architectures able to jointly deal with images…

计算机视觉与模式识别 · 计算机科学 2022-08-01 Nicola Messina , Matteo Stefanini , Marcella Cornia , Lorenzo Baraldi , Fabrizio Falchi , Giuseppe Amato , Rita Cucchiara

Although text-to-image (T2I) models have recently thrived as visual generative priors, their reliance on high-quality text-image pairs makes scaling up expensive. We argue that grasping the cross-modality alignment is not a necessity for a…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Shuailei Ma , Kecheng Zheng , Ying Wei , Wei Wu , Fan Lu , Yifei Zhang , Chen-Wei Xie , Biao Gong , Jiapeng Zhu , Yujun Shen

Text-guided image editing using Text-to-Image (T2I) models often fails to yield satisfactory results, frequently introducing unintended modifications, such as the loss of local detail and color changes. In this paper, we analyze these…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Yufan Ren , Zicong Jiang , Tong Zhang , Søren Forchhammer , Sabine Süsstrunk

Recent significant advances in text-to-image models unlock the possibility of training vision systems using synthetic images, potentially overcoming the difficulty of collecting curated data at scale. It is unclear, however, how these…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Lijie Fan , Kaifeng Chen , Dilip Krishnan , Dina Katabi , Phillip Isola , Yonglong Tian

Machine learning models are increasingly being utilized across various fields and tasks due to their outstanding performance and strong generalization capabilities. Nonetheless, their success hinges on the availability of large volumes of…

机器学习 · 计算机科学 2024-11-26 Shreen Gul , Mohamed Elmahallawy , Sanjay Madria , Ardhendu Tripathy

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Yiming Zhao , Zhouhui Lian

In recent years, significant progress has been made in the development of text-to-image generation models. However, these models still face limitations when it comes to achieving full controllability during the generation process. Often,…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Salaheldin Mohamed

The issue of generative pretraining for vision models has persisted as a long-standing conundrum. At present, the text-to-image (T2I) diffusion model demonstrates remarkable proficiency in generating high-definition images matching textual…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Qiang Wan , Zilong Huang , Bingyi Kang , Jiashi Feng , Li Zhang

Rapid advances in text-to-image (T2I) generation have raised higher requirements for evaluation methodologies. Existing benchmarks center on objective capabilities and dimensions, but lack an application-scenario perspective, limiting…

人工智能 · 计算机科学 2025-09-23 Xiaojing Dong , Weilin Huang , Liang Li , Yiying Li , Shu Liu , Tongtong Ou , Shuang Ouyang , Yu Tian , Fengxuan Zhao

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

In recent years, Text-to-Image (T2I) models have been extensively studied, especially with the emergence of diffusion models that achieve state-of-the-art results on T2I synthesis tasks. However, existing benchmarks heavily rely on…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Eslam Mohamed Bakr , Pengzhan Sun , Xiaoqian Shen , Faizan Farooq Khan , Li Erran Li , Mohamed Elhoseiny