中文
相关论文

相关论文: ShareGPT-4o-Image: Aligning Multimodal Models with…

200 篇论文

Large language models require vast amounts of high-quality training data, but effective filtering of web-scale datasets remains a significant challenge. This paper demonstrates that GPT-4o is remarkably effective at identifying high-quality…

计算与语言 · 计算机科学 2025-02-03 Jifan Zhang , Ziyue Luo , Jia Liu , Ness Shroff , Robert Nowak

Generative AI (GenAI) holds significant promise for automating everyday image editing tasks, especially following the recent release of GPT-4o on March 25, 2025. However, what subjects do people most often want edited? What kinds of editing…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Mohammad Reza Taesiri , Brandon Collins , Logan Bolton , Viet Dac Lai , Franck Dernoncourt , Trung Bui , Anh Totti Nguyen

Thanks to the emerging of foundation models, the large language and vision models are integrated to acquire the multimodal ability of visual captioning, question answering, etc. Although existing multimodal models present impressive…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Bo Zhao , Boya Wu , Muyang He , Tiejun Huang

Diffusion models have gained tremendous success in text-to-image generation, yet still lag behind with visual understanding tasks, an area dominated by autoregressive vision-language models. We propose a large-scale and fully end-to-end…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Zijie Li , Henry Li , Yichun Shi , Amir Barati Farimani , Yuval Kluger , Linjie Yang , Peng Wang

While recent advancements in vision-language models have had a transformative impact on multi-modal comprehension, the extent to which these models possess the ability to comprehend generated images remains uncertain. Synthetic images, in…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Keqiang Sun , Junting Pan , Yuying Ge , Hao Li , Haodong Duan , Xiaoshi Wu , Renrui Zhang , Aojun Zhou , Zipeng Qin , Yi Wang , Jifeng Dai , Yu Qiao , Limin Wang , Hongsheng Li

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models still struggle with prompts that require rich world knowledge and implicit reasoning: both of which are critical for producing…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Daoan Zhang , Che Jiang , Ruoshi Xu , Biaoxiang Chen , Zijian Jin , Yutian Lu , Jianguo Zhang , Liang Yong , Jiebo Luo , Shengda Luo

Research on text-to-image generation has witnessed significant progress in generating diverse and photo-realistic images, driven by diffusion and auto-regressive models trained on large-scale image-text data. Though state-of-the-art models…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Wenhu Chen , Hexiang Hu , Chitwan Saharia , William W. Cohen

In this paper, we present an end-to-end approach to generate high-resolution person images conditioned on texts only. State-of-the-art text-to-image generation models are mainly designed for center-object generation, e.g., flowers and…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Deyin Liu , Lin Yuanbo Wu , Bo Li , Zongyuan Ge

Recently, GPT-4 with Vision (GPT-4V) has demonstrated remarkable visual capabilities across various tasks, but its performance in emotion recognition has not been fully evaluated. To bridge this gap, we present the quantitative evaluation…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Zheng Lian , Licai Sun , Haiyang Sun , Kang Chen , Zhuofan Wen , Hao Gu , Bin Liu , Jianhua Tao

The rapid development of Multimodal Large Language Models (MLLMs) has enabled the integration of multiple modalities, including texts and images, within the large language model (LLM) framework. However, texts and images are usually…

人工智能 · 计算机科学 2025-03-11 Yi Fang , Bowen Jin , Jiacheng Shen , Sirui Ding , Qiaoyu Tan , Jiawei Han

Vision Transformers (ViTs) have outperformed traditional Convolutional Neural Network architectures and achieved state-of-the-art results in various computer vision tasks. Since ViTs are computationally expensive, the models either have to…

分布式、并行与集群计算 · 计算机科学 2025-02-17 Linyi Jiang , Silvery D. Fu , Yifei Zhu , Bo Li

OpenAI released version GPT-4 on March 14, 2023, following the success of ChatGPT, which was announced in November 2022. In addition to the existing GPT-3 features, GPT-4 can interpret images. To achieve this, the processing power and model…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Omer Aydin , Enis Karaarslan

Text-to-3D generation represents an exciting field that has seen rapid advancements, facilitating the transformation of textual descriptions into detailed 3D models. However, current progress often neglects the intricate high-order…

计算机视觉与模式识别 · 计算机科学 2025-01-10 Donglin Di , Jiahui Yang , Chaofan Luo , Zhou Xue , Wei Chen , Xun Yang , Yue Gao

Identity-consistent generation has become an important focus in text-to-image research, with recent models achieving notable success in producing images aligned with a reference identity. Yet, the scarcity of large-scale paired datasets…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Hengyuan Xu , Wei Cheng , Peng Xing , Yixiao Fang , Shuhan Wu , Rui Wang , Xianfang Zeng , Daxin Jiang , Gang Yu , Xingjun Ma , Yu-Gang Jiang

Unifying image understanding and generation has gained growing attention in recent research on multimodal models. Although design choices for image understanding have been extensively studied, the optimal model architecture and training…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Jiuhai Chen , Zhiyang Xu , Xichen Pan , Yushi Hu , Can Qin , Tom Goldstein , Lifu Huang , Tianyi Zhou , Saining Xie , Silvio Savarese , Le Xue , Caiming Xiong , Ran Xu

A good Text-to-Image model should not only generate high quality images, but also ensure the consistency between the text and the generated image. Previous models failed to simultaneously fix both sides well. This paper proposes a Gradual…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Bo Yang , Fangxiang Feng , Xiaojie Wang

Recently, Vector Quantized AutoRegressive (VQ-AR) models have shown remarkable results in text-to-image synthesis by equally predicting discrete image tokens from the top left to bottom right in the latent space. Although the simple…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Zhengcong Fei , Mingyuan Fan , Li Zhu , Junshi Huang

The effectiveness of Multimodal Large Language Models (MLLMs) demonstrates a profound capability in multimodal understanding. However, the simultaneous generation of images with coherent texts is still underdeveloped. Addressing this, we…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Kaizhi Zheng , Xuehai He , Xin Eric Wang

In the current landscape of artificial intelligence, foundation models serve as the bedrock for advancements in both language and vision domains. OpenAI GPT-4 has emerged as the pinnacle in large language models (LLMs), while the computer…

计算机视觉与模式识别 · 计算机科学 2023-11-20 Chris Kelly , Luhui Hu , Cindy Yang , Yu Tian , Deshun Yang , Bang Yang , Zaoshan Huang , Zihao Li , Yuexian Zou

Recent image generation models have shown strong capabilities in generating high-fidelity and photorealistic images. However, they are fundamentally constrained by frozen internal knowledge, thus often failing on real-world scenarios that…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Kaituo Feng , Manyuan Zhang , Shuang Chen , Yunlong Lin , Kaixuan Fan , Yilei Jiang , Hongyu Li , Dian Zheng , Chenyang Wang , Xiangyu Yue