中文
相关论文

相关论文: Visual Puns from Idioms: An Iterative LLM-T2IM-MLL…

200 篇论文

Large Vision-Language Models (LVLMs) that incorporate visual models and large language models have achieved impressive results across cross-modal understanding and reasoning tasks. In recent years, person re-identification (ReID) has also…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Qizao Wang , Bin Li , Xiangyang Xue

One critical prerequisite for faithful text-to-image generation is the accurate understanding of text inputs. Existing methods leverage the text encoder of the CLIP model to represent input prompts. However, the pre-trained CLIP model can…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Zhiyu Tan , Mengping Yang , Luozheng Qin , Hao Yang , Ye Qian , Qiang Zhou , Cheng Zhang , Hao Li

The creation of high-quality human-labeled image-caption datasets presents a significant bottleneck in the development of Visual-Language Models (VLMs). In this work, we investigate an approach that leverages the strengths of Large Language…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Sahand Sharifzadeh , Christos Kaplanis , Shreya Pathak , Dharshan Kumaran , Anastasija Ilic , Jovana Mitrovic , Charles Blundell , Andrea Banino

The capabilities of Large Language Models (LLMs) in code generation have been extensively studied, particularly for implementing target functionalities from natural-language descriptions. Alternatively, input-output (I/O) examples provide…

软件工程 · 计算机科学 2025-05-13 Yingjie Fu , Bozhou Li , Linyi Li , Wentao Zhang , Tao Xie

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

计算与语言 · 计算机科学 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao

Large language models (LLMs) enable system builders today to create competent NLP systems through prompting, where they only need to describe the task in natural language and provide a few examples. However, in other ways, LLMs are a step…

计算与语言 · 计算机科学 2023-08-24 Vijay Viswanathan , Chenyang Zhao , Amanda Bertsch , Tongshuang Wu , Graham Neubig

Large Vision-Language Models (VLMs) have demonstrated strong capabilities in tasks requiring a fine-grained understanding of literal meaning in images and text, such as visual question-answering or visual entailment. However, there has been…

计算与语言 · 计算机科学 2025-02-18 Arkadiy Saakyan , Shreyas Kulkarni , Tuhin Chakrabarty , Smaranda Muresan

Vision-language large models have achieved remarkable success in various multi-modal tasks, yet applying them to video understanding remains challenging due to the inherent complexity and computational demands of video data. While…

计算机视觉与模式识别 · 计算机科学 2024-10-17 Kai Han , Jianyuan Guo , Yehui Tang , Wei He , Enhua Wu , Yunhe Wang

This project investigates the capabilities of large language models (LLMs) to determine the difficulty of data visualization literacy test items. We explore whether features derived from item text (question and answer options), the…

人工智能 · 计算机科学 2026-03-06 Samin Khan

Multimodal Large Language Models (MLLMs) are set to transform how machines process and generate human-like responses by integrating diverse modalities such as text, images, and code. Yet, effectively harnessing their capabilities hinges on…

人工智能 · 计算机科学 2025-04-15 Anwesha Mohanty , Venkatesh Balavadhani Parthasarathy , Arsalan Shahid

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…

Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements…

人工智能 · 计算机科学 2024-06-14 Xinrui Yang , Zhuohan Wang , Anthony Hu

We introduce a novel and extensible benchmark for large language models (LLMs) through grid-based games such as Tic-Tac-Toe, Connect Four, and Gomoku. The open-source game simulation code, available on GitHub, allows LLMs to compete and…

人工智能 · 计算机科学 2024-07-12 Oguzhan Topsakal , Colby Jacob Edell , Jackson Bailey Harper

The integration of generative AI into developer forums like Stack Overflow presents an opportunity to enhance problem-solving by allowing users to post screenshots of code or Integrated Development Environments (IDEs) instead of traditional…

软件工程 · 计算机科学 2025-04-29 Faiz Ahmed , Xuchen Tan , Folajinmi Adewole , Suprakash Datta , Maleknaz Nayebi

Contemporary Text-to-Image (T2I) models frequently depend on qualitative human evaluations to assess the consistency between synthesized images and the text prompts. There is a demand for quantitative and automatic evaluation tools, given…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Ziyuan Qin , Dongjie Cheng , Haoyu Wang , Huahui Yi , Yuting Shao , Zhiyuan Fan , Kang Li , Qicheng Lao

In the paradigm of AI-generated content (AIGC), there has been increasing attention to transferring knowledge from pre-trained text-to-image (T2I) models to text-to-video (T2V) generation. Despite their effectiveness, these frameworks face…

计算机视觉与模式识别 · 计算机科学 2024-02-07 Susung Hong , Junyoung Seo , Heeseong Shin , Sunghwan Hong , Seungryong Kim

Text-to-image generation has evolved beyond single monolithic models to complex multi-component pipelines. These combine fine-tuned generators, adapters, upscaling blocks and even editing steps, leading to significant improvements in image…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Uri Gadot , Rinon Gal , Yftah Ziser , Gal Chechik , Shie Mannor

We study allowing large language models (LLMs) to process arbitrarily long prompts through the lens of inference-time scaling. We propose Recursive Language Models (RLMs), a general inference paradigm that treats long prompts as part of an…

人工智能 · 计算机科学 2026-05-12 Alex L. Zhang , Tim Kraska , Omar Khattab

Conventional, classification-based AI-generated image detection methods cannot explain why an image is considered real or AI-generated in a way a human expert would, which reduces the trustworthiness and persuasiveness of these detection…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Michael Yang , Shijian Deng , William T. Doan , Kai Wang , Tianyu Yang , Harsh Singh , Yapeng Tian