English
Related papers

Related papers: Venn Diagram Prompting : Accelerating Comprehensio…

200 papers

We propose a novel approach for dynamic negative prompting in diffusion models that leverages Vision-Language Models (VLMs) to adaptively generate negative prompts during the denoising process. Unlike traditional Negative Prompting methods…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Hoyeon Chang , Seungjin Kim , Yoonseok Choi

Autoregressive language models decode left-to-right with irreversible commitments, limiting revision during multi-step reasoning. We propose \textbf{VDLM}, a modular variable diffusion language model that separates semantic planning from…

Computation and Language · Computer Science 2026-02-19 Shuhui Qu

Creative generation is the synthesis of new, surprising, and valuable samples that reflect user intent yet cannot be envisioned in advance. This task aims to extend human imagination, enabling the discovery of visual concepts that exist in…

Graphics · Computer Science 2025-10-14 Shelly Golan , Yotam Nitzan , Zongze Wu , Or Patashnik

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

In histopathology, tissue sections are typically stained using common H&E staining or special stains (MAS, PAS, PASM, etc.) to clearly visualize specific tissue structures. The rapid advancement of deep learning offers an effective solution…

Image and Video Processing · Electrical Eng. & Systems 2025-04-23 Zizhi Chen , Xinyu Zhang , Minghao Han , Yizhou Liu , Ziyun Qian , Weifeng Zhang , Xukun Zhang , Jingwei Wei , Lihua Zhang

Pre-trained vision-language models (VLMs) have shown impressive performance on various downstream tasks by utilizing knowledge learned from large data. In general, the performance of VLMs on target tasks can be further improved by prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Eulrang Cho , Jooyeon Kim , Hyunwoo J. Kim

Large language models (LLMs) are documented to struggle in settings that require complex reasoning. Nevertheless, instructing the model to break down the problem into smaller reasoning steps, or ensembling various generations through…

Computation and Language · Computer Science 2024-02-27 Ranjita Naik , Varun Chandrasekaran , Mert Yuksekgonul , Hamid Palangi , Besmira Nushi

In this paper, we propose a novel approach for solving the Visual Question Answering (VQA) task in autonomous driving by integrating Vision-Language Models (VLMs) with continual learning. In autonomous driving, VQA plays a vital role in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yuxin Lin , Mengshi Qi , Liang Liu , Huadong Ma

The emergence of Software-Defined Vehicles (SDVs) marks a paradigm shift in the automotive industry, where software now plays a pivotal role in defining vehicle functionality, enabling rapid innovation of modern vehicles. Developing…

Software Engineering · Computer Science 2025-11-10 Quang-Dung Nguyen , Tri-Dung Tran , Thanh-Hieu Chu , Hoang-Loc Tran , Xiangwei Cheng , Dirk Slama

Vision-Language Models (VLMs) have demonstrated impressive performance on various visual tasks, yet they still require adaptation on downstream tasks to achieve optimal performance. Recently, various adaptation technologies have been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chuanming Wang , Henming Mao , Huanhuan Zhang , Huiyuan Fu , Huadong Ma

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

Large Language Models (LLMs) have the potential to revolutionize automated traceability by overcoming the challenges faced by previous methods and introducing new possibilities. However, the optimal utilization of LLMs for automated…

Software Engineering · Computer Science 2023-08-02 Alberto D. Rodriguez , Katherine R. Dearstyne , Jane Cleland-Huang

While Large Language Models (LLMs) excel at reasoning on text and Vision-Language Models (VLMs) are highly effective for visual perception, applying those models for visual instruction-based planning remains a widely open problem. In this…

Machine Learning · Computer Science 2025-09-11 Mohamed Salim Aissi , Clemence Grislain , Mohamed Chetouani , Olivier Sigaud , Laure Soulier , Nicolas Thome

Prompt engineering has emerged as an integral technique for extending the strengths and abilities of Large Language Models (LLMs) to gain significant performance gains in various Natural Language Processing (NLP) tasks. This approach, which…

Computation and Language · Computer Science 2026-02-13 Munazza Zaib , Elaf Alhazmi

The springing up of Large Language Models (LLMs) has shifted the community from single-task-orientated natural language processing (NLP) research to a holistic end-to-end multi-task learning paradigm. Along this line of research endeavors…

Computation and Language · Computer Science 2023-10-31 Yuanfeng Song , Yuanqin He , Xuefang Zhao , Hanlin Gu , Di Jiang , Haijun Yang , Lixin Fan , Qiang Yang

Recent advances in pre-trained Vision Language Models (VLM) have shown promising potential for effectively adapting to downstream tasks through prompt learning, without the need for additional annotated paired datasets. To supplement the…

Machine Learning · Computer Science 2025-07-11 Sua Lee , Kyubum Shin , Jung Ho Park

Despite the successes of large language models (LLMs), they exhibit significant drawbacks, particularly when processing long contexts. Their inference cost scales quadratically with respect to sequence length, making it expensive for…

Computation and Language · Computer Science 2024-07-22 Thomas Merth , Qichen Fu , Mohammad Rastegari , Mahyar Najibi

Panoptic Scene Graph Generation (PSG) aims at achieving a comprehensive image understanding by simultaneously segmenting objects and predicting relations among objects. However, the long-tail problem among relations leads to unsatisfactory…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zijian Zhou , Miaojing Shi , Holger Caesar

The `pre-train, prompt, predict' paradigm of large language models (LLMs) has achieved remarkable success in open-domain question answering (OD-QA). However, few works explore this paradigm in the scenario of multi-document question…

Computation and Language · Computer Science 2023-12-27 Yu Wang , Nedim Lipka , Ryan A. Rossi , Alexa Siu , Ruiyi Zhang , Tyler Derr

Vision-language models (VLMs) have demonstrated impressive performance by effectively integrating visual and textual information to solve complex tasks. However, it is not clear how these models reason over the visual and textual data…

Artificial Intelligence · Computer Science 2025-04-15 Pouya Pezeshkpour , Moin Aminnaseri , Estevam Hruschka