English
Related papers

Related papers: OAD-Promoter: Enhancing Zero-shot VQA using Large …

200 papers

Open-Vocabulary Object Detection (OVD) faces severe performance degradation when applied to UAV imagery due to the domain gap from ground-level datasets. To address this challenge, we propose a complete UAV-oriented solution that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Zhenhai Weng , Xinjie Li , Can Wu , Weijie He , Jianfeng Lv , Dong Zhou , Zhongliang Yu

Image Quality Assessment (IQA) models benefit significantly from semantic information, which allows them to treat different types of objects distinctly. Currently, leveraging semantic information to enhance IQA is a crucial research…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Wensheng Pan , Timin Gao , Yan Zhang , Runze Hu , Xiawu Zheng , Enwei Zhang , Yuting Gao , Yutao Liu , Yunhang Shen , Ke Li , Shengchuan Zhang , Liujuan Cao , Rongrong Ji

This report provide a detailed description of the method that we explored and proposed in the ECCV OOD-CV UNICORN Challenge 2024, which focusing on the robustness of responses from large language models. The dataset of this competition are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Zhouyang Chi , Qingyuan Jiang , Yang Yang

In this era of technological advancements, several cutting-edge techniques are being implemented to enhance Autonomous Driving (AD) systems, focusing on improving safety, efficiency, and adaptability in complex driving environments.…

Computation and Language · Computer Science 2025-02-27 Md Robiul Islam

In this work, we tackle the limitations of current LiDAR-based 3D object detection systems, which are hindered by a restricted class vocabulary and the high costs associated with annotating new object classes. Our exploration of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Djamahl Etchegaray , Zi Huang , Tatsuya Harada , Yadan Luo

Object-goal navigation requires mobile robots to efficiently locate targets with visual and spatial information, yet existing methods struggle with generalization in unseen environments. Heuristic approaches with naive metrics fail in…

Robotics · Computer Science 2025-07-22 Mengying Lin , Shugao Liu , Dingxi Zhang , Yaran Chen , Zhaoran Wang , Haoran Li , Dongbin Zhao

Retrieval-augmented generation (RAG) with large language models (LLMs) plays a crucial role in question answering, as LLMs possess limited knowledge and are not updated with continuously growing information. Most recent work on RAG has…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shichao Kan , Yuhai Deng , Jiale Fu , Lihui Cen , Zhe Qu , Linna Zhang , Yixiong Liang , Yigang Cen

Autonomous driving technology, a catalyst for revolutionizing transportation and urban mobility, has the tend to transition from rule-based systems to data-driven strategies. Traditional module-based systems are constrained by cumulative…

Artificial Intelligence · Computer Science 2024-08-13 Zhenjie Yang , Xiaosong Jia , Hongyang Li , Junchi Yan

Open-vocabulary object detection aims to recognize objects from an open set of categories, which leverages vision-language models (VLMs) pre-trained on large-scale image-text data. The cooperative paradigm combines an object detector with a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yazhe Wan , Changjae Oh

The advantages of pre-trained large language models (LLMs) are apparent in a variety of language processing tasks. But can a language model's knowledge be further harnessed to effectively disambiguate objects and navigate decision-making…

Robotics · Computer Science 2024-01-09 Connie Jiang , Yiqing Xu , David Hsu

3D object detection plays a crucial role in autonomous systems, yet existing methods are limited by closed-set assumptions and struggle to recognize novel objects and their attributes in real-world scenarios. We propose OVODA, a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinhao Xiang , Kuan-Chuan Peng , Suhas Lohit , Michael J. Jones , Jiawei Zhang

Our objective is to generate Audio Descriptions (ADs) for both movies and TV series in a training-free manner. We use the power of off-the-shelf Visual-Language Models (VLMs) and Large Language Models (LLMs), and develop visual and text…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Junyu Xie , Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

In this paper, we explore effective prompting techniques to enhance zero- and few-shot Visual Question Answering (VQA) performance in contemporary Vision-Language Models (VLMs). Central to our investigation is the role of question templates…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Rabiul Awal , Le Zhang , Aishwarya Agrawal

Detecting out-of-distribution (OOD) data is crucial in real-world machine learning applications, particularly in safety-critical domains. Existing methods often leverage language information from vision-language models (VLMs) to enhance OOD…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shu Zou , Xinyu Tian , Qinyu Zhao , Zhaoyuan Yang , Jing Zhang

The integration of Large Language Models (LLMs) and knowledge graphs (KGs) has achieved remarkable success in various natural language processing tasks. However, existing methodologies that integrate LLMs and KGs often navigate the…

Computation and Language · Computer Science 2024-06-05 Lei Sun , Zhengwei Tao , Youdi Li , Hiroshi Arakawa

To facilitate zero-shot generalization in taskoriented dialog, this paper proposes Language Models as Data (LAD). LAD is a paradigm for creating diverse and accurate synthetic data which conveys the necessary structural constraints and can…

Computation and Language · Computer Science 2022-08-01 Shikib Mehri , Yasemin Altun , Maxine Eskenazi

Large Language Models (LLMs), AI models trained on massive text corpora with remarkable language understanding and generation capabilities, are transforming the field of Autonomous Driving (AD). As AD systems evolve from rule-based and…

Artificial Intelligence · Computer Science 2024-07-30 Yun Li , Kai Katsumata , Ehsan Javanmardi , Manabu Tsukada

While large language models have demonstrated impressive performance across various domains and tasks, their security issues have become increasingly severe. Machine unlearning has emerged as a representative approach for model safety and…

Machine Learning · Computer Science 2025-03-04 Chongyang Gao , Lixu Wang , Kaize Ding , Chenkai Weng , Xiao Wang , Qi Zhu

Despite advances in Visual Question Answering (VQA), the ability of models to assess their own correctness remains underexplored. Recent work has shown that VQA models, out-of-the-box, can have difficulties abstaining from answering when…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Corentin Dancette , Spencer Whitehead , Rishabh Maheshwary , Ramakrishna Vedantam , Stefan Scherer , Xinlei Chen , Matthieu Cord , Marcus Rohrbach

In the progress of industrial anomaly detection, general anomaly detection (GAD) is an emerging trend and also the ultimate goal. Unlike the conventional single- and multi-class AD, general AD aims to train a general AD model that can…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xincheng Yao , Zefeng Qian , Chao Shi , Jiayang Song , Chongyang Zhang