English
Related papers

Related papers: Synthesizing the Kill Chain: A Zero-Shot Framework…

200 papers

This paper introduces a novel framework for zero-shot learning (ZSL), i.e., to recognize new categories that are unseen during training, by using a multi-model and multi-alignment integration method. Specifically, we propose three…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Siqi Yin , Lifan Jiang

This paper introduces Grounding DINO 1.5, a suite of advanced open-set object detection models developed by IDEA Research, which aims to advance the "Edge" of open-set object detection. The suite encompasses two models: Grounding DINO 1.5…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tianhe Ren , Qing Jiang , Shilong Liu , Zhaoyang Zeng , Wenlong Liu , Han Gao , Hongjie Huang , Zhengyu Ma , Xiaoke Jiang , Yihao Chen , Yuda Xiong , Hao Zhang , Feng Li , Peijun Tang , Kent Yu , Lei Zhang

Although vision-language navigation (VLN) has progressed rapidly, zero-shot VLN in continuous environments (VLN-CE) remains highly challenging when using lightweight vision-language models (VLMs), whose limited reasoning capacity makes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Kun Luo , Xiangyu Dong , Xiaoguang Ma , Haoran Zhao , Yaoming Zhou

Effectively understanding urban scenes requires fine-grained spatial reasoning about objects, layouts, and depth cues. However, how well current vision-language models (VLMs), pretrained on general scenes, transfer these abilities to urban…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Juneyoung Ro , Namwoo Kim , Yoonjin Yoon

The recent progress in large language models (LLMs), especially the invention of chain-of-thought prompting, has made it possible to automatically answer questions by stepwise reasoning. However, when faced with more complicated problems…

Artificial Intelligence · Computer Science 2023-10-06 Ning Miao , Yee Whye Teh , Tom Rainforth

While end-to-end Vision-Language-Action (VLA) models offer a promising paradigm for robotic manipulation, fine-tuning them on narrow control data often compromises the profound reasoning capabilities inherited from their base…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tianshuo Yang , Guanyu Chen , Yutian Chen , Zhixuan Liang , Yitian Liu , Zanxin Chen , Chunpu Xu , Haotian Liang , Jiangmiao Pang , Yao Mu , Ping Luo

Autonomous indoor mobile robots can navigate reliably to metric coordinates using established frameworks such as ROS 2 Navigation 2, yet they lack the ability to interpret natural language instructions that express intent rather than…

Robotics · Computer Science 2026-05-05 Bogdan Felician Abaza , Andrei-Alexandru Staicu , Cristian Vasile Doicin

Zero Reinforcement Learning (Zero-RL) has proven to be an effective approach for enhancing the reasoning capabilities of large language models (LLMs) by directly applying reinforcement learning with verifiable rewards on pretrained models,…

Artificial Intelligence · Computer Science 2025-10-30 Yuyuan Zeng , Yufei Huang , Can Xu , Qingfeng Sun , Jianfeng Yan , Guanghui Xu , Tao Yang , Fengzong Lian

Zero-shot learning methods rely on fixed visual and semantic embeddings, extracted from independent vision and language models, both pre-trained for other large-scale tasks. This is a weakness of current zero-shot learning frameworks as…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Shah Nawaz , Jacopo Cavazza , Alessio Del Bue

Benefiting from strong generalization ability, pre-trained vision language models (VLMs), e.g., CLIP, have been widely utilized in zero-shot scene understanding. Unlike simple recognition tasks, grounded situation recognition (GSR) requires…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Jiaming Lei , Lin Li , Chunping Wang , Jun Xiao , Long Chen

Despite progress in automated fact-checking, most systems require a significant amount of labeled training data, which is expensive. In this paper, we propose a novel zero-shot method, which instead of operating directly on the claim and…

Computation and Language · Computer Science 2023-12-20 Zhangdie Yuan , Andreas Vlachos

We propose a training-free, binary verification workflow for zero-shot vision with off-the-shelf VLMs. It comprises two steps: (i) quantization, which turns the open-ended query into a multiple-choice question (MCQ) with a small, explicit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Rongbin Hu , Jeffrey Liu

Remote sensing visual grounding (RSVG) aims to localize objects in remote sensing images based on free-form natural language expressions. Existing approaches are typically constrained to closed-set vocabularies, limiting their applicability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Ke Li , Di Wang , Ting Wang , Fuyu Dong , Yiming Zhang , Luyao Zhang , Xiangyu Wang , Shaofeng Li , Quan Wang

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

In this paper, we present a novel method for reliable frontier selection in Zero-Shot Object Goal Navigation (ZS-OGN), enhancing robotic navigation systems with foundation models to improve commonsense reasoning in indoor environments. Our…

Robotics · Computer Science 2024-10-29 Shuaihang Yuan , Halil Utku Unlu , Hao Huang , Congcong Wen , Anthony Tzes , Yi Fang

The existing zero-shot detection approaches project visual features to the semantic domain for seen objects, hoping to map unseen objects to their corresponding semantics during inference. However, since the unseen objects are never…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Nasir Hayat , Munawar Hayat , Shafin Rahman , Salman Khan , Syed Waqas Zamir , Fahad Shahbaz Khan

Large-scale pre-trained models (PTMs) show great zero-shot capabilities. In this paper, we study how to leverage them for zero-shot visual question answering (VQA). Our approach is motivated by a few observations. First, VQA questions often…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Rui Cao , Jing Jiang

This report provides an architecture-led analysis of two modern vision-language models (VLMs), Qwen2.5-VL-7B-Instruct and Llama-4-Scout-17B-16E-Instruct, and explains how their architectural properties map to a practical video-to-artifact…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Thomson Tong , Diba Darooneh

The deployment of artificial intelligence models at the edge is increasingly critical for autonomous robots operating in GPS-denied environments where local, resource-efficient reasoning is essential. This work demonstrates the feasibility…

Robotics · Computer Science 2025-11-11 Justin Williams , Kishor Datta Gupta , Roy George , Mrinmoy Sarkar

As we move towards large-scale object detection, it is unrealistic to expect annotated training data, in the form of bounding box annotations around objects, for all object classes at sufficient scale, and so methods capable of unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama