English
Related papers

Related papers: Roboflow100-VL: A Multi-Domain Object Detection Be…

200 papers

Innovations in digital intelligence are transforming robotic surgery with more informed decision-making. Real-time awareness of surgical instrument presence and actions (e.g., cutting tissue) is essential for such systems. Yet, despite…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jiajun Cheng , Xianwu Zhao , Sainan Liu , Xiaofan Yu , Ravi Prakash , Patrick J. Codd , Jonathan Elliott Katz , Shan Lin

Despite remarkable progress in Vision-Language-Action models (VLAs) for robot manipulation, these large pre-trained models require fine-tuning to be deployed in specific environments. These fine-tuned models are highly sensitive to camera…

Robotics · Computer Science 2026-03-09 Hyeongjun Heo , Seungyeon Woo , Sang Min Kim , Junho Kim , Junho Lee , Yonghyeon Lee , Young Min Kim

Recent advances in the development of vision-language models (VLMs) are yielding remarkable success in recognizing visual semantic content, including impressive instances of compositional image understanding. Here, we introduce the novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Vishaal Udandarao , Max F. Burg , Samuel Albanie , Matthias Bethge

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

We introduce PLaMo 2.1-VL, a lightweight Vision Language Model (VLM) for autonomous devices, available in 8B and 2B variants and designed for local and edge deployment with Japanese-language operation. Focusing on Visual Question Answering…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Tommi Kerola , Yuya Masuda , Takashi Masuko , Toshiki Nakanishi , Daisuke Nishino , Kuniyuki Takahashi , Hanqin Wang , Yoshihiro Yamada

Vision-Language Models (VLMs) excel at tasks like zero-shot classification and cross-modal retrieval by mapping images and text to a shared space, but this requires expensive end-to-end training with massive paired datasets. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 David Méndez , Roberto Confalonieri , Natalia Díaz Rodríguez

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Learning real-world robotic manipulation is challenging, particularly when limited demonstrations are available. Existing methods for few-shot manipulation often rely on simulation-augmented data or pre-built modules like grasping and pose…

The exponential growth of large language models (LLMs) has opened up numerous possibilities for multimodal AGI systems. However, the progress in vision and vision-language foundation models, which are also critical elements of multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhe Chen , Jiannan Wu , Wenhai Wang , Weijie Su , Guo Chen , Sen Xing , Muyan Zhong , Qinglong Zhang , Xizhou Zhu , Lewei Lu , Bin Li , Ping Luo , Tong Lu , Yu Qiao , Jifeng Dai

Generalization to unseen tasks is an important ability for few-shot learners to achieve better zero-/few-shot performance on diverse tasks. However, such generalization to vision-language tasks including grounding and generation tasks has…

Computation and Language · Computer Science 2023-05-25 Woojeong Jin , Subhabrata Mukherjee , Yu Cheng , Yelong Shen , Weizhu Chen , Ahmed Hassan Awadallah , Damien Jose , Xiang Ren

This review provides a systematic analysis of comprehensive survey of 3D object detection with vision-language models(VLMs) , a rapidly advancing area at the intersection of 3D vision and multimodal AI. By examining over 100 research…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Ranjan Sapkota , Konstantinos I Roumeliotis , Rahul Harsha Cheppally , Marco Flores Calero , Manoj Karkee

Foundation models have revolutionized AI, yet they struggle with zero-shot deployment in real-world industrial settings due to a lack of high-quality, domain-specific datasets. To bridge this gap, Superb AI introduces ZERO, an…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Sangbum Choi , Kyeongryeol Go , Taewoong Jang

Video Understanding, Scene Interpretation and Commonsense Reasoning are highly challenging tasks enabling the interpretation of visual information, allowing agents to perceive, interact with and make rational decisions in its environment.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Nicolas Schuler , Lea Dewald , Nick Baldig , Jürgen Graf

The growing demand for surveillance in public spaces presents significant challenges due to the shortage of human resources. Current AI-based video surveillance systems heavily rely on core computer vision models that require extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Joao Pereira , Vasco Lopes , David Semedo , Joao Neves

The emergence of Vision Language Models (VLMs) has brought unprecedented advances in understanding multimodal information. The combination of textual and visual semantics in VLMs is highly complex and diverse, making the safety alignment of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yongting Zhang , Lu Chen , Guodong Zheng , Yifeng Gao , Rui Zheng , Jinlan Fu , Zhenfei Yin , Senjie Jin , Yu Qiao , Xuanjing Huang , Feng Zhao , Tao Gui , Jing Shao

Cross-Domain Few-Shot Object Detection (CD-FSOD) aims to detect novel classes in unseen target domains given only a few labeled examples. While open-vocabulary detectors built on vision-language models (VLMs) transfer well, they depend…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Wanqi Wang , Jingcai Guo , Yuxiang Cai , Zhi Chen

Video generative models (VGMs) pretrained on large-scale internet data can produce temporally coherent rollout videos that capture rich object dynamics, offering a compelling foundation for zero-shot robotic manipulation. However, VGMs…

Robotics · Computer Science 2026-03-09 Gehao Zhang , Zhenyang Ni , Payal Mohapatra , Han Liu , Ruohan Zhang , Qi Zhu

The integration of language instructions with robotic control, particularly through Vision Language Action (VLA) models, has shown significant potential. However, these systems are often hindered by high computational costs, the need for…

Robotics · Computer Science 2025-02-04 Marie Samson , Bastien Muraccioli , Fumio Kanehiro

For a vision-language model (VLM) to understand the physical world, such as cause and effect, a first step is to capture the temporal dynamics of the visual world, for example how the physical states of objects evolve over time (e.g. a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Kaleb Newman , Shijie Wang , Yuan Zang , David Heffren , Chen Sun

3D Visual Grounding (3DVG) aims to localize objects in 3D scenes using natural language descriptions. Although supervised methods achieve higher accuracy in constrained settings, zero-shot 3DVG holds greater promise for real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Jiawen Lin , Shiran Bian , Yihang Zhu , Wenbin Tan , Yachao Zhang , Yuan Xie , Yanyun Qu