English
Related papers

Related papers: Evolving, Not Training: Zero-Shot Reasoning Segmen…

200 papers

Recent studies have revealed the potential of training open-source Large Language Models (LLMs) to unleash LLMs' reasoning ability for enhancing vision-language navigation (VLN) performance, and simultaneously mitigate the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Bingqian Lin , Yunshuang Nie , Khun Loun Zai , Ziming Wei , Mingfei Han , Rongtao Xu , Minzhe Niu , Jianhua Han , Hanwang Zhang , Liang Lin , Bokui Chen , Cewu Lu , Xiaodan Liang

The Segment Anything Model (SAM) exhibits remarkable versatility and zero-shot learning abilities, owing largely to its extensive training data (SA-1B). Recognizing SAM's dependency on manual guidance given its category-agnostic nature, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Xiyu Qi , Yifan Wu , Yongqiang Mao , Wenhui Zhang , Yidan Zhang

Free-text promptable 3D medical image segmentation offers an intuitive and clinically flexible interaction paradigm. However, current methods are highly sensitive to linguistic variability: minor changes in phrasing can cause substantial…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Tongrui Zhang , Chenhui Wang , Yongming Li , Zhihao Chen , Xufeng Zhan , Hongming Shan

Semantic segmentation is a crucial task in computer vision that involves segmenting images into semantically meaningful regions at the pixel level. However, existing approaches often rely on expensive human annotations as supervision for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Jun Chen , Deyao Zhu , Guocheng Qian , Bernard Ghanem , Zhicheng Yan , Chenchen Zhu , Fanyi Xiao , Mohamed Elhoseiny , Sean Chang Culatana

This study introduces SpatialPrompting, a novel framework that harnesses the emergent reasoning capabilities of off-the-shelf multimodal large language models to achieve zero-shot spatial reasoning in three-dimensional (3D) environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Shun Taguchi , Hideki Deguchi , Takumi Hamazaki , Hiroyuki Sakai

Is Segment Anything Model 3 (SAM3) capable in segmenting Any Pathology Images? Digital pathology segmentation spans tissue-level and nuclei-level scales, where traditional methods often suffer from high annotation costs and poor…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qiuyu Kong , Shakiba Sharifi , Yiming Wang , Marco Cristani , Zanxi Ruan

Current reinforcement learning (RL) frameworks for large language models (LLM) post-training typically assume a fixed prompt distribution, which is sub-optimal and bottlenecks scalability. Prior works have explored prompt evolving, but are…

Computation and Language · Computer Science 2025-04-11 Ziyu Ye , Rishabh Agarwal , Tianqi Liu , Rishabh Joshi , Sarmishta Velury , Quoc V. Le , Qijun Tan , Yuan Liu

Recent advancements in open vocabulary models, like CLIP, have notably advanced zero-shot classification and segmentation by utilizing natural language for class-specific embeddings. However, most research has focused on improving model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wenfang Sun , Yingjun Du , Gaowen Liu , Ramana Kompella , Cees G. M. Snoek

Segment Anything Model (SAM) has attracted widespread attention for its superior interactive segmentation capabilities with visual prompts while lacking further exploration of text prompts. In this paper, we empirically investigate what…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuxuan Zhang , Tianheng Cheng , Lianghui Zhu , Rui Hu , Lei Liu , Heng Liu , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

The rapid advancement of Large Language Models (LLMs) poses a significant challenge to existing mathematical reasoning benchmarks. However, these benchmarks tend to become easier over time as LLMs can learn from the published benchmarks.…

Artificial Intelligence · Computer Science 2025-10-07 Shengbo Wang , Mingwei Liu , Zike Li , Anji Li , Yanlin Wang , Xin Peng , Zibin Zheng

Interpreting object-referential language and grounding objects in 3D with spatial relations and attributes is essential for robots operating alongside humans. However, this task is often challenging due to the diversity of scenes, large…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Nader Zantout , Haochen Zhang , Pujith Kachana , Jinkai Qiu , Guofei Chen , Ji Zhang , Wenshan Wang

The recent SAM 3 and SAM 3D have introduced significant advancements over the predecessor, SAM 2, particularly with the integration of language-based segmentation and enhanced 3D perception capabilities. SAM 3 supports zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Wenzhen Dong , Jieming Yu , Yiming Huang , Hongqiu Wang , Lei Zhu , Albert C. S. Chung , Hongliang Ren , Long Bai

Recent advancements in prompt engineering strategies, such as Chain-of-Thought (CoT) and Self-Discover, have demonstrated significant potential in improving the reasoning abilities of Large Language Models (LLMs). However, these…

Computation and Language · Computer Science 2024-10-15 Krishna Aswani , Huilin Lu , Pranav Patankar , Priya Dhalwani , Iris Tan , Jayant Ganeshmohan , Simon Lacasse

Reference Audio-Visual Segmentation (Ref-AVS) tasks challenge models to precisely locate sounding objects by integrating visual, auditory, and textual cues. Existing methods often lack genuine semantic understanding, tending to memorize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Ziyang Luo , Nian Liu , Fahad Shahbaz Khan , Junwei Han

Segmentation is a fundamental task in computer vision, with prompt-driven methods gaining prominence due to their flexibility. The Segment Anything Model (SAM) excels at point-prompted segmentation, while text-based models, often leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Suzhe Xu , Jialin Peng , Chengyuan Zhang

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

Large language models (LLMs) are increasingly trained with reinforcement learning from verifiable rewards (RLVR), yet real-world deployment demands models that can self-improve without labels or external judges. Existing self-improvement…

Machine Learning · Computer Science 2026-02-19 Yujun Zhou , Zhenwen Liang , Haolin Liu , Wenhao Yu , Kishan Panaganti , Linfeng Song , Dian Yu , Xiangliang Zhang , Haitao Mi , Dong Yu

The prevailing paradigm for training large reasoning models--combining Supervised Fine-Tuning (SFT) with Reinforcement Learning with Verifiable Rewards (RLVR)--is fundamentally constrained by its reliance on high-quality, human-annotated…

Machine Learning · Computer Science 2026-03-24 Yuanfu Wang , Zhixuan Liu , Xiangtian Li , Chaochao Lu , Chao Yang

This paper investigates the fundamental discontinuity between the latest two Segment Anything Models: SAM2 and SAM3. We explain why the expertise in prompt-based segmentation of SAM2 does not transfer to the multimodal concept-driven…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Ranjan Sapkota , Konstantinos I. Roumeliotis , Manoj Karkee

Segment Anything Model 3 (SAM3) advances open-vocabulary segmentation through promptable concept segmentation, enabling users to segment all instances associated with a given concept using short noun-phrase (NP) prompts. While effective for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jingjing Li , Yue Feng , Yuchen Guo , Jincai Huang , Wei Ji , Qi Bi , Yongri Piao , Miao Zhang , Xiaoqi Zhao , Qiang Chen , Shihao Zou , Huchuan Lu , Li Cheng