中文
相关论文

相关论文: OralGPT-Plus: Learning to Use Visual Tools via Rei…

200 篇论文

Existing tool-augmented agentic systems are limited in the real world by (i) black-box reasoning steps that undermine trust of decision-making and pose safety risks, (ii) poor multimodal integration, which is inherently critical for…

人工智能 · 计算机科学 2025-12-22 Yushi Feng , Junye Du , Yingying Hong , Qifan Wang , Lequan Yu

Reinforcement learning (RL) with rule-based reward functions has recently shown great promise in enhancing the reasoning depth and generalization ability of vision-language models (VLMs), while maintaining computational efficiency. In spite…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Yizhou Liu , Dingkang Yang , Zizhi Chen , Minghao Han , Xukun Zhang , Keliang Liu , Jingwei Wei , Lihua Zhang

Omnidirectional images (ODIs), with their 360{\deg} field of view, provide unparalleled spatial awareness for immersive applications like augmented reality and embodied AI. However, the capability of existing multi-modal large language…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Xinshen Zhang , Zhen Ye , Xu Zheng

This study investigates deep learning methods for automated classification of dental conditions in panoramic X-ray images. A dataset of 1,512 radiographs with 11,137 expert-verified annotations across four conditions fillings, cavities,…

计算机视觉与模式识别 · 计算机科学 2025-09-01 Alireza Golkarieh , Kiana Kiashemshaki , Sajjad Rezvani Boroujeni

While Vision-Language Models (VLMs) can solve complex tasks through agentic reasoning, their capabilities remain largely constrained to text-oriented chain-of-thought or isolated tool invocation. They fail to exhibit the human-like…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Yong Xien Chng , Tao Hu , Wenwen Tong , Xueheng Li , Jiandong Chen , Haojia Yu , Jiefan Lu , Hewei Guo , Hanming Deng , Chengjun Xie , Gao Huang , Dahua Lin , Lewei Lu

In modern medicine, clinical diagnosis relies on the comprehensive analysis of primarily textual and visual data, drawing on medical expertise to ensure systematic and rigorous reasoning. Recent advances in large Vision-Language Models…

人工智能 · 计算机科学 2025-07-03 Ziyue Wang , Junde Wu , Linghan Cai , Chang Han Low , Xihong Yang , Qiaxuan Li , Yueming Jin

Clinical finding summaries from an orthopantomogram, or a dental panoramic radiograph, have significant potential to improve patient communication and speed up clinical judgments. While orthopantomogram is a first-line tool for dental…

计算机视觉与模式识别 · 计算机科学 2021-07-07 Tzu-Ming Harry Hsu , Yin-Chih Chelsea Wang

We show that multi-agent systems guided by vision-language models (VLMs) improve end-to-end autonomous scientific discovery. By treating plots as verifiable checkpoints, a VLM-as-a-judge evaluates figures against dynamically generated…

计算与语言 · 计算机科学 2025-11-19 Kahaan Gandhi , Boris Bolliet , Inigo Zubeldia

AI tools in pathology have improved screening throughput, standardized quantification, and revealed prognostic patterns that inform treatment. However, adoption remains limited because most systems still lack the human-readable reasoning…

Generating realistic talking-head videos remains challenging due to persistent issues such as imperfect lip synchronization, unnatural motion, and evaluation metrics that correlate poorly with human perception. We propose FlowPortrait, a…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Weiting Tan , Andy T. Liu , Ming Tu , Xinghua Qu , Philipp Koehn , Lu Lu

Reinforcement learning for agentic multimodal models often suffers from interaction collapse, where models learn to reduce tool usage and multi-turn reasoning, limiting the benefits of agentic behavior. We introduce PyVision-RL, a…

人工智能 · 计算机科学 2026-02-25 Shitian Zhao , Shaoheng Lin , Ming Li , Haoquan Zhang , Wenshuo Peng , Kaipeng Zhang , Chen Wei

Medical imaging has revolutionized diagnosis, yet unnecessary procedures are rising, exposing patients to radiation and stress, limiting equitable access, and straining healthcare systems. The American College of Radiology Appropriateness…

定量方法 · 定量生物学 2025-10-08 Anni Tziakouri , Filippo Menolascina

While recent advances in Reinforcement Fine-Tuning (RFT) have shown that rule-based reward schemes can enable effective post-training for large language models, their extension to cross-modal, vision-centric domains remains largely…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Guangjing Yang , ZhangYuan Yu , Ziyuan Qin , Xinyuan Song , Huahui Yi , Qingbo Kang , Jun Gao , Yiyue Li , Chenlin Du , Qicheng Lao

Recent advances in natural-domain multi-modal large language models (MLLMs) have demonstrated effective spatial reasoning through visual and textual prompting. However, their direct transfer to remote sensing (RS) is hindered by…

计算机视觉与模式识别 · 计算机科学 2025-11-07 Wei Zhang , Miaoxin Cai , Yaqian Ning , Tong Zhang , Yin Zhuang , Shijian Lu , He Chen , Jun Li , Xuerui Mao

Although Vision Language Models (VLMs) have shown strong generalization in medical imaging, pathology presents unique challenges due to ultra-high resolution, complex tissue structures, and nuanced clinical semantics. These factors make…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Wenchuan Zhang , Jingru Guo , Hengzhe Zhang , Penghao Zhang , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

Developing 3D vision-language models with robust clinical reasoning remains a challenge due to the inherent complexity of volumetric medical imaging, the tendency of models to overfit superficial report patterns, and the lack of…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Haoran Lai , Zihang Jiang , Kun Zhang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Shaohua Kevin Zhou

Vision Language Models (VLMs) demonstrate strong qualitative visual understanding, but struggle with metrically precise spatial reasoning required for embodied applications. The agentic paradigm promises that VLMs can use a wide variety of…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Siyi Chen , Mikaela Angelina Uy , Chan Hee Song , Faisal Ladhak , Adithyavairavan Murali , Qing Qu , Stan Birchfield , Valts Blukis , Jonathan Tremblay

Recent advances in large language and vision-language models have enabled strong reasoning capabilities, yet they remain impractical for specialized domains like remote sensing, where annotated data is scarce and expensive. We present the…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Aybora Koksal , A. Aydin Alatan

Large-scale multimodal language models (LMMs) have achieved remarkable success in general domains. However, the exploration of diagnostic language models based on multimodal cephalometric medical data remains limited. In this paper, we…

人工智能 · 计算机科学 2023-07-18 Lei Ma , Jincong Han , Zhaoxin Wang , Dian Zhang