中文
相关论文

相关论文: OralGPT-Plus: Learning to Use Visual Tools via Rei…

200 篇论文

Oversight AI is an emerging concept in radiology where the AI forms a symbiosis with radiologists by continuously supporting radiologists in their decision-making. Recent advances in vision-language models sheds a light on the long-standing…

图像与视频处理 · 电气工程与系统科学 2023-04-13 Sangjoon Park , Eun Sun Lee , Kyung Sook Shin , Jeong Eun Lee , Jong Chul Ye

We present VARGPT, a novel multimodal large language model (MLLM) that unifies visual understanding and generation within a single autoregressive framework. VARGPT employs a next-token prediction paradigm for visual understanding and a…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Xianwei Zhuang , Yuxin Xie , Yufan Deng , Liming Liang , Jinghan Ru , Yuguo Yin , Yuexian Zou

Accurate dental diagnosis is essential for oral healthcare, yet many individuals lack access to timely professional evaluation. Existing AI-based methods primarily treat diagnosis as a visual pattern recognition task and do not reflect the…

3D reconstruction of medical imaging from 2D images has become an increasingly interesting topic with the development of deep learning models in recent years. Previous studies in 3D reconstruction from limited X-ray images mainly rely on…

图像与视频处理 · 电气工程与系统科学 2023-09-06 Weinan Song , Haoxin Zheng , Dezhan Tu , Chengwen Liang , Lei He

Visual reasoning, a cornerstone of human intelligence, encompasses complex perceptual and logical processes essential for solving diverse visual problems. While advances in computer vision have produced powerful models for various…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Zetong Zhou , Dongping Chen , Zixian Ma , Zhihan Hu , Mingyang Fu , Sinan Wang , Yao Wan , Zhou Zhao , Ranjay Krishna

Mammogram mass detection is crucial for diagnosing and preventing the breast cancers in clinical practice. The complementary effect of multi-view mammogram images provides valuable information about the breast anatomical prior structure and…

计算机视觉与模式识别 · 计算机科学 2021-05-24 Yuhang Liu , Fandong Zhang , Chaoqi Chen , Siwen Wang , Yizhou Wang , Yizhou Yu

Analyzing whole-slide images (WSIs) requires an iterative, evidence-driven reasoning process that parallels how pathologists dynamically zoom, refocus, and self-correct while collecting the evidence. However, existing computational…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Jingyun Chen , Linghan Cai , Zhikang Wang , Yi Huang , Songhan Jiang , Shenjin Huang , Hongpeng Wang , Yongbing Zhang

Multimodal Large Language Models (MLLMs) show strong visual perception, yet remain limited in reasoning about space under changing viewpoints. We study this challenge as Perspective-Conditioned Spatial Reasoning (PCSR) in 360-degree…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Yuangong Chen , Wai Keung Wong , Jiaxing Li , Ioannis Patras , Xu Zheng

The integration of Large Language Models (LLMs) into healthcare is constrained by knowledge limitations, hallucinations, and a disconnect from Evidence-Based Medicine (EBM). While Retrieval-Augmented Generation (RAG) offers a solution,…

计算与语言 · 计算机科学 2026-02-03 Qiaoyu Zheng , Yuze Sun , Chaoyi Wu , Weike Zhao , Pengcheng Qiu , Yongguo Yu , Kun Sun , Jian Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie

In precision medicine, quantitative multi-omic features, topological context, and textual biological knowledge play vital roles in identifying disease-critical signaling pathways and targets. Existing pipelines capture only part of…

人工智能 · 计算机科学 2025-12-17 Heming Zhang , Di Huang , Wenyu Li , Michael Province , Yixin Chen , Philip Payne , Fuhai Li

Understanding human gaze behavior is essential for complex scene comprehension and human-computer interaction. Traditional gaze following models are typically restricted to pure spatial localization, lacking the high-level capacity to…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Qiaomu Miao , Haoyu Wu , Jingyi Xu , Minh Hoai , Dimitris Samaras

The emergence of Vision-Language Models (VLMs) has introduced new paradigms for global image geo-localization through retrieval-augmented generation (RAG) and reasoning-driven inference. However, RAG methods are constrained by retrieval…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Bo Yu , Fengze Yang , Yiming Liu , Chao Wang , Xuewen Luo , Taozhe Li , Ruimin Ke , Xiaofan Zhou , Chenxi Liu

Recent multimodal large language models (MLLMs) such as GPT-4o and Qwen3-Omni show strong perception but struggle in multi-speaker, dialogue-centric settings that demand agentic reasoning tracking who speaks, maintaining roles, and…

Effective autonomous driving hinges on robust reasoning across perception, prediction, planning, and behavior. However, conventional end-to-end models fail to generalize in complex scenarios due to the lack of structured reasoning. While…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Muxi Diao , Lele Yang , Hongbo Yin , Zhexu Wang , Yejie Wang , Daxin Tian , Kongming Liang , Zhanyu Ma

Vision-language foundation models have emerged as powerful general-purpose representation learners with strong potential for multimodal understanding, but their deterministic embeddings often fail to provide the reliability required for…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Ahmad Elallaf , Yu Zhang , Yuktha Priya Masupalli , Jeong Yang , Young Lee , Zechun Cao , Gongbo Liang

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

Automated penetration testing (AutoPT) based on reinforcement learning (RL) has proven its ability to improve the efficiency of vulnerability identification in information systems. However, RL-based PT encounters several challenges,…

人工智能 · 计算机科学 2024-05-28 Yuanliang Li , Hanzheng Dai , Jun Yan

Autonomous collision-free navigation in cluttered environments requires safe decision-making under partial observability with both static structure and dynamic obstacles. We present \textbf{PanoDP}, a communication-free learning framework…

机器人学 · 计算机科学 2026-03-10 Hao Zhong , Pei Chi , Jiang Zhao , Shenghai Yuan , Xuyang Gao , Thien-Minh Nguyen , Lihua Xie

Deep learning for medical imaging is hampered by task-specific models that lack generalizability and prognostic capabilities, while existing 'universal' approaches suffer from simplistic conditioning and poor medical semantic understanding.…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Numan Saeed , Tausifa Jan Saleem , Fadillah Maani , Muhammad Ridzuan , Hu Wang , Mohammad Yaqub

Panoramic radiography is a widely used imaging modality in dental practice and research. However, it only provides flattened 2D images, which limits the detailed assessment of dental structures. In this paper, we propose Occudent, a…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Sihwa Park , Seongjun Kim , In-Seok Song , Seung Jun Baek