中文
相关论文

相关论文: Singpath-VL Technical Report

200 篇论文

Conversation agents powered by large language models are revolutionizing the way we interact with visual data. Recently, large vision-language models (LVLMs) have been extensively studied for both images and videos. However, these studies…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Juseong Jin , Chang Wook Jeong

Frontier large language models (LLMs), such as GPT-5, Claude 4.5, Gemini 3, Llama 4, and DeepSeek-R1, represent a transformative class of AI tools capable of revolutionizing various aspects of healthcare by generating human-like responses…

Open-source, multilingual medical large language models (LLMs) have the potential to serve linguistically diverse populations across different regions. Adapting generic LLMs for healthcare often requires continual pretraining, but this…

计算与语言 · 计算机科学 2024-09-10 Meng Zhou , Surajsinh Parmar , Anubhav Bhatti

Large language models (LLMs) are rapidly increasing in capability, but they still struggle with highly specialized programming tasks such as scientific visualization. We present an LLM assistant, ChatVis, that aids the LLM to generate…

人机交互 · 计算机科学 2025-08-01 Tom Peterka , Tanwi Mallick , Orcun Yildiz , David Lenz , Cory Quammen , Berk Geveci

We introduce SAIL-VL2, an open-suite vision-language foundation model (LVM) for comprehensive multimodal understanding and reasoning. As the successor to SAIL-VL, SAIL-VL2 achieves state-of-the-art performance at the 2B and 8B parameter…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Weijie Yin , Yongjie Ye , Fangxun Shu , Yue Liao , Zijian Kang , Hongyuan Dong , Haiyang Yu , Dingkang Yang , Jiacong Wang , Han Wang , Wenzhuo Liu , Xiao Liang , Shuicheng Yan , Chao Feng

Video-based Clinical Gait Analysis often suffers from poor generalization as models overfit environmental biases instead of capturing pathological motion. To address this, we propose BioGait-VLM, a tri-modal Vision-Language-Biomechanics…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Erdong Chen , Yuyang Ji , Jacob K. Greenberg , Benjamin Steel , Faraz Arkam , Abigail Lewis , Pranay Singh , Feng Liu

Large language models (LLMs) show promise for tailored healthcare communication but face challenges in interpretability and multi-task integration particularly for domain-specific needs like myopia, and their real-world effectiveness as…

Multimodal Large Language Models (MLLMs) have demonstrated remarkable effectiveness in various general-domain scenarios, such as visual question answering and image captioning. Recently, researchers have increasingly focused on empowering…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Yan Shu , Chi Liu , Robin Chen , Derek Li , Bryan Dai

Large Language Models (LLMs) have emerged as a potential solution to assist digital health development with patient education, commonly medication-related enquires. We trained and validated Med-Pal, a medication domain-specific LLM-chatbot…

Vision-language models (VLMs) have shown promise in 2D medical image analysis, but extending them to 3D remains challenging due to the high computational demands of volumetric data and the difficulty of aligning 3D spatial features with…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Yu Xin , Gorkem Can Ates , Kuang Gong , Wei Shao

Multiple Instance Learning (MIL) is the leading approach for whole slide image (WSI) classification, enabling efficient analysis of gigapixel pathology slides. Recent work has introduced vision-language models (VLMs) into MIL pipelines to…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Ngoc Bui Lam Quang , Nam Le Nguyen Binh , Thanh-Huy Nguyen , Le Thien Phuc Nguyen , Quan Nguyen , Ulas Bagci

Large Language Models (LLMs) have shown significant promise across various natural language processing tasks. However, their application in the field of pathology, particularly for extracting meaningful insights from unstructured medical…

计算与语言 · 计算机科学 2025-03-04 Rachit Saluja , Jacob Rosenthal , Yoav Artzi , David J. Pisapia , Benjamin L. Liechty , Mert R. Sabuncu

Multimodal Large Language Models (MLLMs) have demonstrated robust capabilities in recognizing everyday human activities, yet their potential for analyzing clinically significant involuntary movements in neurological disorders remains…

Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-loop radiology assistant could facilitate a collaborative…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Chantal Pellegrini , Ege Özsoy , Benjamin Busam , Nassir Navab , Matthias Keicher

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

We introduce MultiMedEval, an open-source toolkit for fair and reproducible evaluation of large, medical vision-language models (VLM). MultiMedEval comprehensively assesses the models' performance on a broad array of six multi-modal tasks,…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Corentin Royer , Bjoern Menze , Anjany Sekuboyina

Multimodal large language models (LLMs) have achieved notable success across various domains, while research in the medical field has largely focused on unimodal images. Meanwhile, current general-domain multimodal models for videos still…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Jiajie Li , Garrett Skinner , Gene Yang , Brian R Quaranto , Steven D Schwaitzberg , Peter C W Kim , Jinjun Xiong

Recent advances in large vision-language models (LVLMs) have demonstrated strong performance on general-purpose medical tasks. However, their effectiveness in specialized domains such as dentistry remains underexplored. In particular,…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Jing Hao , Yuxuan Fan , Yanpeng Sun , Kaixin Guo , Lizhuo Lin , Jinrong Yang , Qi Yong H. Ai , Lun M. Wong , Hao Tang , Kuo Feng Hung

Although supervised machine learning is popular for information extraction from clinical notes, creating large annotated datasets requires extensive domain expertise and is time-consuming. Meanwhile, large language models (LLMs) have…

计算与语言 · 计算机科学 2024-01-26 Madhumita Sushil , Travis Zack , Divneet Mandair , Zhiwei Zheng , Ahmed Wali , Yan-Ning Yu , Yuwei Quan , Atul J. Butte

Medical vision-language models (VLMs) have shown promise as clinical assistants across various medical fields. However, specialized dermatology VLM capable of delivering professional and detailed diagnostic analysis remains underdeveloped,…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Wenqi Zeng , Yuqi Sun , Chenxi Ma , Weimin Tan , Bo Yan