中文
相关论文

相关论文: Incentivizing Tool-augmented Thinking with Images …

200 篇论文

Current large vision-language models (LVLMs) typically employ a connector module to link visual features with text embeddings of large language models (LLMs) and use end-to-end training to achieve multi-modal understanding in a unified…

人工智能 · 计算机科学 2025-08-14 Zixian Guo , Ming Liu , Qilong Wang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

Large Language Models (LLMs) demonstrate enhanced capabilities and reliability by reasoning more, evolving from Chain-of-Thought prompting to product-level solutions like OpenAI o1. Despite various efforts to improve LLM reasoning,…

计算机视觉与模式识别 · 计算机科学 2025-05-05 Yuhao Dong , Zuyan Liu , Hai-Long Sun , Jingkang Yang , Winston Hu , Yongming Rao , Ziwei Liu

Multimodal large language models (MLLMs) still struggle with complex reasoning tasks in Visual Question Answering (VQA). While current methods have advanced by incorporating visual prompts, our study uncovers critical limitations: these…

计算与语言 · 计算机科学 2025-06-03 Songtao Jiang , Chenyi Zhou , Yan Zhang , Yeying Jin , Zuozhu Liu

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced cross-modal understanding and reasoning by incorporating Chain-of-Thought (CoT) reasoning in the semantic space. Building upon this, recent studies…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Chengzhi Liu , Yuzhe Yang , Yue Fan , Qingyue Wei , Sheng Liu , Xin Eric Wang

Medical Image Grounding (MIG), which involves localizing specific regions in medical images based on textual descriptions, requires models to not only perceive regions but also deduce spatial relationships of these regions. Existing…

机器学习 · 计算机科学 2025-07-08 Huihui Xu , Yuanpeng Nie , Hualiang Wang , Ying Chen , Wei Li , Junzhi Ning , Lihao Liu , Hongqiu Wang , Lei Zhu , Jiyao Liu , Xiaomeng Li , Junjun He

This survey explores recent advancements in reasoning large language models (LLMs) designed to mimic "slow thinking" - a reasoning process inspired by human cognition, as described in Kahneman's Thinking, Fast and Slow. These models, like…

人工智能 · 计算机科学 2025-05-09 Qianjun Pan , Wenkai Ji , Yuyang Ding , Junsong Li , Shilian Chen , Junyi Wang , Jie Zhou , Qin Chen , Min Zhang , Yulan Wu , Liang He

Multi-agent large language model frameworks are promising for complex multi step reasoning, yet existing systems remain weak for scientific and knowledge intensive domains due to static prompts and agent roles, rigid workflows, and…

人工智能 · 计算机科学 2026-03-04 Yichao Feng , Haoran Luo , Zhenghong Lin , Yiqun Sun , Pengfei Wei , Lawrence B. Hsieh , Anh Tuan Luu

Background: Several studies indicate that the anterior visual pathway provides information about the dynamics of axonal degeneration in Multiple Sclerosis (MS). Current research in the field is focused on the quest for the most…

图像与视频处理 · 电气工程与系统科学 2023-02-15 Monica Hernandez , Ubaldo Ramon-Julvez , Elisa Vilades , Beatriz Cordon , Elvira Mayordomo , Elena Garcia-Martin

The performance of image generation has been significantly improved in recent years. However, the study of image screening is rare and its performance with Multimodal Large Language Models (MLLMs) is unsatisfactory due to the lack of data…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Zhiyuan Hu , Zheng Sun , Yi Wei , Long Yu

Bridging clinical diagnostic reasoning with AI remains a central challenge in medical imaging. We introduce MedCLM, an automated pipeline that converts detection datasets into large-scale medical visual question answering (VQA) data with…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Soo Yong Kim , Suin Cho , Vincent-Daniel Yun , Gyeongyeon Hwang

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Large Reasoning Models (LRMs) like o3 and DeepSeek-R1 have achieved remarkable progress in reasoning tasks with long cot. However, they remain computationally inefficient and struggle with accuracy when solving problems requiring complex…

人工智能 · 计算机科学 2026-03-03 Haipeng Luo , Huawen Feng , Qingfeng Sun , Can Xu , Kai Zheng , Yufei Wang , Tao Yang , Han Hu , Yansong Tang

Multi-modal large language models (MLLMs) have shown promise in advancing healthcare. However, most existing models remain confined to single-image understanding, which greatly limits their applicability in clinical workflows. In practice,…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhen Chen , Yihang Fu , Gabriel Madera , Mauro Giuffre , Serina Applebaum , Hyunjae Kim , Hua Xu , Qingyu Chen

Recent advances in AI-generated content (AIGC) have significantly accelerated image editing techniques, driving increasing demand for diverse and fine-grained edits. Despite these advances, existing image editing methods still face…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Shuyu Wang , Weiqi Li , Qian Wang , Shijie Zhao , Jian Zhang

Although explainability and interpretability have received significant attention in artificial intelligence (AI) and natural language processing (NLP) for mental health, reasoning has not been examined in the same depth. Addressing this gap…

计算与语言 · 计算机科学 2025-11-10 Sneha Oram , Pushpak Bhattacharyya

Despite the impressive capabilities of Large Language Models (LLMs), existing Conversational Health Agents (CHAs) remain static and brittle, incapable of adaptive multi-turn reasoning, symptom clarification, or transparent decision-making.…

计算与语言 · 计算机科学 2025-07-11 Xinyi Liu , Dachun Sun , Yi R. Fung , Dilek Hakkani-Tür , Tarek Abdelzaher

Machine Learning (ML) is used to tackle various tasks, such as disease classification and prediction. The effectiveness of ML models relies heavily on having large amounts of complete data. However, healthcare data is often limited or…

Deep learning has emerged as a pivotal tool for accelerating research in the life sciences, with the low-level processing of biomedical images (e.g., registration, fusion, restoration, super-resolution) being one of its most critical…

计算工程、金融与科学 · 计算机科学 2025-09-29 Gaole Dai , Chenghao Zhou , Yu Zhou , Rongyu Zhang , Yuan Zhang , Chengkai Hou , Tiejun Huang , Jianxu Chen , Shanghang Zhang

We introduce Agentic Reasoning, a framework that enhances large language model (LLM) reasoning by integrating external tool-using agents. Agentic Reasoning dynamically leverages web search, code execution, and structured memory to address…

人工智能 · 计算机科学 2025-07-16 Junde Wu , Jiayuan Zhu , Yuyuan Liu , Min Xu , Yueming Jin

Reasoning capabilities are crucial for reliable medical visual question answering (VQA); however, existing datasets rarely include reasoning explanations. We address this by generating reasoning trajectories for six medical VQA benchmarks…

机器学习 · 计算机科学 2026-05-07 Halil Ibrahim Gulluk , Olivier Gevaert