English
Related papers

Related papers: AstroVLM: Expert Multi-agent Collaborative Reasoni…

200 papers

We investigate the ability of Vision Language Models (VLMs) to perform visual perspective taking using a new set of visual tasks inspired by established human tests. Our approach leverages carefully controlled scenes in which a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Gracjan Góral , Alicja Ziarko , Piotr Miłoś , Michał Nauman , Maciej Wołczyk , Michał Kosiński

Real-world image restoration (IR) is inherently complex and often requires combining multiple specialized models to address diverse degradations. Inspired by human problem-solving, we propose AgenticIR, an agentic system that mimics the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Kaiwen Zhu , Jinjin Gu , Zhiyuan You , Yu Qiao , Chao Dong

Integration of Large Language Models (LLMs) into visual domain tasks, resulting in visual-LLMs (V-LLMs), has enabled exceptional performance in vision-language tasks, particularly for visual question answering (VQA). However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Kanchana Ranasinghe , Satya Narayan Shukla , Omid Poursaeed , Michael S. Ryoo , Tsung-Yu Lin

Unified vision-language models (VLMs) promise to streamline computer vision pipelines by reframing multiple visual tasks such as classification, detection, and keypoint localization within a single language-driven interface. This…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Conor Wallace , Isaac Corley , Jonathan Lwowski

The advancement of Multimodal Large Language Models (MLLMs) has driven significant progress in Visual Question Answering (VQA), evolving from Single to Multi Image VQA (MVQA). However, the increased number of images in MVQA inevitably…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Kang Zeng , Guojin Zhong , Jintao Cheng , Jin Yuan , Zhiyong Li

Data mining is an important and challenging problem for the efficient analysis of large astronomical databases and will become even more important with the development of the Global Virtual Observatory. In this study, learning vector…

Astrophysics · Physics 2009-11-10 Yanxia Zhang , Yongheng Zhao

Multimodal large language models (MLLMs) excel at generating highly detailed captions but often produce hallucinations. Our analysis reveals that existing hallucination detection methods struggle with detailed captions. We attribute this to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Saehyung Lee , Seunghyun Yoon , Trung Bui , Jing Shi , Sungroh Yoon

Recent advances in generative artificial intelligence have enabled the creation of highly realistic image forgeries, raising significant concerns about digital media authenticity. While existing detection methods demonstrate promising…

Multimedia · Computer Science 2025-04-15 Junhao Xu , Jingjing Chen , Yang Jiao , Jiacheng Zhang , Zhiyu Tan , Hao Li , Yu-Gang Jiang

Heterogeneous multirobot systems show great potential in complex tasks requiring coordinated hybrid cooperation. However, existing methods that rely on static or task-specific models often lack generalizability across diverse tasks and…

Robotics · Computer Science 2025-10-28 Haokun Liu , Zhaoqi Ma , Yunong Li , Junichiro Sugihara , Yicheng Chen , Jinjie Li , Moju Zhao

Vision-language modeling (VLM) aims to bridge the information gap between images and natural language. Under the new paradigm of first pre-training on massive image-text pairs and then fine-tuning on task-specific data, VLM in the remote…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xingxing Weng , Chao Pang , Gui-Song Xia

Recently, large vision-language models (LVLMs) unleash powerful analysis capabilities for low Earth orbit (LEO) satellite Earth observation images in the data center. However, fast satellite motion, brief satellite-ground station (GS)…

Networking and Internet Architecture · Computer Science 2025-07-09 Yuxin Zhang , Jiahao Yang , Zhe Chen , Wenjun Zhu , Jin Zhao , Yue Gao

Vision Language Models (VLMs) have shown promise in automating image diagnosis and interpretation in clinical settings. However, developing specialist medical VLMs requires substantial computational resources and carefully curated datasets,…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 Yuan Zhong , Ruinan Jin , Qi Dou , Xiaoxiao Li

While diffusion models excel at generating high-quality images, they often struggle with accurate counting, attributes, and spatial relationships in complex multi-object scenes. One potential solution involves employing Multimodal Large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiayang Sun , Hongbo Wang , Jie Cao , Huaibo Huang , Ran He

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Image Processing in Astronomy is a major field of research and involves a lot of techniques pertaining to improve analyzing the properties of the celestial objects or obtaining preliminary inference from the image data. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Diganta Misra , Sparsha Mishra , Bhargav Appasani

Image-based quality assessment (QA) in additive manufacturing (AM) often relies heavily on the expertise and constant attention of skilled human operators. While machine learning and deep learning methods have been introduced to assist in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qiaojie Zheng , Jiucai Zhang , Joy Gockel , Michael B. Wakin , Craig Brice , Xiaoli Zhang

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of…

Robotics · Computer Science 2025-12-02 Nivedan Yakolli , Avinash Gautam , Abhijit Das , Yuankai Qi , Virendra Singh Shekhawat

The rapid progress of multimodal large language models (MLLMs) has led to increasing interest in agent-based systems. While most prior work in medical imaging concentrates on automating routine clinical workflows, we study an underexplored…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zihao Zhao , Frederik Hauke , Juliana De Castilhos , Sven Nebelung , Daniel Truhn

Recent advancements in Computer Assisted Diagnosis have shown promising performance in medical imaging tasks, particularly in chest X-ray analysis. However, the interaction between these models and radiologists has been primarily limited to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yunsoo Kim , Jinge Wu , Yusuf Abdulle , Yue Gao , Honghan Wu

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky