English
Related papers

Related papers: COSINT-Agent: A Knowledge-Driven Multimodal Agent …

200 papers

We introduce GenAgent, unifying visual understanding and generation through an agentic multimodal model. Unlike unified models that face expensive training costs and understanding-generation trade-offs, GenAgent decouples these capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kaixun Jiang , Yuzheng Wang , Junjie Zhou , Pandeng Li , Zhihang Liu , Chen-Wei Xie , Zhaoyu Chen , Yun Zheng , Wenqiang Zhang

With the rapid advancement of Vision-Language Models (VLMs), GUI-based mobile agents have emerged as a key development direction for intelligent mobile systems. However, existing agent models continue to face significant challenges in…

Multiagent Systems · Computer Science 2025-09-03 Cheng Zhang , Erhu Feng , Xi Zhao , Yisheng Zhao , Wangbo Gong , Jiahui Sun , Dong Du , Zhichao Hua , Yubin Xia , Haibo Chen

Web-based platforms are becoming a primary channel for psychological support, yet most LLM-driven chatbots remain opaque, single-stage, and weakly grounded in established therapeutic practice, limiting their usefulness for web applications…

Human-Computer Interaction · Computer Science 2026-03-10 Fei Wang , Jiangnan Yang , Junjie Chen , Yuxin Liu , Kun Li , Yanyan Wei , Dan Guo , Meng Wang

Artificial intelligence has shown promise in medical imaging, yet most existing systems lack flexibility, interpretability, and adaptability - challenges especially pronounced in ophthalmology, where diverse imaging modalities are…

Recent research on medical MLLMs has gradually shifted its focus from image-level understanding to fine-grained, pixel-level comprehension. Although segmentation serves as the foundation for pixel-level understanding, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yankai Jiang , Qiaoru Li , Binlu Xu , Haoran Sun , Chao Ding , Junting Dong , Yuxiang Cai , Xuhong Zhang , Jianwei Yin

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Large language models (LLMs) exhibit strong symbolic and compositional reasoning, yet they struggle with time series question answering as the data is typically transformed into an LLM-compatible modality, e.g., serialized text, plotted…

Artificial Intelligence · Computer Science 2026-04-08 Penghang Liu , Elizabeth Fons , Annita Vapsi , Mohsen Ghassemi , Svitlana Vyetrenko , Daniel Borrajo , Vamsi K. Potluru , Manuela Veloso

In this paper, we address the task of utterance level emotion recognition in conversations using commonsense knowledge. We propose COSMIC, a new framework that incorporates different elements of commonsense such as mental states, events,…

Computation and Language · Computer Science 2020-10-07 Deepanway Ghosal , Navonil Majumder , Alexander Gelbukh , Rada Mihalcea , Soujanya Poria

Large language models (LLMs) have shown remarkable multimodal information processing and reasoning ability. When equipped with tools through function calling and enhanced with retrieval-augmented techniques, compound LLM-based systems can…

Machine Learning · Computer Science 2025-11-06 Borun Shi , Ioannis Panagiotas

Open-vocabulary semantic segmentation (OVSS) conducts pixel-level classification via text-driven alignment, where the domain discrepancy between base category training and open-vocabulary inference poses challenges in discriminative…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Jiahao Li , Yang Lu , Yachao Zhang , Fangyong Wang , Yuan Xie , Yanyun Qu

Document Question Answering (DocQA) is a very common task. Existing methods using Large Language Models (LLMs) or Large Vision Language Models (LVLMs) and Retrieval Augmented Generation (RAG) often prioritize information from a single…

Machine Learning · Computer Science 2025-03-19 Siwei Han , Peng Xia , Ruiyi Zhang , Tong Sun , Yun Li , Hongtu Zhu , Huaxiu Yao

Existing evaluations of multimodal large language models (MLLMs) on spatial intelligence are typically fragmented and limited in scope. In this work, we aim to conduct a holistic assessment of the spatial understanding capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haoning Wu , Xiao Huang , Yaohui Chen , Ya Zhang , Yanfeng Wang , Weidi Xie

Large language models (LLMs) show remarkable potential in scientific hypothesis discovery. However, existing approaches face two critical limitations: they treat divergent exploratory ideation and convergent fine-grained refinement as…

Computation and Language · Computer Science 2026-05-29 Hongran An , Zonglin Yang

Environmental, social, and governance (ESG) criteria are essential for evaluating corporate sustainability and ethical performance. However, professional ESG analysis is hindered by data fragmentation across unstructured sources, and…

Artificial Intelligence · Computer Science 2026-01-15 Yilei Zhao , Wentao Zhang , Lei Xiao , Yandan Zheng , Mengpu Liu , Wei Yang Bryan Lim

High-dimensional data remains a pervasive challenge in machine learning, often undermining model interpretability and computational efficiency. While Large Language Models (LLMs) have shown promise for dimensionality reduction through…

Machine Learning · Computer Science 2025-10-08 Mohamed Bal-Ghaoui , Fayssal Sabri

Extracting implicit knowledge and logical reasoning abilities from large language models (LLMs) has consistently been a significant challenge. The advancement of multi-agent systems has further en-hanced the capabilities of LLMs. Inspired…

Artificial Intelligence · Computer Science 2025-09-23 Hailong Yang , Mingxian Gu , Renhuo Zhao , Fuping Hu , Zhaohong Deng , Yitang Chen

Geospatial reasoning is essential for real-world applications such as urban analytics, transportation planning, and disaster response. However, existing LLM-based agents often fail at genuine geospatial computation, relying instead on web…

Artificial Intelligence · Computer Science 2026-01-26 Riyang Bao , Cheng Yang , Dazhou Yu , Zhexiang Tang , Gengchen Mai , Liang Zhao

Accessibility remains a critical concern in today's society, as many technologies are not developed to support the full range of user needs. Existing multi-agent systems (MAS) often cannot provide comprehensive assistance for users in need…

Multiagent Systems · Computer Science 2025-07-16 Aleksandr Algazinov , Matt Laing , Paul Laban

Solving mathematical reasoning problems requires not only accurate access to relevant knowledge but also careful, multi-step thinking. However, current retrieval-augmented models often rely on a single perspective, follow inflexible search…

Artificial Intelligence · Computer Science 2025-11-03 Ali Asgarov , Umid Suleymanov , Aadyant Khatri

The ability for AI agents to "think with images" requires a sophisticated blend of reasoning and perception. However, current open multimodal agents still largely fall short on the reasoning aspect crucial for real-world tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Kaican Li , Lewei Yao , Jiannan Wu , Tiezheng Yu , Jierun Chen , Haoli Bai , Lu Hou , Lanqing Hong , Wei Zhang , Nevin L. Zhang