English
Related papers

Related papers: Kimi K2.5: Visual Agentic Intelligence

200 papers

We present a Collaborative Agent-Based Framework for Multi-Image Reasoning. Our approach tackles the challenge of interleaved multimodal reasoning across diverse datasets and task formats by employing a dual-agent system: a language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Angelos Vlachos , Giorgos Filandrianos , Maria Lymperaiou , Nikolaos Spanos , Ilias Mitsouras , Vasileios Karampinis , Athanasios Voulodimos

We introduce [Cosmos-Predict2.5], the latest generation of the Cosmos World Foundation Models for Physical AI. Built on a flow-based architecture, [Cosmos-Predict2.5] unifies Text2World, Image2World, and Video2World generation in a single…

Emerging 6G networks rely on complex cross-layer optimization, yet manually translating high-level intents into mathematical formulations remains a bottleneck. While Large Language Models (LLMs) offer promise, monolithic approaches often…

Artificial Intelligence · Computer Science 2026-01-28 Haoyun Li , Ming Xiao , Kezhi Wang , Robert Schober , Dong In Kim , Yong Liang Guan

Language model (LM) agents have gained significant attention for their ability to autonomously complete tasks through interactions with environments, tools, and APIs. LM agents are primarily built with prompt engineering or supervised…

Artificial Intelligence · Computer Science 2025-07-22 Renxi Wang , Rifo Ahmad Genadi , Bilal El Bouardi , Yongxin Wang , Fajri Koto , Zhengzhong Liu , Timothy Baldwin , Haonan Li

A multimodal AI agent is characterized by its ability to process and learn from various types of data, including natural language, visual, and audio inputs, to inform its actions. Despite advancements in large language models that…

Computation and Language · Computer Science 2024-04-19 Wei Chen , Zhiyuan Li

Open-sourced Large Language Models (LLMs) have achieved great success in various NLP tasks, however, they are still far inferior to API-based models when acting as agents. How to integrate agent ability into general LLMs becomes a crucial…

Computation and Language · Computer Science 2024-03-20 Zehui Chen , Kuikun Liu , Qiuchen Wang , Wenwei Zhang , Jiangning Liu , Dahua Lin , Kai Chen , Feng Zhao

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Visual reasoning -- the ability to interpret the visual world -- is crucial for embodied agents that operate within three-dimensional scenes. Progress in AI has led to vision and language models capable of answering questions from images.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Damiano Marsili , Rohun Agrawal , Yisong Yue , Georgia Gkioxari

Agentic methods have emerged as a powerful and autonomous paradigm that enhances reasoning, collaboration, and adaptive control, enabling systems to coordinate and independently solve complex tasks. We extend this paradigm to safety…

Artificial Intelligence · Computer Science 2025-10-30 Juan Ren , Mark Dras , Usman Naseem

Fully automated self-driving laboratories are promising to enable high-throughput and large-scale scientific discovery by reducing repetitive labour. However, effective automation requires deep integration of laboratory knowledge, which is…

Artificial Intelligence · Computer Science 2025-09-30 Shuxiang Cao , Zijian Zhang , Mohammed Alghadeer , Simone D Fasciati , Michele Piscitelli , Mustafa Bakr , Peter Leek , Alán Aspuru-Guzik

The transition from optical identification of 2D quantum materials to practical device fabrication requires dynamic reasoning beyond the detection accuracy. While recent domain-specific Multimodal Large Language Models (MLLMs) successfully…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Sankalp Pandey , Xuan-Bac Nguyen , Hoang-Quan Nguyen , Tim Faltermeier , Nicholas Borys , Hugh Churchill , Khoa Luu

Large Language Model-based Multi-Agent Systems (MAS) have demonstrated remarkable capabilities in complex tasks. However, manually designing optimal communication topologies is labor-intensive, while automated expansion methods often result…

Machine Learning · Computer Science 2026-05-12 Yulang Chen , Haoxuan Peng , Jinyan Liu , Zichen Wen , Dongrui Liu , Linfeng Zhang

In Lifelong Learning (LL), agents continually learn as they encounter new conditions and tasks. Most current LL is limited to a single agent that learns tasks sequentially. Dedicated LL machinery is then deployed to mitigate the forgetting…

Recent text-to-image (T2I) models have made remarkable progress in generating visually realistic and semantically coherent images. However, they still suffer from randomness and inconsistency with the given prompts, particularly when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Kaishen Wang , Ruibo Chen , Tong Zheng , Heng Huang

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in…

Recently, large language models (LLMs) have demonstrated remarkable problem-solving capabilities by autonomously integrating with external tools for collaborative reasoning. However, due to the inherently complex and diverse nature of…

Artificial Intelligence · Computer Science 2025-11-03 Mengjie Deng , Guanting Dong , Zhicheng Dou

We introduce GenAgent, unifying visual understanding and generation through an agentic multimodal model. Unlike unified models that face expensive training costs and understanding-generation trade-offs, GenAgent decouples these capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kaixun Jiang , Yuzheng Wang , Junjie Zhou , Pandeng Li , Zhihang Liu , Chen-Wei Xie , Zhaoyu Chen , Yun Zheng , Wenqiang Zhang

This paper presents a novel approach that integrates vision foundation models with reinforcement learning to enhance object interaction capabilities in simulated environments. By combining the Segment Anything Model (SAM) and YOLOv5 with a…

Robotics · Computer Science 2025-08-11 Ahmad Farooq , Kamran Iqbal

With the rapid advancement of large language models (LLMs), Multi-agent Systems (MAS) have achieved significant progress in various application scenarios. However, substantial challenges remain in designing versatile, robust, and efficient…

Artificial Intelligence · Computer Science 2025-09-12 Weige Cai , Tong Zhu , Jinyi Niu , Ruiqi Hu , Lingyao Li , Tenglong Wang , Xiaowu Dai , Weining Shen , Liwen Zhang

World models (WMs) represent the frontier of sample-efficient reinforcement learning, but their complexity leaves many promising improvements unrealized due to the significant expertise and effort required to identify and integrate them.…

Machine Learning · Computer Science 2026-05-12 Lior Cohen , Kaixin Wang , Bingyi Kang , Uri Gadot , Shie Mannor