中文
相关论文

相关论文: Unified Thinker: A General Reasoning Modular Core …

200 篇论文

Recent advances in deep thinking models have demonstrated remarkable reasoning capabilities on mathematical and coding tasks. However, their effectiveness in embodied domains which require continuous interaction with environments through…

Recent advances in image editing models have shown remarkable progress. A common architectural design couples a multimodal large language model (MLLM) encoder with a diffusion decoder, as seen in systems such as Step1X-Edit and…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Fukun Yin , Shiyu Liu , Yucheng Han , Zhibo Wang , Peng Xing , Rui Wang , Wei Cheng , Yingming Wang , Aojie Li , Zixin Yin , Pengtao Chen , Xiangyu Zhang , Daxin Jiang , Xianfang Zeng , Gang Yu

With the rapid advances of powerful multimodal models such as GPT-4o, Nano Banana, and Seedream 4.0 in Image Editing, the performance gap between closed-source and open-source models is widening, primarily due to the scarcity of…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Keming Ye , Zhipeng Huang , Canmiao Fu , Qingyang Liu , Jiani Cai , Zheqi Lv , Chen Li , Jing Lyu , Zhou Zhao , Shengyu Zhang

Recent progress in Multimodal Large Language Models (MLLMs) demonstrates that Chain-of-Thought (CoT) reasoning enables systematic solutions to complex understanding tasks. However, its extension to generation tasks remains nascent and…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Siyu Jiao , Yiheng Lin , Yujie Zhong , Qi She , Wei Zhou , Xiaohan Lan , Zilong Huang , Fei Yu , Yingchen Yu , Yunqing Zhao , Yao Zhao , Yunchao Wei

Unified multimodal generative models aim to integrate image understanding and generation abilities, offering significant advantages in harnessing multimodal corpora, particularly interleaved text-image data. However, existing unified models…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Hong Zhang , Zhongjie Duan , Xingjun Wang , Yuze Zhao , Weiyi Lu , Zhipeng Di , Yixuan Xu , Yingda Chen , Yu Zhang

Recent text-to-image systems face limitations in handling multimodal inputs and complex reasoning tasks. We introduce MindOmni, a unified multimodal large language model that addresses these challenges by incorporating reasoning generation…

人工智能 · 计算机科学 2025-06-12 Yicheng Xiao , Lin Song , Yukang Chen , Yingmin Luo , Yuxin Chen , Yukang Gan , Wei Huang , Xiu Li , Xiaojuan Qi , Ying Shan

For visual content generation, discrepancies between user intentions and the generated content have been a longstanding problem. This discrepancy arises from two main factors. First, user intentions are inherently complex, with subtle…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Yi Cheng , Ziwei Xu , Dongyun Lin , Harry Cheng , Yongkang Wong , Ying Sun , Joo Hwee Lim , Mohan Kankanhalli

A unified diffusion framework for multi-modal generation and understanding has the transformative potential to achieve seamless and controllable image diffusion and other cross-modal tasks. In this paper, we introduce MMGen, a unified…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Jiepeng Wang , Zhaoqing Wang , Hao Pan , Yuan Liu , Dongdong Yu , Changhu Wang , Wenping Wang

Large Language Models have demonstrated remarkable reasoning capability in complex textual tasks. However, multimodal reasoning, which requires integrating visual and textual information, remains a significant challenge. Existing…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Yi Yang , Xiaoxuan He , Hongkun Pan , Xiyan Jiang , Yan Deng , Xingtao Yang , Haoyu Lu , Dacheng Yin , Fengyun Rao , Minfeng Zhu , Bo Zhang , Wei Chen

Training on verifiable symbolic data is a promising way to expand the reasoning frontier of language models beyond what standard pre-training corpora provide. Yet existing procedural generators often rely on fixed puzzles or templates and…

计算与语言 · 计算机科学 2026-03-03 Valentin Lacombe , Valentin Quesnel , Damien Sileo

Image processing is a fundamental task in computer vision, which aims at enhancing image quality and extracting essential features for subsequent vision applications. Traditionally, task-specific models are developed for individual tasks…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Yihao Liu , Xiangyu Chen , Xianzheng Ma , Xintao Wang , Jiantao Zhou , Yu Qiao , Chao Dong

We introduce GenAgent, unifying visual understanding and generation through an agentic multimodal model. Unlike unified models that face expensive training costs and understanding-generation trade-offs, GenAgent decouples these capabilities…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Kaixun Jiang , Yuzheng Wang , Junjie Zhou , Pandeng Li , Zhihang Liu , Chen-Wei Xie , Zhaoyu Chen , Yun Zheng , Wenqiang Zhang

Unified multimodal models have recently demonstrated strong generative capabilities, yet whether and when generation improves understanding remains unclear. Existing benchmarks lack a systematic exploration of the specific tasks where…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Zimo Wen , Boxiu Li , Wanbo Zhang , Junxiang Lei , Xiaoyu Chen , Yijia Fan , Qi Zhang , Yujiang Wang , Lili Qiu , Bo Li , Ziwei Liu , Caihua Shan , Yifan Yang , Yifei Shen

Traditional photographic image editing typically requires users to possess sufficient aesthetic understanding to provide appropriate instructions for adjusting image quality and camera parameters. However, this paradigm relies on explicit…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Ying Zeng , Miaosen Luo , Guangyuan Li , Yang Yang , Ruiyang Fan , Linxiao Shi , Qirui Yang , Jian Zhang , Chengcheng Liu , Siming Zheng , Jinwei Chen , Bo Li , Peng-Tao Jiang

With the proliferation of images in online content, language-guided image retrieval (LGIR) has emerged as a research hotspot over the past decade, encompassing a variety of subtasks with diverse input forms. While the development of large…

信息检索 · 计算机科学 2025-03-14 Pengfei Luo , Jingbo Zhou , Tong Xu , Yuan Xia , Linli Xu , Enhong Chen

Reinforcement learning (RL) has recently achieved remarkable success in eliciting visual reasoning within Multimodal Large Language Models (MLLMs). However, existing approaches typically train separate models for different tasks and treat…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Kaituo Feng , Manyuan Zhang , Hongyu Li , Kaixuan Fan , Shuang Chen , Yilei Jiang , Dian Zheng , Peiwen Sun , Yiyuan Zhang , Haoze Sun , Yan Feng , Peng Pei , Xunliang Cai , Xiangyu Yue

Recent progress in text-to-image (T2I) diffusion models (DMs) has enabled high-quality visual synthesis from diverse textual prompts. Yet, most existing T2I DMs, even those equipped with large language model (LLM)-based text encoders,…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Siqi Kou , Jiachun Jin , Zetong Zhou , Ye Ma , Yugang Wang , Quan Chen , Peng Jiang , Xiao Yang , Jun Zhu , Kai Yu , Zhijie Deng

In this paper, we explore the possibility of building a unified foundation model that can be adapted to both vision-only and text-only tasks. Starting from BERT and ViT, we design a unified transformer consisting of modality-specific…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Qing Li , Boqing Gong , Yin Cui , Dan Kondratyuk , Xianzhi Du , Ming-Hsuan Yang , Matthew Brown

Unified models aim to support both understanding and generation by encoding images into discrete tokens and processing them alongside text within a single autoregressive framework. This unified design offers architectural simplicity and…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Ziyao Wang , Chen Chen , Jingtao Li , Weiming Zhuang , Jiabo Huang , Ang Li , Lingjuan Lyu

We present Pelican-Unify 1.0, the first embodied foundation model trained according to the principle of unification. Pelican-Unify 1.0 uses a single VLM as a unified understanding module, mapping scenes, instructions, visual contexts, and…