English
Related papers

Related papers: TBAC-UniImage: Unified Understanding and Generatio…

200 papers

In-context learning (ICL) enhances the reasoning abilities of Large Language Models (LLMs) by prepending a few demonstrations. It motivates researchers to introduce more examples to provide additional contextual information for the…

Computation and Language · Computer Science 2025-05-27 Jun Gao , Qi Lv , Zili Wang , Tianxiang Wu , Ziqiang Cao , Wenjie Li

In this paper, we propose a unified framework that leverages a single pretrained LLM for Motion-related Multimodal Generation, referred to as MoMug. MoMug integrates diffusion-based continuous motion generation with the model's inherent…

Machine Learning · Computer Science 2025-03-11 Shinichi Tanaka , Zhao Wang , Yoichi Kato , Jun Ohya

Layout generation aims to synthesize realistic graphic scenes consisting of elements with different attributes including category, size, position, and between-element relation. It is a crucial task for reducing the burden on heavy-duty…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Mude Hui , Zhizheng Zhang , Xiaoyi Zhang , Wenxuan Xie , Yuwang Wang , Yan Lu

Recent progress in generative compression technology has significantly improved the perceptual quality of compressed data. However, these advancements primarily focus on producing high-frequency details, often overlooking the ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Naifu Xue , Qi Mao , Zijian Wang , Yuan Zhang , Siwei Ma

We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jinheng Xie , Weijia Mao , Zechen Bai , David Junhao Zhang , Weihao Wang , Kevin Qinghong Lin , Yuchao Gu , Zhijie Chen , Zhenheng Yang , Mike Zheng Shou

Unified models (UMs) hold promise for their ability to understand and generate content across heterogeneous modalities. Compared to merely generating visual content, the use of UMs for interleaved cross-modal reasoning is more promising and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiachun Jin , Zetong Zhou , Xiao Yang , Hao Zhang , Pengfei Liu , Jun Zhu , Zhijie Deng

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

There is growing interest in integrating high-fidelity visual synthesis capabilities into large language models (LLMs) without compromising their strong reasoning capabilities. Existing methods that directly train LLMs or bridge LLMs and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Han Lin , Jaemin Cho , Amir Zadeh , Chuan Li , Mohit Bansal

In the digital age, advanced image editing tools pose a serious threat to the integrity of visual content, making image forgery detection and localization a key research focus. Most existing Image Manipulation Localization (IML) methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yachun Mi , Xingyang He , Shixin Sun , Yu Li , Yanting Li , Zhixuan Li , Jian Jin , Chen Hui , Shaohui Liu

Unified multimodal models (UMMs) have emerged as a powerful paradigm in fundamental cross-modality research, demonstrating significant potential in both image understanding and generation. However, existing research in the face domain…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Junzhe Li , Sifan Zhou , Liya Guo , Xuerui Qiu , Linrui Xu , Delin Qu , Tingting Long , Chun Fan , Ming Li , Hehe Fan , Jun Liu , Shuicheng Yan

We introduce OneDiffusion, a versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. It enables conditional generation from inputs such as text, depth, pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Duong H. Le , Tuan Pham , Sangho Lee , Christopher Clark , Aniruddha Kembhavi , Stephan Mandt , Ranjay Krishna , Jiasen Lu

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. To support wider…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runhui Huang , Kaixin Cai , Jianhua Han , Xiaodan Liang , Renjing Pei , Guansong Lu , Songcen Xu , Wei Zhang , Hang Xu

We propose Lavida-O, a unified Masked Diffusion Model (MDM) for multimodal understanding and generation. Unlike existing multimodal MDMs such as MMaDa and Muddit which only support simple image-level understanding tasks and low-resolution…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Shufan Li , Jiuxiang Gu , Kangning Liu , Zhe Lin , Zijun Wei , Aditya Grover , Jason Kuen

Large-scale models have exhibited remarkable capabilities across diverse domains, including automated medical services and intelligent customer support. However, as most large models are trained on single-modality corpora, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Hao Sun , Yu Song , Jiaqing Liu , Jihong Hu , Yen-Wei Chen , Lanfen Lin

Although significant advancements have been achieved in the progress of keypoint-guided Text-to-Image diffusion models, existing mainstream keypoint-guided models encounter challenges in controlling the generation of more general non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qin Guo , Ailing Zeng , Dongxu Yue , Ceyuan Yang , Yang Cao , Hanzhong Guo , Fei Shen , Wei Liu , Xihui Liu , Dan Xu

Fashionable image generation aims to synthesize images of diverse fashion prevalent around the globe, helping fashion designers in real-time visualization by giving them a basic customized structure of how a specific design preference would…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Krishna Sri Ipsit Mantri , Nevasini Sasikumar

Most existing vision-language pre-training methods focus on understanding tasks and use BERT-like objectives (masked language modeling and image-text matching) during pretraining. Although they perform well in many understanding downstream…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Tianyi Liu , Zuxuan Wu , Wenhan Xiong , Jingjing Chen , Yu-Gang Jiang

In this report, we present OpenUni, a simple, lightweight, and fully open-source baseline for unifying multimodal understanding and generation. Inspired by prevailing practices in unified model learning, we adopt an efficient training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Size Wu , Zhonghua Wu , Zerui Gong , Qingyi Tao , Sheng Jin , Qinyue Li , Wei Li , Chen Change Loy

Unified multimodal models integrate the reasoning capacity of large language models with both image understanding and generation, showing great promise for advanced multimodal intelligence. However, the community still lacks a rigorous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hongxiang Li , Yaowei Li , Bin Lin , Yuwei Niu , Yuhang Yang , Xiaoshuang Huang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Long Chen

Synthetic tabular data generation has attracted growing attention due to its importance for data augmentation, foundation models, and privacy. However, real-world tabular datasets increasingly contain free-form text fields (e.g., reviews or…

Machine Learning · Computer Science 2026-05-13 Donghong Cai , Jiarui Feng , Yanbo Wang , Da Zheng , Yixin Chen , Muhan Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›