English
Related papers

Related papers: Reconstruction Alignment Improves Unified Multimod…

200 papers

Universal Multimodal Retrieval (UMR) seeks any-to-any search across text and vision, yet modern embedding models remain brittle when queries require latent reasoning (e.g., resolving underspecified references or matching compositional…

Information Retrieval · Computer Science 2026-02-10 Jianrui Zhang , Anirudh Sundara Rajan , Brandon Han , Soochahn Lee , Sukanta Ganguly , Yong Jae Lee

Most existing structured pruning methods for Large Language Models (LLMs) require substantial computational and data resources for retraining to reestablish the corrupted correlations, making them prohibitively expensive. To address this,…

Computation and Language · Computer Science 2025-06-11 Jiujun He , Huazhen Lin

Image-text retrieval requires the system to bridge the heterogenous gap between vision and language for accurate retrieval while keeping the network lightweight-enough for efficient retrieval. Existing trade-off solutions mainly study from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jiamin Zhuang , Jing Yu , Yang Ding , Xiangyan Qu , Yue Hu

Recent advancements in vision-language models have achieved remarkable results in making language models understand vision inputs. However, a unified approach to align these models across diverse tasks such as image captioning and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Kartik Jangra , Aman Kumar Singh , Yashwani Mann , Geetanjali Rathee

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Camera control has been actively studied in text or image conditioned video generation tasks. However, altering camera trajectories of a given video remains under-explored, despite its importance in the field of video creation. It is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Jianhong Bai , Menghan Xia , Xiao Fu , Xintao Wang , Lianrui Mu , Jinwen Cao , Zuozhu Liu , Haoji Hu , Xiang Bai , Pengfei Wan , Di Zhang

Modern Latent Diffusion Models (LDMs) typically operate in low-level Variational Autoencoder (VAE) latent spaces that are primarily optimized for pixel-level reconstruction. To unify vision generation and understanding, a burgeoning trend…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Shilong Zhang , He Zhang , Zhifei Zhang , Chongjian Ge , Shuchen Xue , Shaoteng Liu , Mengwei Ren , Soo Ye Kim , Yuqian Zhou , Qing Liu , Daniil Pakhomov , Kai Zhang , Zhe Lin , Ping Luo

Multi-modal Large Language Models (MLLMs) have recently exhibited impressive general-purpose capabilities by leveraging vision foundation models to encode the core concepts of images into representations. These are then combined with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Sara Ghazanfari , Alexandre Araujo , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Multimodal Large Language Models (MLLMs) have achieved remarkable performance by aligning pretrained visual representations with the linguistic knowledge embedded in Large Language Models (LLMs). However, existing approaches typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Ying Liu , Yudong Han , Kean Shi , Liyuan Pan

Masked Autoencoders (MAE) have been popular paradigms for large-scale vision representation pre-training. However, MAE solely reconstructs the low-level RGB signals after the decoder and lacks supervision upon high-level semantics for the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Peng Gao , Renrui Zhang , Rongyao Fang , Ziyi Lin , Hongyang Li , Hongsheng Li , Qiao Yu

Multimodal embedding models, rooted in multimodal large language models (MLLMs), have yielded significant performance improvements across diverse tasks such as retrieval and classification. However, most existing approaches rely heavily on…

Information Retrieval · Computer Science 2026-03-03 Jiahan Chen , Da Li , Hengran Zhang , Yinqiong Cai , Lixin Su , Jiafeng Guo , Daiting Shi , Dawei Yin , Keping Bi

Large-scale generative models have shown impressive image-generation capabilities, propelled by massive data. However, this often inadvertently leads to the generation of harmful or inappropriate content and raises copyright concerns.…

Machine Learning · Computer Science 2025-03-11 Myeongseob Ko , Henry Li , Zhun Wang , Jonathan Patsenker , Jiachen T. Wang , Qinbin Li , Ming Jin , Dawn Song , Ruoxi Jia

Image restoration has traditionally required training specialized models on thousands of paired examples per degradation type. We challenge this paradigm by demonstrating that powerful pre-trained text-conditioned image editing models can…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 M. Akın Yılmaz , Ahmet Bilican , Burak Can Biner , A. Murat Tekalp

Text-to-image diffusion models achieved a remarkable leap in capabilities over the last few years, enabling high-quality and diverse synthesis of images from a textual prompt. However, even the most advanced models often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Eyal Segalis , Dani Valevski , Danny Lumen , Yossi Matias , Yaniv Leviathan

Unified multimodal models have recently demonstrated strong generative capabilities, yet whether and when generation improves understanding remains unclear. Existing benchmarks lack a systematic exploration of the specific tasks where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Zimo Wen , Boxiu Li , Wanbo Zhang , Junxiang Lei , Xiaoyu Chen , Yijia Fan , Qi Zhang , Yujiang Wang , Lili Qiu , Bo Li , Ziwei Liu , Caihua Shan , Yifan Yang , Yifei Shen

Multimodal Large Language Models (MLLMs) achieve stronger visual understanding by scaling input fidelity, yet the resulting visual token growth makes jointly sustaining high spatial resolution and long temporal context prohibitive. We argue…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Huanxuan Liao , Zhongtao Jiang , Yupu Hao , Yuqiao Tan , Shizhu He , Ben Wang , Jun Zhao , Kun Xu , Kang Liu

Despite the success of multimodal contrastive learning in aligning visual and linguistic representations, a persistent geometric anomaly, the Modality Gap, remains: embeddings of distinct modalities expressing identical semantics occupy…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Xiaomin Yu , Yi Xin , Yuhui Zhang , Wenjie Zhang , Chonghan Liu , Hanzhen Zhao , Chen Liu , Xiaoxing Hu , Ziyue Qiao , Hao Tang , Xiaobin Hu , Chengwei Qin , Hui Xiong , Yu Qiao , Shuicheng Yan

Post-training for large language models (LLMs) is constrained by the high cost of acquiring new knowledge or correcting errors and by the unintended side effects that frequently arise from retraining. To address these issues, we introduce…

Computation and Language · Computer Science 2026-02-11 Yisu Wang , Ming Wang , Haoyuan Song , Wenjie Huang , Chaozheng Wang , Yi Xie , Xuming Ran

In medical image classification, supervised learning is challenging due to the scarcity of labeled medical images. To address this, we leverage the visual-textual alignment within Vision-Language Models (VLMs) to enable unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Umaima Rahman , Raza Imam , Mohammad Yaqub , Boulbaba Ben Amor , Dwarikanath Mahapatra

Unified Multimodal models (UMMs) built on a single architecture have shown impressive performance in both understanding and generation. We identify a fundamental challenge that lies in inductive biases induced by distinct supervision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Renjie Lu , Xulong Zhang , Xiaoyang Qu , Shangfei Wang , Jianzong Wang