English
Related papers

Related papers: Re-Align: Structured Reasoning-guided Alignment fo…

200 papers

Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but they still face challenges in General Visual Editing, particularly in following complex instructions, preserving appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xiangyu Zhao , Peiyuan Zhang , Kexian Tang , Xiaorong Zhu , Hao Li , Wenhao Chai , Zicheng Zhang , Renqiu Xia , Guangtao Zhai , Junchi Yan , Hua Yang , Xue Yang , Haodong Duan

Despite recent advances, vision-language models trained with standard contrastive objectives still struggle with compositional reasoning -- the ability to understand structured relationships between visual and linguistic elements. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Jihoon Kwon , Kyle Min , Jy-yong Sohn

Editing images via instruction provides a natural way to generate interactive content, but it is a big challenge due to the higher requirement of scene understanding and generation. Prior work utilizes a chain of large language models,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Liya Ji , Chenyang Qi , Qifeng Chen

Despite the strong abilities, large language models (LLMs) still suffer from hallucinations and reliance on outdated knowledge, raising concerns in knowledge-intensive tasks. Graph-based retrieval-augmented generation (GRAG) enriches LLMs…

Computation and Language · Computer Science 2026-01-14 Derong Xu , Pengyue Jia , Xiaopeng Li , Yingyi Zhang , Maolin Wang , Qidong Liu , Xiangyu Zhao , Yichao Wang , Huifeng Guo , Ruiming Tang , Enhong Chen , Tong Xu

Explanation-guided learning (EGL) has shown promise in aligning model predictions with interpretable reasoning, particularly in computer vision tasks. However, most approaches rely on external annotations or heuristic-based segmentation to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Dongsheng Hong , Chao Chen , Yanhui Chen , Shanshan Lin , Zhihao Chen , Xiangwen Liao

Reasoning large language models (RLLMs) have recently demonstrated remarkable capabilities through structured and multi-step reasoning. While prior research has primarily focused on improving their training and inference strategies, their…

Computation and Language · Computer Science 2025-10-14 Haotian Wu , Bo Xu , Yao Shu , Menglin Yang , Chengwei Qin

Existing Vision Language Models (VLMs) often struggle to preserve logic, entity identity, and artistic style during extended, interleaved image-text interactions. We identify this limitation as "Multimodal Context Drift", which stems from…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Zeteng Lin , Xingxing Li , Wen You , Xiaoyang Li , Zehan Lu , Yujun Cai , Jing Tang

Unified models capable of interleaved generation have emerged as a promising paradigm, with the community increasingly converging on autoregressive modeling for text and flow matching for image generation. To advance this direction, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jie Liu , Zilyu Ye , Linxiao Yuan , Shenhan Zhu , Yu Gao , Jie Wu , Kunchang Li , Xionghui Wang , Xiaonan Nie , Weilin Huang , Wanli Ouyang

Unified multimodal models (UMMs) unify visual understanding and generation within a single architecture. However, conventional training relies on image-text pairs (or sequences) whose captions are typically sparse and miss fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ji Xie , Trevor Darrell , Luke Zettlemoyer , XuDong Wang

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Visual In-Context Learning (ICL) has emerged as a promising research area due to its capability to accomplish various tasks with limited example pairs through analogical reasoning. However, training-based visual ICL has limitations in its…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zheng Gu , Shiyuan Yang , Jing Liao , Jing Huo , Yang Gao

This paper introduces a new in-context learning (ICL) mechanism called In-Image Learning (I$^2$L) that combines demonstration examples, visual cues, and chain-of-thought reasoning into an aggregated image to enhance the capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Lei Wang , Wanyu Xu , Zhiqiang Hu , Yihuai Lan , Shan Dong , Hao Wang , Roy Ka-Wei Lee , Ee-Peng Lim

Recent advances in motion-aware large language models have shown remarkable promise for unifying motion understanding and generation tasks. However, these models typically treat understanding and generation separately, limiting the mutual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yuan-Ming Li , Qize Yang , Nan Lei , Shenghao Fu , Ling-An Zeng , Jian-Fang Hu , Xihan Wei , Wei-Shi Zheng

Text-driven motion editing and intra-structural retargeting, where source and target share topology but may differ in bone lengths, are traditionally handled by fragmented pipelines with incompatible inputs and representations: editing…

Graphics · Computer Science 2026-04-16 Junlin Li , Xinhao Song , Siqi Wang , Haibin Huang , Yili Zhao

In recent years, advancements in AIGC (Artificial Intelligence Generated Content) technology have significantly enhanced the capabilities of large text-to-image models. Despite these improvements, controllable image generation remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Bowen Zhang , Cheng Yang , Xuanhui Liu

Although Large Language Models (LLMs) demonstrate proficiency in knowledge-intensive tasks, current interfaces frequently precipitate cognitive misalignment by failing to externalize users' underlying reasoning structures. Existing tools…

Human-Computer Interaction · Computer Science 2026-04-14 Anqi Wang , Dongyijie Pan , Xin Tong , Pan Hui

Large language models (LLMs) exhibit remarkable capabilities, yet their reasoning remains opaque, raising safety and trust concerns. Attribution methods, which assign credit to input features, have proven effective for explaining the…

Artificial Intelligence · Computer Science 2025-12-18 Chase Walker , Rickard Ewetz

Large language models (LLMs) often suffer from hallucination, generating factually incorrect statements when handling questions beyond their knowledge and perception. Retrieval-augmented generation (RAG) addresses this by retrieving…

Computation and Language · Computer Science 2025-11-18 Shengyuan Chen , Chuang Zhou , Zheng Yuan , Qinggang Zhang , Zeyang Cui , Hao Chen , Yilin Xiao , Jiannong Cao , Xiao Huang

Autoregressive multimodal large language models have recently gained popularity for image generation, driven by advances in foundation models. To enhance alignment and detail, newer approaches employ chain-of-thought (CoT) reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Zeqi Gu , Markos Georgopoulos , Xiaoliang Dai , Marjan Ghazvininejad , Chu Wang , Felix Juefei-Xu , Kunpeng Li , Yujun Shi , Zecheng He , Zijian He , Jiawei Zhou , Abe Davis , Jialiang Wang

Retrieval-Augmented Generation (RAG) enhances the response quality and domain-specific performance of large language models (LLMs) by incorporating external knowledge to combat hallucinations. In recent research, graph structures have been…

Information Retrieval · Computer Science 2025-12-17 Hao Hu , Yifan Feng , Ruoxue Li , Rundong Xue , Xingliang Hou , Zhiqiang Tian , Yue Gao , Shaoyi Du