English
Related papers

Related papers: Localize, Understand, Collaborate: Semantic-Aware …

200 papers

Large text-to-image models have achieved astonishing performance in synthesizing diverse and high-quality images guided by texts. With detail-oriented conditioning control, even finer-grained spatial control can be achieved. However, some…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuhe Liu , Mengxue Kang , Zengchang Qin , Xiangxiang Chu

Remote sensing image change detection is one of the fundamental tasks in remote sensing intelligent interpretation. Its core objective is to identify changes within change regions of interest (CRoI). Current multimodal large models encode…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zhenyang Huang , Xiao Yu , Yi Zhang , Decheng Wang , Hang Ruan

Generative AI often produces results misaligned with user intentions, for example, resolving ambiguous prompts in unexpected ways. Despite existing approaches to clarify intent, a major challenge remains: understanding and influencing AI's…

Human-Computer Interaction · Computer Science 2026-02-10 Lena Hegemann , Xinyi Wen , Michael A. Hedderich , Tarmo Nurmi , Hariharan Subramonyam

Sequential recommendation systems aim to capture users' evolving preferences from their interaction histories. Recent reasoningenhanced methods have shown promise by introducing deliberate, chain-of-thought-like processes with intermediate…

Information Retrieval · Computer Science 2025-12-17 Yifan Shao , Peilin Zhou

Understanding human intents from multimodal signals is critical for analyzing human behaviors and enhancing human-machine interactions in real-world scenarios. However, existing methods exhibit limitations in their modality-level reliance,…

Multimedia · Computer Science 2025-09-03 Qianrui Zhou , Hua Xu , Yifan Wang , Xinzhi Dong , Hanlei Zhang

Current text-driven image editing methods typically follow one of two directions: relying on large-scale, high-quality editing pair datasets to improve editing precision and diversity, or exploring alternative dataset-free techniques.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chenrui Ma , Xi Xiao , Tianyang Wang , Yanning Shen

Vision-Language Models (VLM) exhibit strong reasoning capabilities, showing promise for end-to-end autonomous driving systems. Chain-of-Thought (CoT), as VLM's widely used reasoning strategy, is facing critical challenges. Existing textual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Lingjun Zhang , Yujian Yuan , Changjie Wu , Xinyuan Chang , Xin Cai , Shuang Zeng , Linzhe Shi , Sijin Wang , Hang Zhang , Mu Xu

Recent advances in text-conditioned generative models have provided us with neural networks capable of creating images of astonishing quality, be they realistic, abstract, or even creative. These models have in common that (more or less…

Human-Computer Interaction · Computer Science 2022-10-10 Francisco Ibarrola , Tomas Lawton , Kazjon Grace

DragDiffusion is a diffusion-based method for interactive point-based image editing that enables users to manipulate images by directly dragging selected points. The method claims that accurate spatial control can be achieved by optimizing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Ali Subhan , Ashir Raza

Question answering over visually rich documents (VRDs) requires reasoning not only over isolated content but also over documents' structural organization and cross-page dependencies. However, conventional retrieval-augmented generation…

Computation and Language · Computer Science 2026-03-03 Zhivar Sourati , Zheng Wang , Marianne Menglin Liu , Yazhe Hu , Mengqing Guo , Sujeeth Bharadwaj , Kyu Han , Tao Sheng , Sujith Ravi , Morteza Dehghani , Dan Roth

Pixel-level fine-grained image editing remains an open challenge. Previous works fail to achieve an ideal trade-off between control granularity and inference speed. They either fail to achieve pixel-level fine-grained control, or their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Pengxiang Cai , Zhiwei Liu , Guibo Zhu , Yunfang Niu , Jinqiao Wang

Accurate and controllable image editing is a challenging task that has attracted significant attention recently. Notably, DragGAN is an interactive point-based image editing framework that achieves impressive editing results with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yujun Shi , Chuhui Xue , Jun Hao Liew , Jiachun Pan , Hanshu Yan , Wenqing Zhang , Vincent Y. F. Tan , Song Bai

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there still lacks of control over the generation process in order to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Xianxu Hou , Xiaokang Zhang , Linlin Shen , Zhihui Lai , Jun Wan

Recently, text-guided image manipulation has received increasing attention in the research field of multimedia processing and computer vision due to its high flexibility and controllability. Its goal is to semantically manipulate parts of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ryugo Morita , Zhiqiang Zhang , Man M. Ho , Jinjia Zhou

Instruction-based video editing requires transforming a source video according to a natural-language instruction while preserving irrelevant content and remaining temporally coherent. We argue that existing Diffusion Transformer (DiT)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yan Li , Lin Liu , Xiaopeng Zhang , Qi Tian

Large Language Models (LLMs) achieve remarkable performance through pretraining on extensive data. This enables efficient adaptation to diverse downstream tasks. However, the lack of interpretability in their underlying mechanisms limits…

Computation and Language · Computer Science 2025-06-03 Xintong Wang , Jingheng Pan , Liang Ding , Longyue Wang , Longqin Jiang , Xingshan Li , Chris Biemann

Training autonomous driving and navigation systems requires large and diverse point cloud datasets that capture complex edge case scenarios from various dynamic urban settings. Acquiring such diverse scenarios from real-world point cloud…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Suchetan G. Uppur , Hemant Kumar , Vaibhav Kumar

Instruction-based image editing models have recently achieved impressive performance, enabling complex edits to an input image from a multi-instruction prompt. However, these models apply each instruction in the prompt with a fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Arman Zarei , Samyadeep Basu , Mobina Pournemat , Sayan Nag , Ryan Rossi , Soheil Feizi

This paper presents a novel framework termed Cut-and-Paste for real-word semantic video editing under the guidance of text prompt and additional reference image. While the text-driven video editing has demonstrated remarkable ability to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Zhichao Zuo , Zhao Zhang , Yan Luo , Yang Zhao , Haijun Zhang , Yi Yang , Meng Wang

Synthesizing visual content that meets users' needs often requires flexible and precise controllability of the pose, shape, expression, and layout of the generated objects. Existing approaches gain controllability of generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xingang Pan , Ayush Tewari , Thomas Leimkühler , Lingjie Liu , Abhimitra Meka , Christian Theobalt