English
Related papers

Related papers: OpenVE-3M: A Large-Scale High-Quality Dataset for …

200 papers

While real-world applications increasingly demand intricate scene manipulation, existing instruction-guided image editing benchmarks often oversimplify task complexity and lack comprehensive, fine-grained instructions. To bridge this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Bohan Jia , Wenxuan Huang , Yuntian Tang , Junbo Qiao , Jincheng Liao , Shaosheng Cao , Fei Zhao , Zhaopeng Feng , Zhouhong Gu , Zhenfei Yin , Lei Bai , Wanli Ouyang , Lin Chen , Fei Zhao , Yao Hu , Zihan Wang , Yuan Xie , Shaohui Lin

Existing visual instruction tuning methods typically prompt large language models with textual descriptions to generate instruction-following data. Despite the promising performance achieved, these descriptions are derived from image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Junke Wang , Lingchen Meng , Zejia Weng , Bo He , Zuxuan Wu , Yu-Gang Jiang

We present HumanEdit, a high-quality, human-rewarded dataset specifically designed for instruction-guided image editing, enabling precise and diverse image manipulations through open-form language instructions. Previous large-scale editing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Jinbin Bai , Wei Chow , Ling Yang , Xiangtai Li , Juncheng Li , Hanwang Zhang , Shuicheng Yan

Underwater video enhancement (UVE) aims to improve the visibility and frame quality of underwater videos, which has significant implications for marine research and exploration. However, existing methods primarily focus on developing image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Dazhao Du , Enhan Li , Lingyu Si , Fanjiang Xu , Jianwei Niu

Instruction-based video editing aims to modify an input video according to a natural-language instruction while preserving content fidelity and temporal coherence. However, existing diffusion-based approaches are often trained on paired…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Xiaoyan Cong , Haotian Yang , Angtian Wang , Yizhi Wang , Yiding Yang , Canyu Zhang , Chongyang Ma

Large Language Models (LLMs) have transformed software development by enabling code generation, automated debugging, and complex reasoning. However, their continued advancement is constrained by the scarcity of high-quality, publicly…

Software Engineering · Computer Science 2025-08-11 Wasi Uddin Ahmad , Aleksander Ficek , Mehrzad Samadi , Jocelyn Huang , Vahid Noroozi , Somshubra Majumdar , Boris Ginsburg

Publicly available biomedical videos, such as those on YouTube, serve as valuable educational resources for medical students. Unlike standard machine learning datasets, these videos are designed for human learners, often mixing medical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Rahul Thapa , Andrew Li , Qingyang Wu , Bryan He , Yuki Sahashi , Christina Binder , Angela Zhang , Ben Athiwaratkun , Shuaiwen Leon Song , David Ouyang , James Zou

This paper introduces MM-Instruct, a large-scale dataset of diverse and high-quality visual instruction data designed to enhance the instruction-following capabilities of large multimodal models (LMMs). While existing visual instruction…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jihao Liu , Xin Huang , Jinliang Zheng , Boxiao Liu , Jia Wang , Osamu Yoshie , Yu Liu , Hongsheng Li

Unified video models exhibit strong capabilities in understanding and generation, yet they struggle with reason-informed visual editing even when equipped with powerful internal vision-language models (VLMs). We attribute this gap to two…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xinyu Liu , Hangjie Yuan , Yujie Wei , Jiazheng Xing , Yujin Han , Jiahao Pan , Yanbiao Ma , Chi-Min Chan , Kang Zhao , Shiwei Zhang , Wenhan Luo , Yike Guo

Video foundation models aim to integrate video understanding, generation, editing, and instruction following within a single framework, making them a central direction for next-generation multimodal systems. However, existing evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jianhui Wei , Xiaotian Zhang , Yichen Li , Yuan Wang , Yan Zhang , Ziyi Chen , Zhihang Tang , Wei Xu , Zuozhu Liu

With the rapid advances of powerful multimodal models such as GPT-4o, Nano Banana, and Seedream 4.0 in Image Editing, the performance gap between closed-source and open-source models is widening, primarily due to the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Keming Ye , Zhipeng Huang , Canmiao Fu , Qingyang Liu , Jiani Cai , Zheqi Lv , Chen Li , Jing Lyu , Zhou Zhao , Shengyu Zhang

Recently, 3D understanding has become popular to facilitate autonomous agents to perform further decisionmaking. However, existing 3D datasets and methods are often limited to specific tasks. On the other hand, recent progress in Large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mingsheng Li , Xin Chen , Chi Zhang , Sijin Chen , Hongyuan Zhu , Fukun Yin , Gang Yu , Tao Chen

We present Edit3r, a feed-forward framework that reconstructs and edits 3D scenes in a single pass from unposed, view-inconsistent, instruction-edited images. Unlike prior methods requiring per-scene optimization, Edit3r directly predicts…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jiageng Liu , Weijie Lyu , Xueting Li , Yejie Guo , Ming-Hsuan Yang

Visual instruction tuning has made considerable strides in enhancing the capabilities of Large Multimodal Models (LMMs). However, existing open LMMs largely focus on single-image tasks, their applications to multi-image scenarios remains…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Feng Li , Renrui Zhang , Hao Zhang , Yuanhan Zhang , Bo Li , Wei Li , Zejun Ma , Chunyuan Li

Recent advances in text-to-video (T2V) technology, as demonstrated by models such as Runway Gen-3, Pika, Sora, and Kling, have significantly broadened the applicability and popularity of the technology. This progress has created a growing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Zelu Qi , Ping Shi , Shuqi Wang , Chaoyang Zhang , Fei Zhao , Zefeng Ying , Da Pan , Xi Yang , Zheqi He , Teng Dai

Learning-based underwater image enhancement (UIE) methods have made great progress. However, the lack of large-scale and high-quality paired training samples has become the main bottleneck hindering the development of UIE. The inter-frame…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yaofeng Xie , Lingwei Kong , Kai Chen , Ziqiang Zheng , Xiao Yu , Zhibin Yu , Bing Zheng

As AI-assisted video creation becomes increasingly practical, instruction-guided video editing has become essential for refining generated or captured footage to meet professional requirements. Yet the field still lacks both a large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xiangbo Gao , Sicong Jiang , Bangya Liu , Xinghao Chen , Minglai Yang , Siyuan Yang , Mingyang Wu , Jiongze Yu , Qi Zheng , Haozhi Wang , Jiayi Zhang , Jie Yang , Zihan Wang , Qing Yin , Zhengzhong Tu

Incorporating human feedback has been shown to be crucial to align text generated by large language models to human preferences. We hypothesize that state-of-the-art instructional image editing models, where outputs are generated based on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Shu Zhang , Xinyi Yang , Yihao Feng , Can Qin , Chia-Chih Chen , Ning Yu , Zeyuan Chen , Huan Wang , Silvio Savarese , Stefano Ermon , Caiming Xiong , Ran Xu

In recent years, image editing models have made significant progress, enabling users to manipulate visual content in a flexible and interactive manner through natural language instructions. However, an important yet underexplored research…

Code editing plays a vital role in software engineering, requiring developers to adjust existing code according to natural language instructions while keeping functionality intact and avoiding unnecessary modifications. However,…

Software Engineering · Computer Science 2025-10-08 Zekai Zhang , Mingwei Liu , Zhenxi Chen , Linxi Liang , Yuxuan Chen , Guangsheng Ou , Yanlin Wang , Dan Li , Xin Peng , Zibin Zheng