English
Related papers

Related papers: ScaleEdit-12M: Scaling Open-Source Image Editing D…

200 papers

Instruction-based text editing is increasingly critical for real-world applications such as code editors (e.g., Cursor), but Large Language Models (LLMs) continue to struggle with this task. Unlike free-form generation, editing requires…

Computation and Language · Computer Science 2025-12-16 Yiming Zeng , Jinghan Cao , Zexin Li , Wanhao Yu , Zhankai Ye , Dawei Xiang , Ting Hua , Xin Liu , Shangqian Gao , Tingting Yu

Despite recent advances in inversion and instruction-based image editing, existing approaches primarily excel at editing single, prominent objects but significantly struggle when applied to complex scenes containing multiple entities. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Bimsara Pathiraja , Maitreya Patel , Shivam Singh , Yezhou Yang , Chitta Baral

We introduce Skywork UniPic, a 1.5 billion-parameter autoregressive model that unifies image understanding, text-to-image generation, and image editing within a single architecture-eliminating the need for task-specific adapters or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Peiyu Wang , Yi Peng , Yimeng Gan , Liang Hu , Tianyidan Xie , Xiaokun Wang , Yichen Wei , Chuanxin Tang , Bo Zhu , Changshi Li , Hongyang Wei , Eric Li , Xuchen Song , Yang Liu , Yahui Zhou

Current unified multimodal models for image generation and editing typically rely on massive parameter scales (e.g., >10B), entailing prohibitive training costs and deployment footprints. In this work, we present DeepGen 1.0, a lightweight…

Large language models (LLMs) encode vast world knowledge but struggle to stay up-to-date, often leading to errors and hallucinations. Knowledge editing offers an efficient alternative to retraining, enabling targeted modifications by…

Computation and Language · Computer Science 2025-06-03 Weitao Ma , Xiyuan Du , Xiaocheng Feng , Lei Huang , Yichong Huang , Huiyi Zhang , Xiaoliang Yang , Baohang Li , Xiachong Feng , Ting Liu , Bing Qin

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating strong capabilities in tasks such as text generation, summarization, and reasoning. Recently, their potential for automating precise text…

Computation and Language · Computer Science 2026-01-27 Yiming Zeng , Wanhao Yu , Zexin Li , Tao Ren , Yu Ma , Jinghan Cao , Xiyan Chen , Tingting Yu

Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) have shown great knowledge transfer and generalization capability on various downstream tasks within their domains. Inspired by these efforts, in this paper we propose a unified…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jing Shi , Ning Xu , Haitian Zheng , Alex Smith , Jiebo Luo , Chenliang Xu

Pre-training state-of-the-art large language models (LLMs) requires vast amounts of clean and diverse text data. While the open development of large high-quality English pre-training datasets has seen substantial recent progress, training…

Large multimodal language models (MLLMs) have revolutionized natural language processing and visual understanding, but often contain outdated or inaccurate information. Current multimodal knowledge editing evaluations are limited in scope…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Yaohui Ma , Xiaopeng Hong , Shizhou Zhang , Huiyun Li , Zhilin Zhu , Wei Luo , Zhiheng Ma

With the rapid advancement of text-to-image (T2I) models, ensuring their safety has become increasingly critical. Existing safety approaches can be categorized into training-time and inference-time methods. While inference-time methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Ruiyang Zhang , Jiahao Luo , Xiaoru Feng , Qiufan Pang , Yaodong Yang , Juntao Dai

Training generalist agents capable of adapting to diverse scenarios requires interactive environments for self-exploration. However, interactive environments remain critically scarce, and existing synthesis methods suffer from significant…

Artificial Intelligence · Computer Science 2026-02-09 Dunwei Tu , Hongyan Hao , Hansi Yang , Yihao Chen , Yi-Kai Zhang , Zhikang Xia , Yu Yang , Yueqing Sun , Xingchen Liu , Furao Shen , Qi Gu , Hui Su , Xunliang Cai

Text-driven image synthesis has made significant advancements with the development of diffusion models, transforming how visual content is generated from text prompts. Despite these advances, text-driven image editing, a key area in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Mingzhen Huang , Jialing Cai , Shan Jia , Vishnu Suresh Lokhande , Siwei Lyu

Recent diffusion-based image editing methods have significantly advanced text-guided tasks but often struggle to interpret complex, indirect instructions. Moreover, current models frequently suffer from poor identity preservation,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Chun-Hsiao Yeh , Yilin Wang , Nanxuan Zhao , Richard Zhang , Yuheng Li , Yi Ma , Krishna Kumar Singh

Generative models, such as diffusion and autoregressive approaches, have demonstrated impressive capabilities in editing natural images. However, applying these tools to scientific charts rests on a flawed assumption: a chart is not merely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Shawn Li , Ryan Rossi , Sungchul Kim , Sunav Choudhary , Franck Dernoncourt , Puneet Mathur , Zhengzhong Tu , Yue Zhao

Large multimodal models demonstrate remarkable generalist ability to perform diverse multimodal tasks in a zero-shot manner. Large-scale web-based image-text pairs contribute fundamentally to this success, but suffer from excessive noise.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Qiying Yu , Quan Sun , Xiaosong Zhang , Yufeng Cui , Fan Zhang , Yue Cao , Xinlong Wang , Jingjing Liu

Skills, i.e., structured workflow instructions distilled for large language models (LLMs), are becoming an increasingly important mechanism for improving agent performance on real-world downstream tasks. However, as the open-source skill…

Computation and Language · Computer Science 2026-05-29 Jiahao Ying , Boxian Ai , Wei Tang , Siyuan Liu , Yixin Cao

Given an original image, image editing aims to generate an image that align with the provided instruction. The challenges are to accept multimodal inputs as instructions and a scarcity of high-quality training data, including crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhen Han , Chaojie Mao , Zeyinzi Jiang , Yulin Pan , Jingfeng Zhang

Thanks to the powerful language comprehension capabilities of Large Language Models (LLMs), existing instruction-based image editing methods have introduced Multimodal Large Language Models (MLLMs) to promote information exchange between…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yujie Hu , Zecheng Tang , Xu Jiang , Weiqi Li , Jian Zhang

Text-guided audio editing aims to modify specific acoustic events while strictly preserving non-target content. Despite recent progress, existing approaches remain fundamentally limited. Training-free methods often suffer from signal…

Sound · Computer Science 2026-01-21 Ye Tao , Wen Wu , Chao Zhang , Mengyue Wu , Shuai Wang , Xuenan Xu

Large-scale image datasets frequently contain identifiable or sensitive content, raising privacy risks when training models that may memorize and leak such information. We present Unsafe2Safe, a fully automated pipeline that detects…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Mih Dinh , SouYoung Jin