English
Related papers

Related papers: DocSynthv2: A Practical Autoregressive Modeling fo…

200 papers

We demonstrate the use of conditional autoregressive generative models (van den Oord et al., 2016a) over a discrete latent space (van den Oord et al., 2017b) for forward planning with MCTS. In order to test this method, we introduce a new…

Machine Learning · Computer Science 2018-11-27 Johanna Hansen , Kyle Kastner , Aaron Courville , Gregory Dudek

Document grounded generation is the task of using the information provided in a document to improve text generation. This work focuses on two different document grounded generation tasks: Wikipedia Update Generation task and Dialogue…

Computation and Language · Computer Science 2021-04-27 Shrimai Prabhumoye , Kazuma Hashimoto , Yingbo Zhou , Alan W Black , Ruslan Salakhutdinov

Recent breakthroughs in text-to-image diffusion models have significantly advanced the generation of high-fidelity, photo-realistic images from textual descriptions. Yet, these models often struggle with interpreting spatial arrangements…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jiaqi Liu , Tao Huang , Chang Xu

Videos of actions are complex signals containing rich compositional structure in space and time. Current video generation methods lack the ability to condition the generation on multiple coordinated and potentially simultaneous timed…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Amir Bar , Roei Herzig , Xiaolong Wang , Anna Rohrbach , Gal Chechik , Trevor Darrell , Amir Globerson

Recent progress in text-to-music generation has enabled models to synthesize high-quality musical segments, full compositions, and even respond to fine-grained control signals, e.g. chord progressions. State-of-the-art (SOTA) systems differ…

Sound · Computer Science 2025-09-05 Or Tal , Felix Kreuk , Yossi Adi

We introduce AutoPartGen, a model that generates objects composed of 3D parts in an autoregressive manner. This model can take as input an image of an object, 2D masks of the object's parts, or an existing 3D object, and generate a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Minghao Chen , Jianyuan Wang , Roman Shapovalov , Tom Monnier , Hyunyoung Jung , Dilin Wang , Rakesh Ranjan , Iro Laina , Andrea Vedaldi

Personalized image synthesis has emerged as a pivotal application in text-to-image generation, enabling the creation of images featuring specific subjects in diverse contexts. While diffusion models have dominated this domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Kaiyue Sun , Xian Liu , Yao Teng , Xihui Liu

Generative modeling of high-dimensional data is a key problem in machine learning. Successful approaches include latent variable models and autoregressive models. The complementary strengths of these approaches, to model global and local…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Thomas Lucas , Jakob Verbeek

We present a diffusion-based framework for document-centric background generation that achieves foreground preservation and multi-page stylistic consistency through latent-space design rather than explicit constraints. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Taewon Kang

This paper addresses the performance bottlenecks of existing text-driven image generation methods in terms of semantic alignment accuracy and structural consistency. A high-fidelity image generation method is proposed by integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Danyi Gao

Recent agentic workflows automate professional document generation but focus narrowly on textual quality, overlooking structural and stylistic professionalism, which is equally critical for readability. This gap stems mainly from a lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Junpeng Liu , Yuzhong Zhao , Bowen Cao , Jiayu Ding , Yilin Jia , Tengchao Lv , Yupan Huang , Wenshan Wu , Shaohan Huang , Nan Yang , Li Dong , Lei Cui , Tao Ge , Xun Wang , Huitian Jiao , Sun Mao , FNU Kartik , Si-Qing Chen , Wai Lam , Furu Wei

Most Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend the scope of machine…

Computation and Language · Computer Science 2018-06-12 Johannes Welbl , Pontus Stenetorp , Sebastian Riedel

Recent progress in controllable image generation and editing is largely driven by diffusion-based methods. Although diffusion models perform exceptionally well in specific tasks with tailored designs, establishing a unified model is still…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Jiteng Mu , Nuno Vasconcelos , Xiaolong Wang

While autoregressive (AR) models have demonstrated remarkable success in image generation, extending them to layout-conditioned generation remains challenging due to the sparse nature of layout conditions and the risk of feature…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zirui Zheng , Takashi Isobe , Tong Shen , Xu Jia , Jianbin Zhao , Xiaomin Li , Mengmeng Ge , Baolu Li , Qinghe Wang , Dong Li , Dong Zhou , Yunzhi Zhuge , Huchuan Lu , Emad Barsoum

Generating presentation slides is a time-consuming task that urgently requires automation. Due to their limited flexibility and lack of automated refinement mechanisms, existing autonomous LLM-based agents face constraints in real-world…

Computation and Language · Computer Science 2025-02-24 Yunqing Xu , Xinbei Ma , Jiyang Qiu , Hai Zhao

Document layout understanding is a field of study that analyzes the spatial arrangement of information in a document hoping to understand its structure and layout. Models such as LayoutLM (and its subsequent iterations) can understand…

Computation and Language · Computer Science 2025-01-13 Pablo Melendez , Clemens Havas

Autoregressive models are widely used for tasks such as image and audio generation. The sampling process of these models, however, does not allow interruptions and cannot adapt to real-time computational resources. This challenge impedes…

Machine Learning · Computer Science 2021-02-24 Yilun Xu , Yang Song , Sahaj Garg , Linyuan Gong , Rui Shu , Aditya Grover , Stefano Ermon

Accurate and comprehensive clinical documentation is crucial for delivering high-quality healthcare, facilitating effective communication among providers, and ensuring compliance with regulatory requirements. However, manual transcription…

Computation and Language · Computer Science 2024-06-12 Anjanava Biswas , Wrick Talukdar

Generating realistic human-human interactions is a challenging task that requires not only high-quality individual body and hand motions, but also coherent coordination among all interactants. Due to limitations in available data and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Pablo Ruiz-Ponce , Sergio Escalera , José García-Rodríguez , Jiankang Deng , Rolandos Alexandros Potamias

Design-to-code generation has emerged as a promising approach to bridge the gap between design prototypes and deployable frontend code. However, existing methods often suffer from structural inconsistencies, asset misalignment, and limited…

Software Engineering · Computer Science 2025-11-07 Yongxi Chen , Lei Chen