English
Related papers

Related papers: AssetFormer: Modular 3D Assets Generation with Aut…

200 papers

We propose Significance-Offset Convolutional Neural Network, a deep convolutional network architecture for regression of multivariate asynchronous time series. The model is inspired by standard autoregressive (AR) models and gating…

Machine Learning · Computer Science 2018-06-13 Mikołaj Bińkowski , Gautier Marti , Philippe Donnat

Algorithms for the action segmentation task typically use temporal models to predict what action is occurring at each frame for a minute-long daily activity. Recent studies have shown the potential of Transformer in modeling the relations…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Fangqiu Yi , Hongyu Wen , Tingting Jiang

Autoregressive conditional image generation algorithms are capable of generating photorealistic images that are consistent with given textual or image conditions, and have great potential for a wide range of applications. Nevertheless, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Qiaoying Qu , Shiyu Shen

We present DreamBooth3D, an approach to personalize text-to-3D generative models from as few as 3-6 casually captured images of a subject. Our approach combines recent advances in personalizing text-to-image models (DreamBooth) with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Amit Raj , Srinivas Kaza , Ben Poole , Michael Niemeyer , Nataniel Ruiz , Ben Mildenhall , Shiran Zada , Kfir Aberman , Michael Rubinstein , Jonathan Barron , Yuanzhen Li , Varun Jampani

We introduce SynFormer, a generative modeling framework designed to efficiently explore and navigate synthesizable chemical space. Unlike traditional molecular generation approaches, we generate synthetic pathways for molecules to ensure…

Machine Learning · Computer Science 2024-10-07 Wenhao Gao , Shitong Luo , Connor W. Coley

Object manipulation in images aims to not only edit the object's presentation but also gift objects with motion. Previous methods encountered challenges in concurrently handling static editing and dynamic generation, while also struggling…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Ruisi Zhao , Zechuan Zhang , Zongxin Yang , Yi Yang

Recently, 3D assets created via reconstruction and generation have matched the quality of manually crafted assets, highlighting their potential for replacement. However, this potential is largely unrealized because these assets always need…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yiwen Chen , Tong He , Di Huang , Weicai Ye , Sijin Chen , Jiaxiang Tang , Xin Chen , Zhongang Cai , Lei Yang , Gang Yu , Guosheng Lin , Chi Zhang

Autoregressive models can generate high-quality 3D meshes by sequentially producing vertices and faces, but their token-by-token decoding results in slow inference, limiting practical use in interactive and large-scale applications. We…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Tingrui Shen , Yiheng Zhang , Chen Tang , Chuan Ping , Zixing Zhao , Le Wan , Yuwang Wang , Ronggang Wang , Shengfeng He

Modeling the 3D world from sensor data for simulation is a scalable way of developing testing and validation environments for robotic learning problems such as autonomous driving. However, manually creating or re-creating real-world-like…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Bokui Shen , Xinchen Yan , Charles R. Qi , Mahyar Najibi , Boyang Deng , Leonidas Guibas , Yin Zhou , Dragomir Anguelov

Autoregressive and diffusion models have achieved remarkable progress in language models and visual generation, respectively. We present ACDiT, a novel Autoregressive blockwise Conditional Diffusion Transformer, that innovatively combines…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Jinyi Hu , Shengding Hu , Yuxuan Song , Yufei Huang , Mingxuan Wang , Hao Zhou , Zhiyuan Liu , Wei-Ying Ma , Maosong Sun

Achieving precise, object-level control in image editing remains challenging: 2D methods lack 3D awareness and often yield ambiguous or implausible results, while existing 3D-aware approaches rely on heavy optimization or incomplete…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yuhuan Xie , Aoxuan Pan , Yi-Hua Huang , Chirui Chang , Peng Dai , Xin Yu , Xiaojuan Qi

The labor- and experience-intensive creation of 3D assets with physically based rendering (PBR) materials demands an autonomous 3D asset creation pipeline. However, most existing 3D generation methods focus on geometry modeling, either…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ze-Xin Yin , Jiaxiong Qiu , Liu Liu , Xinjie Wang , Wei Sui , Zhizhong Su , Jian Yang , Jin Xie

Autoregressive models for text sometimes generate repetitive and low-quality output because errors accumulate during the steps of generation. This issue is often attributed to exposure bias - the difference between how a model is trained,…

Computation and Language · Computer Science 2024-03-26 Yizhe Zhang , Jiatao Gu , Zhuofeng Wu , Shuangfei Zhai , Josh Susskind , Navdeep Jaitly

3D multi-object tracking (MOT) is vital for many applications including autonomous driving vehicles and service robots. With the commonly used tracking-by-detection paradigm, 3D MOT has made important progress in recent years. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xuesong Chen , Shaoshuai Shi , Chao Zhang , Benjin Zhu , Qiang Wang , Ka Chun Cheung , Simon See , Hongsheng Li

We introduce ProcGen3D, a new approach for 3D content creation by generating procedural graph abstractions of 3D objects, which can then be decoded into rich, complex 3D assets. Inspired by the prevalent use of procedural generators in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xinyi Zhang , Daoyi Gao , Naiqi Li , Angela Dai

This work presents, to the best of the authors' knowledge, the first generalizable and fully data-driven adaptive framework designed to stabilize deep learning (DL) autoregressive forecasting models over long time horizons, with the goal of…

Fluid Dynamics · Physics 2025-05-06 Rodrigo Abadía-Heredia , Manuel Lopez-Martin , Soledad Le Clainche

Pedestrian trajectory prediction, vital for selfdriving cars and socially-aware robots, is complicated due to intricate interactions between pedestrians, their environment, and other Vulnerable Road Users. This paper presents GSGFormer, an…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zhongchang Luo , Marion Robin , Pavan Vasishta

In recent years, the demand for 3D content has grown exponentially with the intelligent upgrade of interactive media, extended reality (XR), and Metaverse industries. In order to overcome the limitations of traditional manual modeling…

Graphics · Computer Science 2025-12-23 Xiang Tang , Ruotong Li , Xiaopeng Fan

Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be effective, a basis must be tailored to the specific set of…

Machine Learning · Computer Science 2024-01-19 Zelin Ni , Hang Yu , Shizhan Liu , Jianguo Li , Weiyao Lin

With the emergence of VR and AR, 360{\deg} data attracts increasing attention from the computer vision and multimedia communities. Typically, 360{\deg} data is projected into 2D ERP (equirectangular projection) images for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yinjie Zhao , Lichen Zhao , Qian Yu , Jing Zhang , Lu Sheng , Dong Xu