English
Related papers

Related papers: SoftCap: Soft-Budget Control for Diffusion Transfo…

200 papers

We consider the problem of fine-grained classification on an edge camera device that has limited power. The edge device must sparingly interact with the cloud to minimize communication bits to conserve power, and the cloud upon receiving…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Hanxiao Wang , Venkatesh Saligrama , Stan Sclaroff , Vitaly Ablavsky

While the diffusion transformer (DiT) has become a focal point of interest in recent years, its application in low-light image enhancement remains a blank area for exploration. Current methods recover the details from low-light images while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xiangchen Yin , Zhenda Yu , Longtao Jiang , Xin Gao , Xiao Sun , Zhi Liu , Xun Yang

Diffusion-based world models have shown strong potential for unified world simulation, but the iterative denoising remains too costly for interactive use and long-horizon rollouts. While feature caching can accelerate inference without…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Weilun Feng , Guoxin Fan , Haotong Qin , Chuanguang Yang , Mingqiang Wu , Yuqi Li , Xiangqi Li , Zhulin An , Libo Huang , Dingrui Wang , Longlong Liao , Michele Magno , Yongjun Xu

Diffusion Transformers (DiT) have become the de-facto model for generating high-quality visual content like videos and images. A huge bottleneck is the attention mechanism where complexity scales quadratically with resolution and video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Ruichen Chen , Keith G. Mills , Liyao Jiang , Chao Gao , Di Niu

Text-to-image diffusion models are computationally intensive, often requiring dozens of forward passes through large transformer backbones. For instance, Stable Diffusion XL generates high-quality images with 50 evaluations of a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Natalia Frumkin , Diana Marculescu

Diffusion Transformers (DiTs) introduce the transformer architecture to diffusion tasks for latent-space image generation. With an isotropic architecture that chains a series of transformer blocks, DiTs demonstrate competitive performance…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yuchuan Tian , Zhijun Tu , Hanting Chen , Jie Hu , Chao Xu , Yunhe Wang

We present the design, implementation, and evaluation of FineIBT: a CFI enforcement mechanism that improves the precision of hardware-assisted CFI solutions, like Intel IBT, by instrumenting program code to reduce the valid/allowed targets…

Cryptography and Security · Computer Science 2023-09-15 Alexander J. Gaidis , Joao Moreira , Ke Sun , Alyssa Milburn , Vaggelis Atlidakis , Vasileios P. Kemerlis

Diffusion transformers (DiTs) have emerged as a dominant architecture for text-to-image generation, yet their performance drops when generating at resolutions beyond their training range. Existing training-free approaches mitigate this by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Javad Rajabi , Kimia Shaban , Koorosh Roohi , David B. Lindell , Babak Taati

With the explosive growth of rigid-body simulators, policy learning in simulation has become the de facto standard for most rigid morphologies. In contrast, soft robotic simulation frameworks remain scarce and are seldom adopted by the soft…

Robotics · Computer Science 2025-11-11 Andrew Choi , Dezhong Tong

Diffusion Transformers (DiTs) incur prohibitive computational costs due to the quadratic scaling of self-attention. Existing pruning methods fail to simultaneously satisfy differentiability, efficiency, and the strict static budgets…

Machine Learning · Computer Science 2026-02-06 Jiaji Zhang , Hailiang Zhao , Guoxuan Zhu , Ruichao Sun , Jiaju Wu , Xinkui Zhao , Hanlin Tang , Weiyi Lu , Kan Liu , Tao Lan , Lin Qu , Shuiguang Deng

With the incorporation of the UNet architecture, diffusion probabilistic models have become a dominant force in image generation tasks. One key design in UNet is the skip connections between the encoder and decoder blocks. Although skip…

Machine Learning · Computer Science 2024-02-26 Jiajun Ma , Shuchen Xue , Tianyang Hu , Wenjia Wang , Zhaoqiang Liu , Zhenguo Li , Zhi-Ming Ma , Kenji Kawaguchi

Scene text editing aims to modify or add texts on images while ensuring text fidelity and overall visual quality consistent with the background. Recent methods are primarily built on UNet-based diffusion models, which have improved scene…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Rui Lan , Yancheng Bai , Xu Duan , Mingxing Li , Dongyang Jin , Ryan Xu , Dong Nie , Lei Sun , Xiangxiang Chu

We study the tradeoff between computational effort and classification accuracy in a cascade of deep neural networks. During inference, the user sets the acceptable accuracy degradation which then automatically determines confidence…

Machine Learning · Computer Science 2020-11-12 Konstantin Berestizshevsky , Guy Even

General aviation fault diagnosis and efficient maintenance are critical to flight safety; however, deploying deep learning models on resource-constrained edge devices poses dual challenges in computational capacity and interpretability.…

Artificial Intelligence · Computer Science 2026-04-03 Zhihuan Wei , Xinhang Chen , Danyang Han , Yang Hu , Jie Liu , Xuewen Miao , Guijiang Li

Large pre-trained models have had a significant impact on computer vision by enabling multi-modal learning, where the CLIP model has achieved impressive results in image classification, object detection, and semantic segmentation. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Sitian Shen , Zilin Zhu , Linqian Fan , Harry Zhang , Xinxiao Wu

Recent guidance methods in diffusion models steer reverse sampling by perturbing the model to construct an implicit weak model and guide generation away from it. Among these approaches, attention perturbation has demonstrated strong…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Minjae Kim , Jaewon Min , Wooseok Jang , Sangwu Lee , Sayak Paul , Susung Hong , Seungryong Kim

In light of recent breakthroughs in text-to-image (T2I) generation, particularly with diffusion transformers (DiT), subject-driven technologies are increasingly being employed for high-fidelity customized production that preserves subject…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yanbing Zhang , Zhe Wang , Qin Zhou , Mengping Yang

Dynamic point cloud pretraining is still dominated by masked reconstruction objectives. However, these objectives inherit two key limitations. Existing methods inject ground-truth tube centers as decoder positional embeddings, causing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhuoyue Zhang , Jihua Zhu , Chaowei Fang , Jian Liu , Ajmal Saeed Mian

Transformer networks have emerged as the state-of-the-art approach for natural language processing tasks and are gaining popularity in other domains such as computer vision and audio processing. However, the efficient hardware acceleration…

Hardware Architecture · Computer Science 2024-07-29 Gamze İslamoğlu , Moritz Scherer , Gianna Paulin , Tim Fischer , Victor J. B. Jung , Angelo Garofalo , Luca Benini

Large-scale text-to-image (T2I) diffusion models excel at open-domain synthesis but still struggle with precise text rendering, especially for multi-line layouts, dense typography, and long-tailed scripts such as Chinese. Prior solutions…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Ruiqiang Zhang , Hengyi Wang , Chang Liu , Guanjie Wang , Zehua Ma , Weiming Zhang