English
Related papers

Related papers: JointNet: Extending Text-to-Image Diffusion for De…

200 papers

Cross-view geo-localization plays a critical role in Unmanned Aerial Vehicle (UAV) localization and navigation. However, significant challenges arise from the drastic viewpoint differences and appearance variations between images. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Hongyu Zhou , Yunzhou Zhang , Tingsong Huang , Fawei Ge , Man Qi , Xichen Zhang , Yizhong Zhang

In recent years, using a deep convolutional neural network (CNN) as a feature encoder (or backbone) is the most commonly observed architectural pattern in several computer vision methods, and semantic segmentation is no exception. The two…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Venkata Satya Sai Ajay Daliparthi

Diffusion generative models have emerged as a powerful framework for addressing problems in structural biology and structure-based drug design. These models operate directly on 3D molecular structures. Due to the unfavorable scaling of…

Biomolecules · Quantitative Biology 2024-05-10 Ian Dunn , David Ryan Koes

Contents generated by recent advanced Text-to-Image (T2I) diffusion models are sometimes too imaginative for existing off-the-shelf dense predictors to estimate due to the immitigable domain gap. We introduce DMP, a pipeline utilizing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Hsin-Ying Lee , Hung-Yu Tseng , Hsin-Ying Lee , Ming-Hsuan Yang

Brain network analysis has emerged as pivotal method for gaining a deeper understanding of brain functions and disease mechanisms. Despite the existence of various network construction approaches, shortcomings persist in the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yongcheng Zong , Shuqiang Wang

Diffusion models achieved unprecedented fidelity and diversity for synthesizing image, video, 3D assets, etc. However, subject mixing is an unresolved issue for diffusion-based image synthesis, particularly for synthesizing multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Weimin Qiu , Jieke Wang , Meng Tang

U-Nets are among the most widely used architectures in computer vision, renowned for their exceptional performance in applications such as image segmentation, denoising, and diffusion modeling. However, a theoretical explanation of the…

Machine Learning · Computer Science 2024-05-02 Song Mei

Diffusion models have become the de-facto approach for generating visual data, which are trained to match the distribution of the training dataset. In addition, we also want to control generation to fulfill desired properties such as…

Machine Learning · Computer Science 2024-12-30 Dinghuai Zhang , Yizhe Zhang , Jiatao Gu , Ruixiang Zhang , Josh Susskind , Navdeep Jaitly , Shuangfei Zhai

Deep reinforcement learning (DRL) has long been a promising solution for sequential resource management in wireless networks. However, conventional DRL methods are fundamentally limited by their reliance on unimodal policy distributions,…

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Recurrent neural networks have been widely used in sequence learning tasks. In previous studies, the performance of the model has always been improved by either wider or deeper structures. However, the former becomes more prone to…

Machine Learning · Computer Science 2019-11-20 Yu-Xuan Li , Jin-Yuan Liu , Liang Li , Xiang Guan

Depth-guided multimodal fusion combines depth information from visible and infrared images, significantly enhancing the performance of 3D reconstruction and robotics applications. Existing thermal-visible image fusion mainly focuses on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jinchang Zhang , Zijun Li , Guoyu Lu

Diffusion model, as a new generative model which is very popular in image generation and audio synthesis, is rarely used in speech enhancement. In this paper, we use the diffusion model as a module for stochastic refinement. We propose…

Sound · Computer Science 2022-11-01 Zhibin Qiu , Mengfan Fu , Yinfeng Yu , LiLi Yin , Fuchun Sun , Hao Huang

Image classification models often demonstrate unstable performance in real-world applications due to variations in image information, driven by differing visual perspectives of subject objects and lighting discrepancies. To mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuze Zheng , Zixuan Li , Xiangxian Li , Jinxing Liu , Yuqing Wang , Xiangxu Meng , Lei Meng

Image classification serves as the cornerstone of computer vision, traditionally achieved through discriminative models based on deep neural networks. Recent advancements have introduced classification methods derived from generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chunxiao Li , Xiaoxiao Wang , Boming Miao , Chuanlong Xie , Zizhe Wang , Yao Zhu

In this paper, we introduce the problem of jointly learning feed-forward neural networks across a set of relevant but diverse datasets. Compared to learning a separate network from each dataset in isolation, joint learning enables us to…

Machine Learning · Computer Science 2019-06-12 Zaiwei Zhang , Xiangru Huang , Qixing Huang , Xiao Zhang , Yuan Li

Ensemble learning has proven effective in improving predictive performance and estimating uncertainty in neural networks. However, conventional ensemble methods often suffer from redundant parameter usage and computational inefficiencies…

Machine Learning · Computer Science 2024-12-23 Arnav Kharbanda , Advait Chandorkar

We develop a neural network architecture which, trained in an unsupervised manner as a denoising diffusion model, simultaneously learns to both generate and segment images. Learning is driven entirely by the denoising diffusion objective,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xin Yuan , Michael Maire

Text-to-image generation (TTI) refers to the usage of models that could process text input and generate high fidelity images based on text descriptions. Text-to-image generation using neural networks could be traced back to the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Fengxiang Bie , Yibo Yang , Zhongzhu Zhou , Adam Ghanem , Minjia Zhang , Zhewei Yao , Xiaoxia Wu , Connor Holmes , Pareesa Golnari , David A. Clifton , Yuxiong He , Dacheng Tao , Shuaiwen Leon Song

In real-world scenarios, images captured often suffer from blurring, noise, and other forms of image degradation, and due to sensor limitations, people usually can only obtain low dynamic range images. To achieve high-quality images,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Kangzhen Yang , Tao Hu , Kexin Dai , Genggeng Chen , Yu Cao , Wei Dong , Peng Wu , Yanning Zhang , Qingsen Yan