English
Related papers

Related papers: Cosine-Similarity Methods for Efficient Training a…

200 papers

Sparse neural networks attract increasing interest as they exhibit comparable performance to their dense counterparts while being computationally efficient. Pruning the dense neural networks is among the most widely used methods to obtain a…

Neural and Evolutionary Computing · Computer Science 2022-11-11 Zahra Atashgahi , Joost Pieterse , Shiwei Liu , Decebal Constantin Mocanu , Raymond Veldhuis , Mykola Pechenizkiy

A novel energy-efficient edge computing paradigm is proposed for real-time deep learning-based image upsampling applications. State-of-the-art deep learning solutions for image upsampling are currently trained using either resize or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

Recent advances in generative deep learning have enabled the creation of high-quality synthetic images in text-to-image generation. Prior work shows that fine-tuning a pretrained diffusion model on ImageNet and generating synthetic training…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhuoran Yu , Chenchen Zhu , Sean Culatana , Raghuraman Krishnamoorthi , Fanyi Xiao , Yong Jae Lee

Lane detection is crucial for vehicle localization which makes it the foundation for automated driving and many intelligent and advanced driving assistant systems. Available vision-based lane detection methods do not make full use of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Ruohan Li , Yongqi Dong

The world is inherently dynamic, and continual learning aims to enable models to adapt to ever-evolving data streams. While pre-trained models have shown powerful performance in continual learning, they still require finetuning to adapt…

Machine Learning · Computer Science 2026-03-20 Haihua Luo , Xuming Ran , Tommi Kärkkäinen , Huiyan Xue , Zhonghua Chen , Qi Xu , Fengyu Cong

Recently, learned image compression techniques have achieved remarkable performance, even surpassing the best manually designed lossy image coders. They are promising to be large-scale adopted. For the sake of practicality, a thorough…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Dailan He , Ziming Yang , Weikun Peng , Rui Ma , Hongwei Qin , Yan Wang

Variational Autoencoders (VAEs) are powerful generative models for learning latent representations. Standard VAEs generate dispersed and unstructured latent spaces by utilizing all dimensions, which limits their interpretability, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Farshad Sangari Abiz , Reshad Hosseini , Babak N. Araabi

The rapid increase in remote sensing satellites has led to the emergence of distributed space-based observation systems. However, existing distributed remote sensing models often rely on centralized training, resulting in data leakage,…

Machine Learning · Computer Science 2025-04-08 Xiaohe Li , Haohua Wu , Jiahao Li , Zide Fan , Kaixin Zhang , Xinming Li , Yunping Ge , Xinyu Zhao

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

While mel-spectrograms have been widely utilized as intermediate representations in zero-shot text-to-speech (TTS), their inherent redundancy leads to inefficiency in learning text-speech alignment. Compact VAE-based latent representations…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-02 Zhikang Niu , Shujie Hu , Jeongsoo Choi , Yushen Chen , Peining Chen , Pengcheng Zhu , Yunting Yang , Bowen Zhang , Jian Zhao , Chunhui Wang , Xie Chen

Recent 3D content generation pipelines commonly employ Variational Autoencoders (VAEs) to encode shapes into compact latent representations for diffusion-based generation. However, the widely adopted uniform point sampling strategy in Shape…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Rui Chen , Jianfeng Zhang , Yixun Liang , Guan Luo , Weiyu Li , Jiarui Liu , Xiu Li , Xiaoxiao Long , Jiashi Feng , Ping Tan

We describe an image compression method, consisting of a nonlinear analysis transformation, a uniform quantizer, and a nonlinear synthesis transformation. The transforms are constructed in three successive stages of convolutional linear…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Johannes Ballé , Valero Laparra , Eero P. Simoncelli

Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Yifan Pu , Yizeng Han , Yulin Wang , Junlan Feng , Chao Deng , Gao Huang

Accurate and stable feature matching is critical for computer vision tasks, particularly in applications such as Simultaneous Localization and Mapping (SLAM). While recent learning-based feature matching methods have demonstrated promising…

Robotics · Computer Science 2025-04-08 Yuqing Wang , Yan Wang , Hailiang Tang , Xiaoji Niu

Localizing more sources than sensors with a sparse linear array (SLA) has long relied on minimizing a distance between two covariance matrices and recent algorithms often utilize semidefinite programming (SDP). Although deep neural network…

Signal Processing · Electrical Eng. & Systems 2025-03-11 Kuan-Lin Chen , Bhaskar D. Rao

Vision-language models such as CLIP have shown impressive capabilities in aligning images and text, but they often struggle with lengthy and detailed text descriptions due to pre-training on short and concise captions. We present FAST-GOAL…

Artificial Intelligence · Computer Science 2026-05-27 Hyungyu Choi , Young Kyun Jang , Chanho Eom

End to end (E2E) autonomous driving trajectory prediction is often trained with camera frames sampled at the highest available temporal frequency, assuming that denser sampling improves performance. We question this assumption by treating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yumao Liu , Tao Liu , Xiangyu Li , Jiaxiang Li , Ke Ma

The loss functions of deep neural networks are complex and their geometric properties are not well understood. We show that the optima of these complex loss functions are in fact connected by simple curves over which training and test…

Machine Learning · Statistics 2018-10-31 Timur Garipov , Pavel Izmailov , Dmitrii Podoprikhin , Dmitry Vetrov , Andrew Gordon Wilson

We analyze the training of a two-layer autoencoder used to parameterize a flow-based generative model for sampling from a high-dimensional Gaussian mixture. Previous work shows that the phase where the relative probability between the modes…

Machine Learning · Computer Science 2025-02-11 Santiago Aranguri , Francesco Insulla

We present variational generative adversarial networks, a general learning framework that combines a variational auto-encoder with a generative adversarial network, for synthesizing images in fine-grained categories, such as faces of a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Jianmin Bao , Dong Chen , Fang Wen , Houqiang Li , Gang Hua