English
Related papers

Related papers: RegBN: Batch Normalization of Multimodal Data with…

200 papers

Adapting a model to perform well on unforeseen data outside its training set is a common problem that continues to motivate new approaches. We demonstrate that application of batch normalization in the output layer, prior to softmax…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Matthew R. Behrend , Sean M. Robinson

In this paper, we study the problem of multi-domain image generation, the goal of which is to generate pairs of corresponding images from different domains. With the recent development in generative models, image generation has achieved…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Xudong Mao , Qing Li

Several image processing tasks, such as image classification and object detection, have been significantly improved using Convolutional Neural Networks (CNN). Like ResNet and EfficientNet, many architectures have achieved outstanding…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Claudio Filipi Gonçalves dos Santos , João Paulo Papa

Deep learning has made significant advancements in supervised learning. However, models trained in this setting often face challenges due to domain shift between training and test sets, resulting in a significant drop in performance during…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Lei Qi , Hongpeng Yang , Yinghuan Shi , Xin Geng

A large number of real-world graphs or networks are inherently heterogeneous, involving a diversity of node types and relation types. Heterogeneous graph embedding is to embed rich structural and semantic information of a heterogeneous…

Social and Information Networks · Computer Science 2020-04-01 Xinyu Fu , Jiani Zhang , Ziqiao Meng , Irwin King

Modern deep models are trained on large real-world datasets, where data quality varies and redundancy is common. Data-centric approaches such as dataset pruning have shown promise in improving training efficiency and model performance.…

Machine Learning · Computer Science 2025-07-18 Suorong Yang , Peijia Li , Yujie Liu , Zhiming Xu , Peng Ye , Wanli Ouyang , Furao Shen , Dongzhan Zhou

Many recent datasets contain a variety of different data modalities, for instance, image, question, and answer data in visual question answering (VQA). When training deep net classifiers on those multi-modal datasets, the modalities get…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Itai Gat , Idan Schwartz , Alexander Schwing , Tamir Hazan

The rise in loosely-structured data available through text, images, and other modalities has called for new ways of querying them. Multimedia Information Retrieval has filled this gap and has witnessed exciting progress in recent years.…

Multimedia · Computer Science 2024-01-31 Giovanni Trappolini , Andrea Santilli , Emanuele Rodolà , Alon Halevy , Fabrizio Silvestri

Neural Radiance Fields (NeRF) have significantly advanced the field of novel view synthesis, yet their generalization across diverse scenes and conditions remains challenging. Addressing this, we propose the integration of a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Ahmed Qazi , Abdul Basit , Asim Iqbal

Training a deep neural network with a small amount of data is a challenging problem as it is vulnerable to overfitting. However, one of the practical difficulties that we often face is to collect many samples. Transfer learning is a…

Machine Learning · Computer Science 2020-07-13 Yunho Jeon , Yongseok Choi , Jaesun Park , Subin Yi , Dongyeon Cho , Jiwon Kim

Multimodal learning is a rapidly growing research field that has revolutionized multitasking and generative modeling in AI. While much of the research has focused on dealing with unstructured data (e.g., language, images, audio, or video),…

Artificial Intelligence · Computer Science 2024-03-11 Marco D Alessandro , Enrique Calabrés , Mikel Elkano

Deep Neural Networks have shown great promise on a variety of downstream applications; but their ability to adapt and generalize to new data and tasks remains a challenge. However, the ability to perform few or zero-shot adaptation to novel…

Machine Learning · Computer Science 2020-10-14 Samarth Sinha , Karsten Roth , Anirudh Goyal , Marzyeh Ghassemi , Hugo Larochelle , Animesh Garg

Most of the recent results in polynomial functional regression have been focused on an in-depth exploration of single-parameter regularization schemes. In contrast, in this study we go beyond that framework by introducing an algorithm for…

Multispectral and multimodal images are of important usage in the field of multi-source visual information fusion. Due to the alternation or movement of image devices, the acquired multispectral and multimodal images are usually misaligned,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Si-Yuan Cao , Beinan Yu , Lun Luo , Shu-Jie Chen , Chunguang Li , Hui-Liang Shen

Deep Neural Networks have achieved remarkable success relying on the developing availability of GPUs and large-scale datasets with increasing network depth and width. However, due to the expensive computation and intensive memory,…

Machine Learning · Computer Science 2020-09-07 E Zhenqian , Gao Weiguo

Despite the rapid evolution of semantic segmentation for land cover classification in high-resolution remote sensing imagery, integrating multiple data modalities such as Digital Surface Model (DSM), RGB, and Near-infrared (NIR) remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Tong Wang , Guanzhou Chen , Xiaodong Zhang , Chenxi Liu , Xiaoliang Tan , Jiaqi Wang , Chanjuan He , Wenlin Zhou

Multi-modal machine translation aims at translating the source sentence into a different language in the presence of the paired image. Previous work suggests that additional visual information only provides dispensable help to translation,…

Computation and Language · Computer Science 2019-12-30 Pengcheng Yang , Boxing Chen , Pei Zhang , Xu Sun

Deep Convolutional Neural Networks (DCNNs) are hard and time-consuming to train. Normalization is one of the effective solutions. Among previous normalization methods, Batch Normalization (BN) performs well at medium and large batch sizes…

Machine Learning · Computer Science 2020-12-10 Xiao-Yun Zhou , Jiacheng Sun , Nanyang Ye , Xu Lan , Qijun Luo , Bo-Lin Lai , Pedro Esperanca , Guang-Zhong Yang , Zhenguo Li

Despite their impressive performance, Deep Neural Networks (DNNs) typically underperform Gradient Boosting Trees (GBTs) on many tabular-dataset learning tasks. We propose that applying a different regularization coefficient to each weight…

Machine Learning · Statistics 2018-10-25 Ira Shavitt , Eran Segal

How to extract more and useful information for single image super resolution is an imperative and difficult problem. Learning-based method is a representative method for such task. However, the results are not so stable as there may exist…

Image and Video Processing · Electrical Eng. & Systems 2020-03-25 Hu Liang , Shengrong Zhao