English
Related papers

Related papers: CateNorm: Categorical Normalization for Robust Med…

200 papers

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning, where accurate boundary delineation is essential for precise lesion localization, organ identification, and quantitative assessment. In recent…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Peiting Tian , Xi Chen , Haixia Bi , Fan Li

Medical image segmentation can provide detailed information for clinical analysis which can be useful for scenarios where the detailed location of a finding is important. Knowing the location of disease can play a vital role in treatment…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Abhishek Srivastava , Sukalpa Chanda , Debesh Jha , Michael A. Riegler , Pål Halvorsen , Dag Johansen , Umapada Pal

Reliable classification and detection of certain medical conditions, in images, with state-of-the-art semantic segmentation networks, require vast amounts of pixel-wise annotation. However, the public availability of such datasets is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Erik Ostrowski , Bharath Srinivas Prabakaran , Muhammad Shafique

Deep neural networks often suffer the data distribution shift between training and testing, and the batch statistics are observed to reflect the shift. In this paper, targeting of alleviating distribution shift in test time, we revisit the…

Machine Learning · Computer Science 2022-05-23 Tao Yang , Shenglong Zhou , Yuwang Wang , Yan Lu , Nanning Zheng

In training neural networks, batch normalization has many benefits, not all of them entirely understood. But it also has some drawbacks. Foremost is arguably memory consumption, as computing the batch statistics requires all instances…

Machine Learning · Computer Science 2024-07-26 Benjamin Berger , Victor Uc Cetina

Spatial attention has been introduced to convolutional neural networks (CNNs) for improving both their performance and interpretability in visual tasks including image classification. The essence of the spatial attention is to learn a…

Image and Video Processing · Electrical Eng. & Systems 2020-08-03 Linchuan Xu , Jun Huang , Atsushi Nitanda , Ryo Asaoka , Kenji Yamanishi

Batch normalization has been widely used to improve optimization in deep neural networks. While the uncertainty in batch statistics can act as a regularizer, using these dataset statistics specific to the training set impairs generalization…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Vincent Michalski , Vikram Voleti , Samira Ebrahimi Kahou , Anthony Ortiz , Pascal Vincent , Chris Pal , Doina Precup

Convolutional neural network (CNN)-based image denoising methods have been widely studied recently, because of their high-speed processing capability and good visual quality. However, most of the existing CNN-based denoisers learn the image…

Image and Video Processing · Electrical Eng. & Systems 2020-06-30 Rui Zhao , Kin-Man Lam , Daniel P. K. Lun

Batch normalization (BN) allows training very deep networks by normalizing activations by mini-batch sample statistics which renders BN unstable for small batch sizes. Current small-batch solutions such as Instance Norm, Layer Norm, and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Xiangwei Shi , Yunqiang Li , Xin Liu , Jan van Gemert

Generalizable person re-identification aims to learn a model with only several labeled source domains that can perform well on unseen domains. Without access to the unseen domain, the feature statistics of the batch normalization (BN) layer…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Jiawei Liu , Zhipeng Huang , Liang Li , Kecheng Zheng , Zheng-Jun Zha

Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. However, when applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. After…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Rang Meng , Xianfeng Li , Weijie Chen , Shicai Yang , Jie Song , Xinchao Wang , Lei Zhang , Mingli Song , Di Xie , Shiliang Pu

Over the past few years, Batch-Normalization has been commonly used in deep networks, allowing faster training and high performance for a wide variety of applications. However, the reasons behind its merits remained unanswered, with several…

Machine Learning · Statistics 2019-02-08 Elad Hoffer , Ron Banner , Itay Golan , Daniel Soudry

Domain generalization (DG) is a principal task to evaluate the robustness of computer vision models. Many previous studies have used normalization for DG. In normalization, statistics and normalized features are regarded as style and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sangrok Lee , Jongseong Bae , Ha Young Kim

Convolutional neural networks (CNNs) show outstanding performance in many image processing problems, such as image recognition, object detection and image segmentation. Semantic segmentation is a very challenging task that requires…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Fan Jia , Jun Liu , Xue-cheng Tai

Image segmentation is an important task in many medical applications. Methods based on convolutional neural networks attain state-of-the-art accuracy; however, they typically rely on supervised training with large labeled datasets. Labeling…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Amy Zhao , Guha Balakrishnan , Frédo Durand , John V. Guttag , Adrian V. Dalca

Quantized Neural Networks (QNNs) use low bit-width fixed-point numbers for representing weight parameters and activations, and are often used in real-world applications due to their saving of computation resources and reproducibility of…

Machine Learning · Computer Science 2020-09-01 Dachao Lin , Peiqin Sun , Guangzeng Xie , Shuchang Zhou , Zhihua Zhang

An unsupervised data-driven nuclei segmentation method for histology images, called CBM, is proposed in this work. CBM consists of three modules applied in a block-wise manner: 1) data-driven color transform for energy compaction and…

Image and Video Processing · Electrical Eng. & Systems 2021-10-15 Vasileios Magoulianitis , Peida Han , Yijing Yang , C. -C. Jay Kuo

Convolutional Neural Networks (CNNs) have been recently employed to solve problems from both the computer vision and medical image analysis fields. Despite their popularity, most approaches are only able to process 2D images while most…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Fausto Milletari , Nassir Navab , Seyed-Ahmad Ahmadi

Batch Normalization (BN) uses mini-batch statistics to normalize the activations during training, introducing dependence between mini-batch elements. This dependency can hurt the performance if the mini-batch size is too small, or if the…

Machine Learning · Computer Science 2020-04-02 Saurabh Singh , Shankar Krishnan

Traditional domain generalization methods often rely on domain alignment to reduce inter-domain distribution differences and learn domain-invariant representations. However, domain shifts are inherently difficult to eliminate, which limits…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuheng Xu , Taiping Zhang