English
Related papers

Related papers: CateNorm: Categorical Normalization for Robust Med…

200 papers

Batch normalization (BN) is a popular and ubiquitous method in deep learning that has been shown to decrease training time and improve generalization performance of neural networks. Despite its success, BN is not theoretically well…

Machine Learning · Computer Science 2022-01-21 Susanna Lange , Kyle Helfrich , Qiang Ye

Batch normalization (BN) is central to modern deep networks, but its effect on the realized function during training remains less understood than its optimization benefits. We study training-time BN in continuous piecewise-affine (CPA)…

Machine Learning · Computer Science 2026-05-13 Xuan Qi , Yi Wei , Fanqi Yu , Furao Shen , Vittorio Murino , Cigdem Beyan

While the authors of Batch Normalization (BN) identify and address an important problem involved in training deep networks-- \textit{Internal Covariate Shift}-- the current solution has certain drawbacks. For instance, BN depends on batch…

Machine Learning · Statistics 2016-06-21 Devansh Arpit , Yingbo Zhou , Hung Ngo , Venu Govindaraju

Sampling and quantization are standard practices in signal and image processing, but a theoretical understanding of their impact is incomplete. We consider discrete image registration when the underlying function is a one-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Serap A. Savari

Batch normalization (BN) has become a de facto standard for training deep convolutional networks. However, BN accounts for a significant fraction of training run-time and is difficult to accelerate, since it is a memory-bandwidth bounded…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Igor Gitman , Boris Ginsburg

Some real-world domains, such as Agriculture and Healthcare, comprise early-stage disease indications whose recording constitutes a rare event, and yet, whose precise detection at that stage is critical. In this type of highly imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Veysel Kocaman , Ofer M. Shir , Thomas Bäck

Batch Normalization (BatchNorm) is commonly used in Convolutional Neural Networks (CNNs) to improve training speed and stability. However, there is still limited consensus on why this technique is effective. This paper uses concepts from…

Neural and Evolutionary Computing · Computer Science 2021-06-02 Elaina Chai , Mert Pilanci , Boris Murmann

Cell nuclei segmentation is one of the most important tasks in the analysis of biomedical images. With ever-growing sizes and amounts of three-dimensional images to be processed, there is a need for better and faster segmentation methods.…

Computer Vision and Pattern Recognition · Computer Science 2017-02-20 Julian Arz , Peter Sanders , Johannes Stegmaier , Ralf Mikut

The fundamental difficulty in person re-identification (ReID) lies in learning the correspondence among individual cameras. It strongly demands costly inter-camera annotations, yet the trained models are not guaranteed to transfer well to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Zijie Zhuang , Longhui Wei , Lingxi Xie , Tianyu Zhang , Hengheng Zhang , Haozhe Wu , Haizhou Ai , Qi Tian

Although supervised deep-learning has achieved promising performance in medical image segmentation, many methods cannot generalize well on unseen data, limiting their real-world applicability. To address this problem, we propose a deep…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Shangqi Gao , Hangqi Zhou , Yibo Gao , Xiahai Zhuang

Image segmentation has come a long way since the early days of computer vision, and still remains a challenging task. Modern variations of the classical (purely bottom-up) approach, involve, e.g., some form of user assistance (interactive…

Computer Vision and Pattern Recognition · Computer Science 2017-07-19 Eyasu Zemene , Leulseged Tesfaye Alemu , Marcello Pelillo

Deep convolutional neural networks (CNNs) are state-of-the-art for semantic image segmentation, but typically require many labeled training samples. Obtaining 3D segmentations of medical images for supervised training is difficult and labor…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Zhenlin Xu , Marc Niethammer

Image colorization achieves more and more realistic results with the increasing computation power of recent deep learning techniques. It becomes more difficult to identify the fake colorized images by human eyes. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Weize Quan , Dong-Ming Yan , Kai Wang , Xiaopeng Zhang , Denis Pellerin

Convolutional Neural Networks (CNNs) work very well for supervised learning problems when the training dataset is representative of the variations expected to be encountered at test time. In medical image segmentation, this premise is…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Neerav Karani , Ertunc Erdil , Krishna Chaitanya , Ender Konukoglu

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia

Mammography stands as the main screening method for detecting breast cancer early, enhancing treatment success rates. The segmentation of landmark structures in mammography images can aid the medical assessment in the evaluation of cancer…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Jan Hurtado , Joao P. Maia , Cesar A. Sierra-Franco , Alberto Raposo

Efficiently utilizing discriminative features is crucial for convolutional neural networks to achieve remarkable performance in medical image segmentation and is also important for model generalization across multiple domains, where letting…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Ran Gu , Jiangshan Lu , Jingyang Zhang , Wenhui Lei , Xiaofan Zhang , Guotai Wang , Shaoting Zhang

Normalization layers in neural operators usually compute statistics by uniformly averaging discrete grid values, making the normalization itself discretization-dependent and thereby a source of transfer error across different resolutions or…

Machine Learning · Computer Science 2026-05-11 Bum Jun Kim , Makoto Kawano , Yusuke Iwasawa , Yutaka Matsuo

The Segment Anything Model (SAM) has achieved remarkable successes in the realm of natural image segmentation, but its deployment in the medical imaging sphere has encountered challenges. Specifically, the model struggles with medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Shreyank N Gowda , David A. Clifton

Computed Tomography (CT) based precise prostate segmentation for treatment planning is challenging due to (1) the unclear boundary of the prostate derived from CT's poor soft tissue contrast and (2) the limitation of convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2023-07-20 Chengyin Li , Yao Qiang , Rafi Ibn Sultan , Hassan Bagher-Ebadian , Prashant Khanduri , Indrin J. Chetty , Dongxiao Zhu