English
Related papers

Related papers: Multi-task Learning with 3D-Aware Regularization

200 papers

This paper considers the multi-task learning problem and in the setting where some relevant features could be shared across few related tasks. Most of the existing methods assume the extent to which the given tasks are related or share a…

Machine Learning · Computer Science 2012-06-22 Pratik Jawanpuria , J. Saketha Nath

Brain image registration transforms a pair of images into one system with the matched imaging contents, which is of essential importance for brain image analysis. This paper presents a novel framework for unsupervised 3D brain image…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Lihao Liu , Xiaowei Hu , Lei Zhu , Pheng-Ann Heng

The inherent ill-posed nature of image reconstruction problems, due to limitations in the physical acquisition process, is typically addressed by introducing a regularisation term that incorporates prior knowledge about the underlying…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Naïl Khelifa , Ferdia Sherry , Carola-Bibiane Schönlieb

Neuroimage processing tasks like segmentation, reconstruction, and registration are central to the study of neuroscience. Robust deep learning strategies and architectures used to solve these tasks are often similar. Yet, when presented…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Steffen Czolbe , Adrian V. Dalca

The "CNN-RNN" design pattern is increasingly widely applied in a variety of image annotation tasks including multi-label classification and captioning. Existing models use the weakly semantic CNN hidden layer or its transform as the image…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Bootstrapping is behind much of the successes of Deep Reinforcement Learning. However, learning the value function via bootstrapping often leads to unstable training due to fast-changing target values. Target Networks are employed to…

We propose a neural regularization method that refines the noisy 3D semantic field produced by lifting multi-view inconsistent 2D features, in order to obtain an accurate and robust 3D semantic Gaussian Splatting. The 2D features extracted…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Zaiyan Yang , Xinpeng Liu , Heng Guo , Jinglei Shi , Zhanyu Ma , Fumio Okura

Deep neural networks (DNNs) have substantial computational requirements, which greatly limit their performance in resource-constrained environments. Recently, there are increasing efforts on optical neural networks and optical computing…

Machine Learning · Computer Science 2021-04-05 Yingjie Li , Ruiyang Chen , Berardi Sensale Rodriguez , Weilu Gao , Cunxi Yu

The emergence of deep-learning-based methods to solve image-reconstruction problems has enabled a significant increase in reconstruction quality. Unfortunately, these new methods often lack reliability and explainability, and there is a…

Image and Video Processing · Electrical Eng. & Systems 2023-08-28 Alexis Goujon , Sebastian Neumayer , Pakshal Bohra , Stanislas Ducotterd , Michael Unser

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

Key to multitask learning is exploiting relationships between different tasks to improve prediction performance. If the relations are linear, regularization approaches can be used successfully. However, in practice assuming the tasks to be…

Machine Learning · Computer Science 2017-08-11 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco , Massimiliano Pontil

Multi-task learning leverages potential correlations among related tasks to extract common features and yield performance gains. However, most previous works only consider simple or weak interactions, thereby failing to model complex…

Computation and Language · Computer Science 2017-07-11 Honglun Zhang , Liqiang Xiao , Yongkun Wang , Yaohui Jin

Neural network based models have achieved impressive results on various specific tasks. However, in previous works, most models are learned separately based on single-task supervised objectives, which often suffer from insufficient training…

Computation and Language · Computer Science 2016-09-26 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Modern deep neural networks require a tremendous amount of data to train, often needing hundreds or thousands of labeled examples to learn an effective representation. For these networks to work with less data, more structure must be built…

Computer Vision and Pattern Recognition · Computer Science 2019-03-06 Reuben Feinman , Brenden M. Lake

Overfitting is one of the most common problems when training deep neural networks on comparatively small datasets. Here, we demonstrate that neural network activation sparsity is a reliable indicator for overfitting which we utilize to…

Machine Learning · Computer Science 2020-02-24 Karim Huesmann , Soeren Klemm , Lars Linsen , Benjamin Risse

Learning effective regularization is crucial for solving ill-posed inverse problems, which arise in a wide range of scientific and engineering applications. While data-driven methods that parameterize regularizers using deep neural networks…

Machine Learning · Statistics 2025-02-04 Yasi Zhang , Oscar Leong

One major challenge in training Deep Neural Networks is preventing overfitting. Many techniques such as data augmentation and novel regularizers such as Dropout have been proposed to prevent overfitting without requiring a massive amount of…

Machine Learning · Computer Science 2016-06-13 Michael Cogswell , Faruk Ahmed , Ross Girshick , Larry Zitnick , Dhruv Batra

Learning robust 3D shape segmentation functions with deep neural networks has emerged as a powerful paradigm, offering promising performance in producing a consistent part segmentation of each 3D shape. Generalizing across 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yu Hao , Hao Huang , Shuaihang Yuan , Yi Fang

Deep predictive models of neuronal activity have recently enabled several new discoveries about the selectivity and invariance of neurons in the visual cortex. These models learn a shared set of nonlinear basis functions, which are linearly…

Neurons and Cognition · Quantitative Biology 2024-06-19 Polina Turishcheva , Max Burg , Fabian H. Sinz , Alexander Ecker