English
Related papers

Related papers: Deep Cross Residual Learning for Multitask Visual …

200 papers

Recent advances in molecular representation integrates molecular topological and visual modalities, opening new avenues for precise Molecular Relational Learning (MRL). Existing MRL methods focus on intra-domain modeling, and their inherent…

Machine Learning · Computer Science 2026-05-25 Peiliang Zhang , Jingling Yuan , Shiqing Wu , Mengqing Hu , Chao Che , Yongjun Zhu , Lin Li

This paper presents a deep relational metric learning (DRML) framework for image clustering and retrieval. Most existing deep metric learning methods learn an embedding space with a general objective of increasing interclass distances and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Wenzhao Zheng , Borui Zhang , Jiwen Lu , Jie Zhou

Channel estimation is one of the main tasks in realizing practical intelligent reflecting surface-assisted multi-user communication (IRS-MC) systems. However, different from traditional communication systems, an IRS-MC system generally…

Signal Processing · Electrical Eng. & Systems 2021-08-03 Chang Liu , Xuemeng Liu , Derrick Wing Kwan Ng , Jinhong Yuan

Transformer networks have achieved remarkable success across diverse domains, leveraging a variety of architectural innovations, including residual connections. However, traditional residual connections, which simply sum the outputs of…

Machine Learning · Computer Science 2025-07-25 Mike Heddes , Adel Javanmard , Kyriakos Axiotis , Gang Fu , MohammadHossein Bateni , Vahab Mirrokni

Residual units are wildly used for alleviating optimization difficulties when building deep neural networks. However, the performance gain does not well compensate the model size increase, indicating low parameter efficiency in these…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Chen Yunpeng , Jin Xiaojie , Kang Bingyi , Feng Jiashi , Yan Shuicheng

Recently deep residual learning with residual units for training very deep neural networks advanced the state-of-the-art performance on 2D image recognition tasks, e.g., object detection and segmentation. However, how to fully leverage…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Hao Chen , Qi Dou , Lequan Yu , Pheng-Ann Heng

In this paper we consider a problem known as multi-task learning, consisting of fitting a set of classifier or regression functions intended for solving different tasks. In our novel formulation, we couple the parameters of these functions,…

Machine Learning · Computer Science 2021-05-28 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Capsule networks are a type of neural network that have recently gained increased popularity. They consist of groups of neurons, called capsules, which encode properties of objects or object parts. The connections between capsules encrypt…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Josef Gugglberger , David Peer , Antonio Rodriguez-Sanchez

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

Machine Learning · Computer Science 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

Deep reinforcement learning yields great results for a large array of problems, but models are generally retrained anew for each new problem to be solved. Prior learning and knowledge are difficult to incorporate when training new models,…

Artificial Intelligence · Computer Science 2017-09-21 Aditya Gudimella , Ross Story , Matineh Shaker , Ruofan Kong , Matthew Brown , Victor Shnayder , Marcos Campos

In this paper, we propose a novel multi-task learning method based on the deep convolutional network. The proposed deep network has four convolutional layers, three max-pooling layers, and two parallel fully connected layers. To adjust the…

Machine Learning · Computer Science 2019-04-17 Fang Su , Hai-Yang Shang , Jing-Yan Wang

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

Machine Learning · Computer Science 2020-09-22 Michael Crawshaw

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

When searching for objects in cluttered environments, it is often necessary to perform complex interactions in order to move occluding objects out of the way and fully reveal the object of interest and make it graspable. Due to the…

Residual networks are the current state of the art on ImageNet. Similar work in the direction of utilizing shortcut connections has been done extremely recently with derivatives of residual networks and with highway networks. This work…

Computer Vision and Pattern Recognition · Computer Science 2017-01-11 Brian Chu , Daylen Yang , Ravi Tadinada

ResNets and its variants play an important role in various fields of image recognition. This paper gives another variant of ResNets, a kind of cross-residual learning networks called C-ResNets, which has less computation and parameters than…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Jun Liang , Songsen Yu , Huan Yang

Apart from discriminative models for classification and object detection tasks, the application of deep convolutional neural networks to basic research utilizing natural imaging data has been somewhat limited; particularly in cases where a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 R. Ian Etheredge , Manfred Schartl , Alex Jordan

Despite progress in visual perception tasks such as image classification and detection, computers still struggle to understand the interdependency of objects in the scene as a whole, e.g., relations between objects or their attributes.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-10 Xiaodan Liang , Lisa Lee , Eric P. Xing

Recent advancements in deep neural networks have markedly enhanced the performance of computer vision tasks, yet the specialized nature of these networks often necessitates extensive data and high computational power. Addressing these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Jiayou Chao , Wei Zhu

Convolutional neural network (CNN) depth is of crucial importance for image super-resolution (SR). However, we observe that deeper networks for image SR are more difficult to train. The low-resolution inputs and features contain abundant…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Yulun Zhang , Kunpeng Li , Kai Li , Lichen Wang , Bineng Zhong , Yun Fu