中文
相关论文

相关论文: Efficient Re-parameterization Operations Search fo…

200 篇论文

The recurrent mechanism has recently been introduced into U-Net in various medical image segmentation tasks. Existing studies have focused on promoting network recursion via reusing building blocks. Although network parameters could be…

图像与视频处理 · 电气工程与系统科学 2021-07-02 Xinyi Wang , Tiange Xiang , Chaoyi Zhang , Yang Song , Dongnan Liu , Heng Huang , Weidong Cai

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

机器学习 · 计算机科学 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

We propose a structured prediction architecture, which exploits the local generic features extracted by Convolutional Neural Networks and the capacity of Recurrent Neural Networks (RNN) to retrieve distant dependencies. The proposed…

计算机视觉与模式识别 · 计算机科学 2016-05-25 Francesco Visin , Marco Ciccone , Adriana Romero , Kyle Kastner , Kyunghyun Cho , Yoshua Bengio , Matteo Matteucci , Aaron Courville

High-resolution representations (HR) are essential for dense prediction tasks such as segmentation, detection, and pose estimation. Learning HR representations is typically ignored in previous Neural Architecture Search (NAS) methods that…

计算机视觉与模式识别 · 计算机科学 2021-06-15 Mingyu Ding , Xiaochen Lian , Linjie Yang , Peng Wang , Xiaojie Jin , Zhiwu Lu , Ping Luo

Convolutional Neural Networks (CNNs) continue to achieve great success in classification tasks as innovative techniques and complex multi-path architecture topologies are introduced. Neural Architecture Search (NAS) aims to automate the…

神经与进化计算 · 计算机科学 2023-12-14 Trevor Londt , Xiaoying Gao , Peter Andreae , Yi Mei

To achieve excellent performance with modern neural networks, having the right network architecture is important. Neural Architecture Search (NAS) concerns the automatic discovery of task-specific network architectures. Modern NAS…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Alexander Chebykin , Tanja Alderliesten , Peter A. N. Bosman

Convolutional Neural Networks have been used in a variety of image related applications after their rise in popularity due to ImageNet competition. Convolutional Neural Networks have shown remarkable results in applications including face…

机器学习 · 计算机科学 2023-01-18 Anshumaan Chauhan , Siddhartha Bhattacharyya , S. Vadivel

Training neural networks requires increasing amounts of memory. Parameter sharing can reduce memory and communication costs, but existing methods assume networks have many identical layers and utilize hand-crafted sharing strategies that…

机器学习 · 计算机科学 2022-03-17 Bryan A. Plummer , Nikoli Dryden , Julius Frost , Torsten Hoefler , Kate Saenko

Designing complex architectures has been an essential cogwheel in the revolution deep learning has brought about in the past decade. When solving difficult problems in a datadriven manner, a well-tried approach is to take an architecture…

机器学习 · 计算机科学 2021-10-14 Attila Nagy , Ábel Boros

Neural Architecture Search (NAS) methods autonomously discover high-accuracy neural network architectures, outperforming manually crafted ones. However, The NAS methods require high computational costs due to the high dimension search space…

神经与进化计算 · 计算机科学 2024-10-31 Zaniar Sharifi , Khabat Soltanian , Ali Amiri

Deep learning-based low-light image enhancers have made significant progress in recent years, with a trend towards achieving satisfactory visual quality while gradually reducing the number of parameters and improving computational…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Nan An , Long Ma , Guangchao Han , Xin Fan , RIsheng Liu

The structural re-parameterization (SRP) technique is a novel deep learning technique that achieves interconversion between different network architectures through equivalent parameter transformations. This technique enables the mitigation…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Shanshan Zhong , Zhongzhan Huang , Wushao Wen , Jinghui Qin , Liang Lin

Deep convolutional neural networks demonstrate impressive results in the super-resolution domain. A series of studies concentrate on improving peak signal noise ratio (PSNR) by using much deeper layers, which are not friendly to constrained…

计算机视觉与模式识别 · 计算机科学 2020-07-22 Xiangxiang Chu , Bo Zhang , Hailong Ma , Ruijun Xu , Qingyuan Li

Recently, Neural Architecture Search (NAS) methods have been introduced and show impressive performance on many benchmarks. Among those NAS studies, Neural Architecture Transformer (NAT) aims to adapt the given neural architecture to…

机器学习 · 计算机科学 2022-05-17 Do-Guk Kim , Heung-Chang Lee

Latest algorithms for automatic neural architecture search perform remarkable but few of them can effectively design the number of channels for convolutional neural networks and consume less computational efforts. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Hui Zhu , Zhulin An , Chuanguang Yang , Xiaolong Hu , Kaiqiang Xu , Yongjun Xu

Despite the remarkable successes of Convolutional Neural Networks (CNNs) in computer vision, it is time-consuming and error-prone to manually design a CNN. Among various Neural Architecture Search (NAS) methods that are motivated to…

计算机视觉与模式识别 · 计算机科学 2021-07-14 Hao Tan , Ran Cheng , Shihua Huang , Cheng He , Changxiao Qiu , Fan Yang , Ping Luo

The standard paradigm in Neural Architecture Search (NAS) is to search for a fully deterministic architecture with specific operations and connections. In this work, we instead propose to search for the optimal operation distribution, thus…

机器学习 · 计算机科学 2021-11-09 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Fabio M. Carlucci

Deep convolutional neural networks (CNNs) have been widely used in surface defect detection. However, no CNN architecture is suitable for all detection tasks and designing effective task-specific requires considerable effort. The neural…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Zhenrong Wang , Bin Li , Weifeng Li , Shuanlong Niu , Wang Miao , Tongzhi Niu

While Convolutional Neural Networks (CNNs) excel at learning complex latent-space representations, their over-parameterization can lead to overfitting and reduced performance, particularly with limited data. This, alongside their high…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Manish Sharma , Jamison Heard , Eli Saber , Panos P. Markopoulos

Fast Neural Architecture Construction (NAC) is a method to construct deep network architectures by pruning and expansion of a base network. In recent years, several automated search methods for neural network architectures have been…

神经与进化计算 · 计算机科学 2018-12-17 Purushotham Kamath , Abhishek Singh , Debo Dutta