English
Related papers

Related papers: Intelligent Parameter Tuning in Optimization-based…

200 papers

Dynamic computed tomography perfusion (CTP) imaging is a promising approach for acute ischemic stroke diagnosis and evaluation. Hemodynamic parametric maps of cerebral parenchyma are calculated from repeated CT scans of the first pass of…

Medical Physics · Physics 2020-05-21 Dufan Wu , Hui Ren , Quanzheng Li

Deep neural networks exploiting millions of parameters are nowadays the norm in deep learning applications. This is a potential issue because of the great amount of computational resources needed for training, and of the possible loss of…

Computation and Language · Computer Science 2022-10-31 Giovanni Bonetta , Matteo Ribero , Rossella Cancelliere

Reducing scan time in Positron Emission Tomography (PET) imaging while maintaining high-quality images is crucial for minimizing patient discomfort and radiation exposure. Due to the limited size of datasets and distribution discrepancy…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Yumin Kim , Gayoon Choi , Seong Jae Hwang

Image reconstruction of low-count positron emission tomography (PET) data is challenging. Kernel methods address the challenge by incorporating image prior information in the forward model of iterative PET image reconstruction. The…

Image and Video Processing · Electrical Eng. & Systems 2022-10-25 Siqi Li , Kuang Gong , Ramsey D. Badawi , Edward J. Kim , Jinyi Qi , Guobao Wang

Graph transformers have gained popularity in various graph-based tasks by addressing challenges faced by traditional Graph Neural Networks. However, the quadratic complexity of self-attention operations and the extensive layering in graph…

Machine Learning · Computer Science 2023-09-20 Reza Shirkavand , Heng Huang

Hyperparameter Optimization (HPO) can lift the burden of tuning hyperparameters (HPs) of neural networks. HPO algorithms from the Population Based Training (PBT) family are efficient thanks to dynamically adjusting HPs every few steps of…

Machine Learning · Computer Science 2025-11-13 Alexander Chebykin , Tanja Alderliesten , Peter A. N. Bosman

Iterative pruning is one of the most effective compression methods for pre-trained language models. We discovered that finding the optimal pruning decision is an equality-constrained 0-1 Integer Linear Programming problem. The solution to…

Computation and Language · Computer Science 2023-05-23 Siyu Ren , Kenny Q. Zhu

In this paper, we investigate image reconstruction for dynamic Computed Tomography. The motion of the target with respect to the measurement acquisition rate leads to highly resolved in time but highly undersampled in space measurements.…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Pablo Arratia , Matthias Ehrhardt , Lisa Kreusser

We present a new inner-outer iterative algorithm for edge enhancement in imaging problems. At each outer iteration, we formulate a Tikhonov-regularized problem where the penalization is expressed in the 2-norm and involves a regularization…

Numerical Analysis · Mathematics 2020-12-30 Silvia Gazzola , Misha E. Kilmer , James G. Nagy , Oguz Semerici , Eric L. Miller

In X-ray Computed Tomography (CT), projections from many angles are acquired and used for 3D reconstruction. To make CT suitable for in-line quality control, reducing the number of angles while maintaining reconstruction quality is…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Tianyuan Wang , Felix Lucka , Tristan van Leeuwen

Commercial iterative reconstruction techniques on modern CT scanners target radiation dose reduction but there are lingering concerns over their impact on image appearance and low contrast detectability. Recently, machine learning,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Hongming Shan , Atul Padole , Fatemeh Homayounieh , Uwe Kruger , Ruhani Doda Khera , Chayanin Nitiwarangkul , Mannudeep K. Kalra , Ge Wang

Three-dimensional (3D) reconstruction of head Computed Tomography (CT) images elucidates the intricate spatial relationships of tissue structures, thereby assisting in accurate diagnosis. Nonetheless, securing an optimal head CT scan…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Bowen Zheng , Chenxi Huang , Yuemei Luo

We propose an efficient estimation technique for the automatic selection of locally-adaptive Total Variation regularisation parameters based on an hybrid strategy which combines a local maximum-likelihood approach estimating space-variant…

Optimization and Control · Mathematics 2020-05-20 Luca Calatroni , Alessandro Lanza , Monica Pragliola , Fiorella Sgallari

Prompt tuning attempts to update few task-specific parameters in pre-trained models. It has achieved comparable performance to fine-tuning of the full parameter set on both language understanding and generation tasks. In this work, we study…

Computation and Language · Computer Science 2022-07-15 Weng Lam Tam , Xiao Liu , Kaixuan Ji , Lilong Xue , Xingjian Zhang , Yuxiao Dong , Jiahua Liu , Maodi Hu , Jie Tang

Fine-tuning from pre-trained ImageNet models has become the de-facto standard for various computer vision tasks. Current practices for fine-tuning typically involve selecting an ad-hoc choice of hyperparameters and keeping them fixed to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Hao Li , Pratik Chaudhari , Hao Yang , Michael Lam , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Tuning parameters is an important step for the application of metaheuristics to problem classes of interest. In this work we present a tuning framework based on the sequential optimization of perturbed regression models. Besides providing…

Neural and Evolutionary Computing · Computer Science 2019-12-02 Áthila R. Trindade , Felipe Campelo

This paper is about regularizing deep convolutional networks (CNNs) based on an adaptive framework for transfer learning with limited training data in the target domain. Recent advances of CNN regularization in this context are commonly due…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Yang Zhong , Atsuto Maki

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

Calibration of sensors is a fundamental step to validate their operation. This can be a demanding task, as it relies on acquiring a detailed modelling of the device, aggravated by its possible dependence upon multiple parameters. Machine…

Pre-training (PT) followed by fine-tuning (FT) is an effective method for training neural networks, and has led to significant performance improvements in many domains. PT can incorporate various design choices such as task and data…

Machine Learning · Computer Science 2021-11-03 Aniruddh Raghu , Jonathan Lorraine , Simon Kornblith , Matthew McDermott , David Duvenaud