中文
相关论文

相关论文: Hyperparameter Optimization and Reproducibility in…

200 篇论文

The deployment of pre-trained models (PTMs) has greatly advanced the field of continual learning (CL), enabling positive knowledge transfer and resilience to catastrophic forgetting. To sustain these advantages for sequentially arriving…

机器学习 · 计算机科学 2025-04-18 Liyuan Wang , Jingyi Xie , Xingxing Zhang , Hang Su , Jun Zhu

In order to improve reproducibility, deep reinforcement learning (RL) has been adopting better scientific practices such as standardized evaluation metrics and reporting. However, the process of hyperparameter optimization still varies…

机器学习 · 计算机科学 2023-06-05 Theresa Eimer , Marius Lindauer , Roberta Raileanu

Data scarcity is a major limiting factor for applying modern machine learning techniques to clinical tasks. Although sufficient data exists for some well-studied medical tasks, there remains a long tail of clinically relevant tasks with…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Stefano Woerner , Christian F. Baumgartner

Hyperparameter tuning is an omnipresent problem in machine learning as it is an integral aspect of obtaining the state-of-the-art performance for any model. Most often, hyperparameters are optimized just by training a model on a grid of…

机器学习 · 计算机科学 2019-06-28 Hadi S. Jomaa , Josif Grabocka , Lars Schmidt-Thieme

Recent breakthroughs in self-supervised learning have enabled the use of large unlabeled datasets to train visual foundation models that can generalize to a variety of downstream tasks. While this training paradigm is well suited for the…

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

图像与视频处理 · 电气工程与系统科学 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Despite the recent progress in deep reinforcement learning field (RL), and, arguably because of it, a large body of work remains to be done in reproducing and carefully comparing different RL algorithms. We present catalyst.RL, an open…

机器学习 · 计算机科学 2019-03-04 Sergey Kolesnikov , Oleksii Hrinchuk

Despite the evolution of Convolutional Neural Networks (CNNs), their performance is surprisingly dependent on the choice of hyperparameters. However, it remains challenging to efficiently explore large hyperparameter search space due to the…

计算机视觉与模式识别 · 计算机科学 2022-09-27 HyunJae Lee , Gihyeon Lee , Junhwan Kim , Sungjun Cho , Dohyun Kim , Donggeun Yoo

Deep learning based computed tomography (CT) reconstruction has demonstrated outstanding performance on simulated 2D low-dose CT data. This applies in particular to domain adapted neural networks, which incorporate a handcrafted physics…

图像与视频处理 · 电气工程与系统科学 2023-11-30 Jevgenija Rudzusika , Buda Bajić , Thomas Koehler , Ozan Öktem

Background and objective: Cell-level pathological image analysis requires working with extremely small image patches (40x40 pixels), far below standard ImageNet resolutions. It remains unclear whether modern deep learning architectures and…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Hiroki Kagiyama , Toru Nagasaka , Yukari Adachi , Takaaki Tachibana , Ryota Ito , Mitsugu Fujita , Kimihiro Yamashita , Yoshihiro Kakeji

Background: Empirical studies on widely used model-based development tools such as MATLAB/Simulink are limited despite the tools' importance in various industries. Aims: The aim of this paper is to investigate the reproducibility of…

软件工程 · 计算机科学 2023-08-10 Sohil Lal Shrestha , Shafiul Azam Chowdhury , Christoph Csallner

Pathology reports are structured, multi-granular documents encoding diagnostic conclusions, histological grades, and ancillary test results across one or more anatomical sites; yet existing pathology vision-language models (VLMs) reduce…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Ruicheng Yuan , Zhenxuan Zhang , Anbang Wang , Liwei Hu , Xiangqian Hua , Yaya Peng , Jiawei Luo , Guang Yang

Recent advances in Multimodal Large Language Models (MLLMs) have spurred significant progress in Chain-of-Thought (CoT) reasoning. Building on the success of Deepseek-R1, researchers extended multimodal reasoning to post-training paradigms…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Jianyu Qi , Ding Zou , Wenrui Yan , Rui Ma , Jiaxu Li , Zhijie Zheng , Zhiguo Yang , Rongchang Zhao

Recent years have seen great advancements in the development of deep learning models for histopathology image analysis in digital pathology applications, evidenced by the increasingly common deployment of these models in both research and…

图像与视频处理 · 电气工程与系统科学 2022-08-09 Veena Kaustaban , Qinle Ba , Ipshita Bhattacharya , Nahil Sobh , Satarupa Mukherjee , Jim Martin , Mohammad Saleh Miri , Christoph Guetter , Amal Chaturvedi

Colorectal diseases, including inflammatory conditions and neoplasms, require quick, accurate care to be effectively treated. Traditional diagnostic pipelines require extensive preparation and rely on separate, individual evaluations on…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Krithik Ramesh , Ritvik Koneru

The field of deep learning has witnessed significant breakthroughs, spanning various applications, and fundamentally transforming current software capabilities. However, alongside these advancements, there have been increasing concerns…

机器学习 · 计算机科学 2025-05-07 Nikita Ravi , Abhinav Goel , James C. Davis , George K. Thiruvathukal

Counterfactual learning to rank (CLTR) has attracted extensive attention in the IR community for its ability to leverage massive logged user interaction data to train ranking models. While the CLTR models can be theoretically unbiased when…

机器学习 · 计算机科学 2025-08-29 Zechun Niu , Zhilin Zhang , Jiaxin Mao , Qingyao Ai , Ji-Rong Wen

The scalability of current language-image pre-training for 3D medical imaging, such as CT and MRI, is constrained by the need for radiologists to manually curate raw clinical studies. In this work, we pioneer pre-training directly on…

计算机视觉与模式识别 · 计算机科学 2026-02-20 Chenhui Zhao , Yiwei Lyu , Asadur Chowdury , Edward Harake , Akhil Kondepudi , Akshay Rao , Xinhai Hou , Honglak Lee , Todd Hollon

In continual learning (CL) -- where a learner trains on a stream of data -- standard hyperparameter optimisation (HPO) cannot be applied, as a learner does not have access to all of the data at the same time. This has prompted the…

机器学习 · 计算机科学 2025-03-17 Thomas L. Lee , Sigrid Passano Hellan , Linus Ericsson , Elliot J. Crowley , Amos Storkey

In this paper, we tackle two fundamental problems in few-shot domain adaptation of foundation models. First, hyperparameter tuning is often impractical due to the lack of large validation datasets. Second, model robustness under…

机器学习 · 计算机科学 2025-07-09 Marco Roschkowski