English
Related papers

Related papers: Differential Description Length for Hyperparameter…

200 papers

In this article, we discuss some of the recent developments in applying machine learning (ML) techniques to nonlinear dynamical systems. In particular, we demonstrate how to build a suitable ML framework for addressing two specific…

Adaptation and Self-Organizing Systems · Physics 2020-11-30 Sayan Roy , Debanjan Rana

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

As deep learning methodologies have developed, it has been generally agreed that increasing neural network size improves model quality. However, this is at the expense of memory and compute requirements, which also need to be increased.…

Machine Learning · Computer Science 2024-08-07 Mitchelle Rasquinha , Gil Tabak

Hyperparameter optimization is a ubiquitous challenge in machine learning, and the performance of a trained model depends crucially upon their effective selection. While a rich set of tools exist for this purpose, there are currently no…

Machine Learning · Statistics 2021-11-10 Shubhankar Mohapatra , Sajin Sasy , Xi He , Gautam Kamath , Om Thakkar

Deep Metric Learning algorithms aim to learn an efficient embedding space to preserve the similarity relationships among the input data. Whilst these algorithms have achieved significant performance gains across a wide plethora of tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Soumava Kumar Roy , Yan Han , Mehrtash Harandi , Lars Petersson

In semi-supervised learning, methods that rely on confidence learning to generate pseudo-labels have been widely proposed. However, increasing research finds that when faced with noisy and biased data, the model's representation network is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Yanbiao Ma , Licheng Jiao , Fang Liu , Lingling Li , Shuyuan Yang , Xu Liu

In histopathological image analysis, feature extraction for classification is a challenging task due to the diversity of histology features suitable for each problem as well as presence of rich geometrical structure. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Tiep H. Vu , Hojjat S. Mousavi , Vishal Monga , UK Arvind Rao , Ganesh Rao

Game Description Language (GDL) provides a standardized way to express diverse games in a machine-readable format, enabling automated game simulation, and evaluation. While previous research has explored game description generation using…

Artificial Intelligence · Computer Science 2025-01-23 Tsunehiko Tanaka , Edgar Simo-Serra

Diffusion Large Language Models (DLLMs) are emerging as a powerful alternative to the dominant Autoregressive Large Language Models, offering efficient parallel generation and capable global context modeling. However, the practical…

Computation and Language · Computer Science 2025-08-19 Jinsong Li , Xiaoyi Dong , Yuhang Zang , Yuhang Cao , Jiaqi Wang , Dahua Lin

Extensive research on formal verification of machine learning (ML) systems indicates that learning from data alone often fails to capture underlying background knowledge. A variety of verifiers have been developed to ensure that a…

Logic in Computer Science · Computer Science 2023-11-17 Thomas Flinkow , Barak A. Pearlmutter , Rosemary Monahan

In many image-related tasks, learning expressive and discriminative representations of images is essential, and deep learning has been studied for automating the learning of such representations. Some user-centric tasks, such as image…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Chenyi Lei , Dong Liu , Weiping Li , Zheng-Jun Zha , Houqiang Li

Concise and meaningful method names are crucial for program comprehension and maintenance. However, method names may become inconsistent with their corresponding implementations, causing confusion and errors. Several deep learning…

Software Engineering · Computer Science 2025-01-23 Taiming Wang , Yuxia Zhang , Lin Jiang , Yi Tang , Guangjie Li , Hui Liu

Data dimension reduction (DDR) is all about mapping data from high dimensions to low dimensions, various techniques of DDR are being used for image dimension reduction like Random Projections, Principal Component Analysis (PCA), the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Wisal Khan , Muhammad Turab , Waqas Ahmad , Syed Hasnat Ahmad , Kelash Kumar , Bin Luo

Feature selection is frequently used as a pre-processing step to machine learning. It is a process of choosing a subset of original features so that the feature space is optimally reduced according to a certain evaluation criterion. The…

Computer Vision and Pattern Recognition · Computer Science 2014-01-07 Vijendra Singh , Shivani Pathak

A fundamental problem associated with the task of network reconstruction from dynamical or behavioral data consists in determining the most appropriate model complexity in a manner that prevents overfitting, and produces an inferred network…

Machine Learning · Statistics 2025-03-24 Tiago P. Peixoto

This paper describes an effective and efficient image classification framework nominated distributed deep representation learning model (DDRL). The aim is to strike the balance between the computational intensive deep learning approaches…

Computer Vision and Pattern Recognition · Computer Science 2016-07-05 Le Dong , Na Lv , Qianni Zhang , Shanshan Xie , Ling He , Mengdie Mao

While large-scale training data is fundamental for developing capable large language models (LLMs), strategically selecting high-quality data has emerged as a critical approach to enhance training efficiency and reduce computational costs.…

Machine Learning · Computer Science 2025-07-23 Yang Yu , Kai Han , Hang Zhou , Yehui Tang , Kaiqi Huang , Yunhe Wang , Dacheng Tao

Climate models play a critical role in understanding and projecting climate change. Due to their complexity, their horizontal resolution of about 40-100 km remains too coarse to resolve processes such as clouds and convection, which need to…

Machine Learning · Computer Science 2025-03-18 Birgit Kühbacher , Fernando Iglesias-Suarez , Niki Kilbertus , Veronika Eyring

In this paper we present new algorithms for training reduced-size nonlinear representations in the Kernel Dictionary Learning (KDL) problem. Standard KDL has the drawback of a large size of the kernel matrix when the data set is large.…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Denis C. Ilie-Ablachim , Bogdan Dumitrescu

Deep learning (DL) is gaining popularity as a parameter estimation method for quantitative MRI. A range of competing implementations have been proposed, relying on either supervised or self-supervised learning. Self-supervised approaches,…

Medical Physics · Physics 2024-01-24 Sean C. Epstein , Timothy J. P. Bray , Margaret Hall-Craggs , Hui Zhang