中文
相关论文

相关论文: Training the Untrainable: Introducing Inductive Bi…

200 篇论文

An approach to incorporate deep learning within an iterative image reconstruction framework to reconstruct images from severely incomplete measurement data is presented. Specifically, we utilize a convolutional neural network (CNN) as a…

计算机视觉与模式识别 · 计算机科学 2017-09-05 Brendan Kelly , Thomas P. Matthews , Mark A. Anastasio

For almost 70 years, researchers have typically selected the width of neural networks' layers either manually or through automated hyperparameter tuning methods such as grid search and, more recently, neural architecture search. This paper…

机器学习 · 计算机科学 2026-02-17 Federico Errica , Henrik Christiansen , Viktor Zaverkin , Mathias Niepert , Francesco Alesiani

Machine learning requires exuberant amounts of data and computation. Also, models require equally excessive growth in the number of parameters. It is, therefore, sensible to look for technologies that reduce these demands on resources.…

机器学习 · 计算机科学 2023-03-29 Danko Nikolić , Davor Andrić , Vjekoslav Nikolić

Diffusion models have emerged as the mainstream approach for visual generation. However, these models typically suffer from sample inefficiency and high training costs. Consequently, methods for efficient finetuning, inference and…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Felix Krause , Timy Phan , Ming Gui , Stefan Andreas Baumann , Vincent Tao Hu , Björn Ommer

Prediction accuracy and model explainability are the two most important objectives when developing machine learning algorithms to solve real-world problems. The neural networks are known to possess good prediction performance, but lack of…

机器学习 · 统计学 2019-09-04 Zebin Yang , Aijun Zhang , Agus Sudjianto

Prior-data fitted networks (PFNs) were recently proposed as a new paradigm for machine learning. Instead of training the network to an observed training set, a fixed model is pre-trained offline on small, simulated training sets from a…

机器学习 · 统计学 2023-05-19 Thomas Nagler

A discriminatively trained neural net classifier can fit the training data perfectly if all information about its input other than class membership has been discarded prior to the output layer. Surprisingly, past research has discovered…

机器学习 · 计算机科学 2021-07-23 Piotr Teterwak , Chiyuan Zhang , Dilip Krishnan , Michael C. Mozer

Innovations in neural architectures have fostered significant breakthroughs in language modeling and computer vision. Unfortunately, novel architectures often result in challenging hyper-parameter choices and training instability if the…

机器学习 · 计算机科学 2021-11-25 Chen Zhu , Renkun Ni , Zheng Xu , Kezhi Kong , W. Ronny Huang , Tom Goldstein

Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based…

Recently, vision Transformers (ViTs) are developing rapidly and starting to challenge the domination of convolutional neural networks (CNNs) in the realm of computer vision (CV). With the general-purpose Transformer architecture replacing…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Haofei Zhang , Jiarui Duan , Mengqi Xue , Jie Song , Li Sun , Mingli Song

Reversible image conversion (RIC) suffers from ill-posedness issues due to its forward conversion process being considered an underdetermined system. Despite employing invertible neural networks (INN), existing RIC methods intrinsically…

图像与视频处理 · 电气工程与系统科学 2025-08-05 Yuanfei Huang , Hua Huang

Neural network models and deep models are one of the leading and state of the art models in machine learning. Most successful deep neural models are the ones with many layers which highly increases their number of parameters. Training such…

机器学习 · 计算机科学 2018-07-17 Soufiane Belharbi

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Training data is always finite, making it unclear how to generalise to unseen situations. But, animals do generalise, wielding Occam's razor to select a parsimonious explanation of their observations. How they do this is called their…

神经元与认知 · 定量生物学 2023-07-20 William Dorrell , Maria Yuffa , Peter Latham

Recent advances in generative models trained on large-scale datasets have made it possible to synthesize high-quality samples across various domains. Moreover, the emergence of strong inversion networks enables not only a reconstruction of…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Juwon Seo , Sung-Hoon Lee , Tae-Young Lee , Seungjun Moon , Gyeong-Moon Park

Reliable uncertainty quantification remains a major obstacle to the deployment of deep learning models under distributional shift. Existing post-hoc approaches that retrofit pretrained models either inherit misplaced confidence or merely…

机器学习 · 计算机科学 2025-09-30 Charmaine Barker , Daniel Bethell , Simos Gerasimou

Depth completion deals with the problem of recovering dense depth maps from sparse ones, where color images are often used to facilitate this task. Recent approaches mainly focus on image guided learning frameworks to predict dense depth.…

计算机视觉与模式识别 · 计算机科学 2022-07-14 Zhiqiang Yan , Kun Wang , Xiang Li , Zhenyu Zhang , Jun Li , Jian Yang

While the deployment of neural networks, yielding impressive results, becomes more prevalent in various applications, their interpretability and understanding remain a critical challenge. Network inversion, a technique that aims to…

机器学习 · 计算机科学 2024-02-20 Pirzada Suhail , Supratik Chakraborty , Amit Sethi

Neural Networks (NNs) are vulnerable to adversarial examples. Such inputs differ only slightly from their benign counterparts yet provoke misclassifications of the attacked NNs. The required perturbations to craft the examples are often…

密码学与安全 · 计算机科学 2020-09-30 Philip Sperl , Konstantin Böttinger

Improving the resilience of a network is a fundamental problem in network science, which protects the underlying system from natural disasters and malicious attacks. This is traditionally achieved via successive degree-preserving edge…

机器学习 · 计算机科学 2022-05-24 Shanchao Yang , Kaili Ma , Baoxiang Wang , Tianshu Yu , Hongyuan Zha