English
Related papers

Related papers: On the Robustness and Generalization of Deep Learn…

200 papers

With the rapid rise of large models, copyright protection for generated image content has become a critical security challenge. Although deep learning watermarking techniques offer an effective solution for digital image copyright…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaowu Wu , Liting Zeng , Wei Lu , Xiangyang Luo

A key feature of human intelligence is the ability to generalize beyond the training distribution, for instance, parsing longer sentences than seen in the past. Currently, deep neural networks struggle to generalize robustly to such shifts…

Machine Learning · Computer Science 2022-02-22 Soham Dan , Osbert Bastani , Dan Roth

Ultrafast ultrasound imaging insonifies a medium with one or a combination of a few plane waves at different beam-steered angles instead of many focused waves. It can achieve much higher frame rates, but often at the cost of reduced image…

Image and Video Processing · Electrical Eng. & Systems 2024-04-23 Ryan A. L. Schoop , Gijs Hendriks , Tristan van Leeuwen , Chris L. de Korte , Felix Lucka

Deep neural networks have achieved remarkable results across many language processing tasks, however these methods are highly sensitive to noise and adversarial attacks. We present a regularization based method for limiting network…

Computation and Language · Computer Science 2016-09-21 Yitong Li , Trevor Cohn , Timothy Baldwin

In this paper, for the first time, we propose an evaluation method for deep learning models that assesses the performance of a model not only in an unseen test scenario, but also in extreme cases of noise, outliers and ambiguous input data.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Magdalini Paschali , Sailesh Conjeti , Fernando Navarro , Nassir Navab

Transfer learning is a widely-used paradigm in deep learning, where models pre-trained on standard datasets can be efficiently adapted to downstream tasks. Typically, better pre-trained models yield better transfer results, suggesting that…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Hadi Salman , Andrew Ilyas , Logan Engstrom , Ashish Kapoor , Aleksander Madry

Many recent efforts have been devoted to designing sophisticated deep learning structures, obtaining revolutionary results on benchmark datasets. The success of these deep learning methods mostly relies on an enormous volume of labeled…

Computer Vision and Pattern Recognition · Computer Science 2015-10-20 Jiaji Huang , Qiang Qiu , Robert Calderbank , Guillermo Sapiro

Deep learning has become a prominent computational modeling tool in the areas of computer vision and image processing in recent years. This research comprehensively analyzes the different deep-learning methods used for image-to-image…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Yuda Bi

Ultrasound computed tomography (USCT), as an emerging technology, can provide multiple quantitative parametric images of human tissue, such as sound speed and attenuation images, distinguishing it from conventional B-mode (reflection)…

Image and Video Processing · Electrical Eng. & Systems 2024-06-17 Weicheng Yan , Qiude Zhang , Yun Wu , Zhaohui Liu , Liang Zhou , Mingyue Ding , Ming Yuchi , Wu Qiu

Most of the available advanced misfit functions for full waveform inversion (FWI) are hand-crafted, and the performance of those misfit functions is data-dependent. Thus, we propose to learn a misfit function for FWI, entitled ML-misfit,…

Geophysics · Physics 2020-03-19 Bingbing Sun , Tariq Alkhalifah

Full waveform inversion (FWI) is an iterative nonlinear waveform matching procedure subject to wave-equation constraint. FWI is highly nonlinear when the wave-equation constraint is enforced at each iteration. To mitigate nonlinearity,…

Optimization and Control · Mathematics 2019-10-29 Hossein S. Aghamiry , Ali Gholami , Stephane Operto

Deep learning is a potential paradigm changer for the design of wireless communications systems (WCS), from conventional handcrafted schemes based on sophisticated mathematical models with assumptions to autonomous schemes based on the…

Information Theory · Computer Science 2018-08-08 Woongsup Lee , Ohyun Jo , Minhoe Kim

Deep learning has revolutionized neuroimage analysis by delivering unprecedented speed and accuracy. However, the narrow scope of many training datasets constrains model robustness and generalizability. This challenge is particularly acute…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Malte Hoffmann

Deep learning models have lately shown great performance in various fields such as computer vision, speech recognition, speech translation, and natural language processing. However, alongside their state-of-the-art performance, it is still…

Machine Learning · Computer Science 2019-04-09 Daniel Jakubovitz , Raja Giryes , Miguel R. D. Rodrigues

Studying the sensitivity of weight perturbation in neural networks and its impacts on model performance, including generalization and robustness, is an active research topic due to its implications on a wide range of machine learning tasks…

Machine Learning · Computer Science 2021-12-20 Yu-Lin Tsai , Chia-Yi Hsu , Chia-Mu Yu , Pin-Yu Chen

Full-waveform inversion (FWI) is a powerful seismic imaging technique used to estimate high-resolution physical properties of subsurface structures by minimizing the misfit between observed and modeled seismic data. FWI is inherently a…

Geophysics · Physics 2025-12-19 Kamal Aghazade , Toktam Zand , Ali Gholami

Accurately characterizing migration velocity models is crucial for a wide range of geophysical applications, from hydrocarbon exploration to monitoring of CO2 sequestration projects. Traditional velocity model building methods such as…

Machine Learning · Computer Science 2024-11-15 Rafael Orozco , Huseyin Tuna Erdinc , Yunlin Zeng , Mathias Louboutin , Felix J. Herrmann

Full waveform inversion (FWI) is a high-resolution seismic inversion technique popularly used in oil and gas exploration. Traditional FWI employs the $l_2$ norm measurement to minimize the misfit between observed and predicted seismic data.…

Geophysics · Physics 2025-04-03 Liangsheng He , Chao Song , Cai Liu

We address the fundamental question of why deep neural networks generalize by establishing a pointwise generalization theory for fully connected networks. This framework resolves long-standing barriers to characterizing the rich nonlinear…

Machine Learning · Computer Science 2026-05-19 Shaojie Li , Yunbei Xu

Clinical application of high-resolution diffusion MRI is hindered by hardware limitations and prohibitive scan times, motivating computational super-resolution. This study investigates the efficacy of a feature-based loss function in…

Image and Video Processing · Electrical Eng. & Systems 2026-05-18 David Lohr , Rene Werner