English
Related papers

Related papers: AutoJoin: Efficient Adversarial Training against G…

200 papers

Adversarial attacks to image classification systems present challenges to convolutional networks and opportunities for understanding them. This study suggests that adversarial perturbations on images lead to noise in the features…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Cihang Xie , Yuxin Wu , Laurens van der Maaten , Alan Yuille , Kaiming He

Distributed model training suffers from communication bottlenecks due to frequent model updates transmitted across compute nodes. To alleviate these bottlenecks, practitioners use gradient compression techniques like sparsification,…

Machine Learning · Computer Science 2020-11-02 Saurabh Agarwal , Hongyi Wang , Kangwook Lee , Shivaram Venkataraman , Dimitris Papailiopoulos

For efficient and safe autonomous driving, it is essential that autonomous vehicles can predict the motion of other traffic agents. While highly accurate, current motion prediction models often impose significant challenges in terms of…

Robotics · Computer Science 2024-09-26 Alexander Prutsch , Horst Bischof , Horst Possegger

Algorithmic differentiation (AD) has become increasingly capable and straightforward to use. However, AD is inefficient when applied directly to solvers, a feature of most engineering analyses. We can leverage implicit differentiation to…

Optimization and Control · Mathematics 2023-06-28 Andrew Ning , Taylor McDonnell

With the rise of powerful foundation models, a pre-training-fine-tuning paradigm becomes increasingly popular these days: A foundation model is pre-trained using a huge amount of data from various sources, and then the downstream users only…

Machine Learning · Computer Science 2025-04-16 Meiqi Liu , Zhuoqun Huang , Yue Xing

Meta-optics promises compact, high-performance imaging and color routing. However, designing high-performance structures is a high-dimensional optimization problem: mapping a desired optical output back to a physical 3D structure requires…

Machine Learning · Computer Science 2026-04-21 Chanik Kang , Hyewon Suk , Haejun Chung

Learning-based denoising algorithms achieve state-of-the-art performance across various denoising tasks. However, training such models relies on access to large training datasets consisting of clean and noisy image pairs. On the other hand,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Ali Zafari , Xi Chen , Shirin Jalali

Trajectory optimization using a learned model of the environment is one of the core elements of model-based reinforcement learning. This procedure often suffers from exploiting inaccuracies of the learned model. We propose to regularize…

Machine Learning · Computer Science 2019-12-30 Rinu Boney , Norman Di Palo , Mathias Berglund , Alexander Ilin , Juho Kannala , Antti Rasmus , Harri Valpola

We propose a simple interpolation-based method for the efficient approximation of gradients in neural ODE models. We compare it with the reverse dynamic method (known in the literature as "adjoint method") to train neural ODEs on…

Neural and Evolutionary Computing · Computer Science 2020-11-03 Talgat Daulbaev , Alexandr Katrutsa , Larisa Markeeva , Julia Gusak , Andrzej Cichocki , Ivan Oseledets

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Traffic sign detection is an important research direction in intelligent driving. Unfortunately, existing methods often overlook extreme conditions such as fog, rain, and motion blur. Moreover, the end-to-end training strategy for image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Haoqin Hong , Yue Zhou , Xiangyu Shu , Xiaofang Hu

Gradient-based adversarial attacks on deep neural networks pose a serious threat, since they can be deployed by adding imperceptible perturbations to the test data of any network, and the risk they introduce cannot be assessed through the…

Cryptography and Security · Computer Science 2021-04-06 Rehana Mahfuz , Rajeev Sahay , Aly El Gamal

Neural networks, in particular autoencoders, are one of the most promising solutions for unmixing hyperspectral data, i.e. reconstructing the spectra of observed substances (endmembers) and their relative mixing fractions (abundances),…

Image and Video Processing · Electrical Eng. & Systems 2022-04-13 Kamil Książek , Przemysław Głomb , Michał Romaszewski , Michał Cholewa , Bartosz Grabowski , Krisztián Búza

The reliance on deep learning algorithms has grown significantly in recent years. Yet, these models are highly vulnerable to adversarial attacks, which introduce visually imperceptible perturbations into testing data to induce…

Machine Learning · Computer Science 2019-06-14 Rajeev Sahay , Rehana Mahfuz , Aly El Gamal

Neural rendering techniques promise efficient photo-realistic image synthesis while at the same time providing rich control over scene parameters by learning the physical image formation process. While several supervised methods have been…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Hassan Abu Alhaija , Siva Karthik Mustikovela , Justus Thies , Varun Jampani , Matthias Nießner , Andreas Geiger , Carsten Rother

Deep feedforward and recurrent networks have achieved impressive results in many perception and language processing applications. This success is partially attributed to architectural innovations such as convolutional and long short-term…

Machine Learning · Statistics 2015-11-24 Arvind Neelakantan , Luke Vilnis , Quoc V. Le , Ilya Sutskever , Lukasz Kaiser , Karol Kurach , James Martens

As Artificial Intelligence (AI) becomes increasingly integrated into microgrid control systems, the risk of malicious actors exploiting vulnerabilities in Machine Learning (ML) algorithms to disrupt power generation and distribution grows.…

Cryptography and Security · Computer Science 2025-03-26 Ahmed Omara , Burak Kantarci

Unsupervised learning is of growing interest because it unlocks the potential held in vast amounts of unlabelled data to learn useful representations for inference. Autoencoders, a form of generative model, may be trained by learning to…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Antonia Creswell , Anil Anthony Bharath

Parameterized feedforward control is at the basis of many successful control applications with varying references. The aim of this paper is to develop an efficient data-driven approach to learn the feedforward parameters for MIMO systems.…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Leontine Aarnoudse , Tom Oomen

Recent work has advocated for the use of deep learning to perform power allocation in the downlink of massive MIMO (maMIMO) networks. Yet, such deep learning models are vulnerable to adversarial attacks. In the context of maMIMO power…

Signal Processing · Electrical Eng. & Systems 2023-03-21 Rajeev Sahay , Minjun Zhang , David J. Love , Christopher G. Brinton