English
Related papers

Related papers: RoMA: Robust Model Adaptation for Offline Model-ba…

200 papers

Training and inference in deep neural networks (DNNs) has, due to a steady increase in architectural complexity and data set size, lead to the development of strategies for reducing time and space requirements of DNN training and inference,…

Machine Learning · Computer Science 2021-08-24 Lorenz Kummer

Recent advancements in domain generalization for deepfake detection have attracted significant attention, with previous methods often incorporating additional modules to prevent overfitting to domain-specific patterns. However, such…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Lingyu Qiu , Ke Jiang , Xiaoyang Tan

Recent progress in deep learning has been driven by increasingly larger models. However, their computational and energy demands have grown proportionally, creating significant barriers to their deployment and to a wider adoption of deep…

Machine Learning · Computer Science 2025-09-16 Pedro Savarese

Offline optimization is a fundamental challenge in science and engineering, where the goal is to optimize black-box functions using only offline datasets. This setting is particularly relevant when querying the objective function is…

Machine Learning · Computer Science 2026-01-07 Minsu Kim , Jiayao Gu , Ye Yuan , Taeyoung Yun , Zixuan Liu , Yoshua Bengio , Can Chen

To develop a trustworthy AI system, which aim to identify the input regions that most influence the models decisions. The primary task of existing attribution methods lies in efficiently and accurately identifying the relationships among…

Machine Learning · Computer Science 2026-05-20 Ruoyu Chen , Siyuan Liang , Jingzhi Li , Shiming Liu , Li Liu , Hua Zhang , Xiaochun Cao

Deep neural networks (DNNs) can enable precise control while maintaining low computational costs by circumventing the need for dynamic modeling. However, the deployment of such black-box approaches remains challenging for heavy-duty wheeled…

Robotics · Computer Science 2026-04-03 Mehdi Heydari Shahna , Jouni Mattila

In recent years, Non-Orthogonal Multiple Access (NOMA) system has emerged as a promising candidate for multiple access frameworks due to the evolution of deep machine learning, trying to incorporate deep machine learning into the NOMA…

Artificial Intelligence · Computer Science 2026-01-21 WooSeok Kim , Jeonghoon Lee , Sangho Kim , Taesun An , WonMin Lee , Dowon Kim , Kyungseop Shin

Designing optimisation algorithms that perform well in general requires experimentation on a range of diverse problems. Training neural networks is an optimisation task that has gained prominence with the recent successes of deep learning.…

Neural and Evolutionary Computing · Computer Science 2022-09-07 Katherine M. Malan , Christopher W. Cleghorn

Neural ranking models (NRMs) have shown remarkable success in recent years, especially with pre-trained language models. However, deep neural models are notorious for their vulnerability to adversarial examples. Adversarial attacks may…

Information Retrieval · Computer Science 2022-06-09 Chen Wu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

The theory of deep learning focuses almost exclusively on supervised learning, non-convex optimization using stochastic gradient descent, and overparametrized neural networks. It is common belief that the optimizer dynamics, network…

Machine Learning · Computer Science 2022-02-18 Xinyi Chen , Edgar Minasyan , Jason D. Lee , Elad Hazan

Central to the design of many robot systems and their controllers is solving a constrained blackbox optimization problem. This paper presents CNMA, a new method of solving this problem that is conservative in the number of potentially…

Artificial Intelligence · Computer Science 2021-02-09 Sanjai Narain , Emily Mak , Dana Chee , Todd Huster , Jeremy Cohen , Kishore Pochiraju , Brendan Englot , Niraj K. Jha , Karthik Narayan

In statistics, it is common to encounter multi-modal and non-smooth likelihood (or objective function) maximization problems, where the parameters have known upper and lower bounds. This paper proposes a novel derivative-free global…

Optimization and Control · Mathematics 2023-09-14 Priyam Das

Face recognition has obtained remarkable progress in recent years due to the great improvement of deep convolutional neural networks (CNNs). However, deep CNNs are vulnerable to adversarial examples, which can cause fateful consequences in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Yinpeng Dong , Hang Su , Baoyuan Wu , Zhifeng Li , Wei Liu , Tong Zhang , Jun Zhu

Online algorithms that allow a small amount of migration or recourse have been intensively studied in the last years. They are essential in the design of competitive algorithms for dynamic problems, where objects can also depart from the…

Data Structures and Algorithms · Computer Science 2019-05-21 Sebastian Berndt , Valentin Dreismann , Kilian Grage , Klaus Jansen , Ingmar Knof

Black-box optimization is often encountered for decision-making in complex systems management, where the knowledge of system is limited. Under these circumstances, it is essential to balance the utilization of new information with…

Computation · Statistics 2025-01-15 Teng Lian , Jian-Qiang Hu , Yuhang Wu , Zeyu Zheng

Adversarial transferability enables black-box attacks on unknown victim deep neural networks (DNNs), rendering attacks viable in real-world scenarios. Current transferable attacks create adversarial perturbation over the entire image,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Shangbo Wu , Yu-an Tan , Yajie Wang , Ruinan Ma , Wencong Ma , Yuanzhang Li

Dynamic multi-objective optimization problems (DMOPs) remain a challenge to be settled, because of conflicting objective functions change over time. In recent years, transfer learning has been proven to be a kind of effective approach in…

Neural and Evolutionary Computing · Computer Science 2019-10-23 Zhenzhong Wang , Min Jiang , Xing Gao , Liang Feng , Weizhen Hu , Kay Chen Tan

Despite their outstanding performance in a broad spectrum of real-world tasks, deep artificial neural networks are sensitive to input noises, particularly adversarial perturbations. On the contrary, human and animal brains are much less…

Neural and Evolutionary Computing · Computer Science 2022-05-23 Xiyuan Chen , Xingyu Li , Yi Zhou , Tianming Yang

Deep neural networks (DNNs) have provided brilliant performance across various tasks. However, this success often comes at the cost of unnecessarily large model sizes, high computational demands, and substantial memory footprints.…

Machine Learning · Computer Science 2025-11-26 Shaharyar Ahmed Khan Tareen , Filza Khan Tareen

Despite significant progress, Vision-Language Models (VLMs) still struggle with complex visual reasoning, where multi-step dependencies cause early errors to cascade through the reasoning chain. Existing post-training paradigms are limited:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yanbei Jiang , Chao Lei , Yihao Ding , Krista Ehinger , Jey Han Lau