English
Related papers

Related papers: DisCo Fever: Robust Networks Through Distance Corr…

200 papers

Understanding and reasoning over long contexts is a crucial capability for language models (LMs). Although recent models support increasingly long context windows, their accuracy often deteriorates as input length grows. In practice, models…

Computation and Language · Computer Science 2026-04-17 Xi Ye , Wuwei Zhang , Fangcong Yin , Howard Yen , Danqi Chen

Empirically, Deep Learning (DL) has demonstrated unprecedented success in practical applications. However, DL remains by and large a mysterious "black-box", spurring recent theoretical research to build its mathematical foundations. In this…

Machine Learning · Computer Science 2025-01-22 Jwo-Yuh Wu , Liang-Chi Huang , Wen-Hsuan Li , Chun-Hung Liu

Deep neural networks have demonstrated remarkable advancements in various fields using large, well-annotated datasets. However, real-world data often exhibit long-tailed distributions and label noise, significantly degrading generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Jae Soon Baik , In Young Yoon , Kun Hoon Kim , Jun Won Choi

In this paper, we present confidence inference approachin an unsupervised way in stereo matching. Deep Neu-ral Networks (DNNs) have recently been achieving state-of-the-art performance. However, it is often hard to tellwhether the trained…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Ruichao Xiao , Wenxiu Sun , Chengxi Yang

Regularization plays a vital role in the context of deep learning by preventing deep neural networks from the danger of overfitting. This paper proposes a novel deep learning regularization method named as DL-Reg, which carefully reduces…

Machine Learning · Computer Science 2020-11-05 Maryam Dialameh , Ali Hamzeh , Hossein Rahmani

Decentralized learning enables edge users to collaboratively train models by exchanging information via device-to-device communication, yet prior works have been limited to wireless networks with fixed topologies and reliable workers. In…

Information Theory · Computer Science 2022-02-03 Eunjeong Jeong , Matteo Zecchin , Marios Kountouris

Deep learning will play a crucial role in enabling cognitive automation for the mobile networks of the future. Deep clustering, a subset of deep learning, could be a valuable tool for many network automation use-cases. Unfortunately, most…

Machine Learning · Computer Science 2021-03-16 Marton Kajo , Janik Schnellbach , Stephen S. Mwanje , Georg Carle

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

Unsupervised contrastive learning achieves great success in learning image representations with CNN. Unlike most recent methods that focused on improving accuracy of image classification, we present a novel contrastive learning approach,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Enze Xie , Jian Ding , Wenhai Wang , Xiaohang Zhan , Hang Xu , Peize Sun , Zhenguo Li , Ping Luo

Collecting large training datasets, annotated with high-quality labels, is costly and time-consuming. This paper proposes a novel framework for training deep convolutional neural networks from noisy labeled datasets that can be obtained…

Machine Learning · Computer Science 2017-11-06 Arash Vahdat

The task of clustering unlabeled time series and sequences entails a particular set of challenges, namely to adequately model temporal relations and variable sequence lengths. If these challenges are not properly handled, the resulting…

Machine Learning · Statistics 2019-02-19 Daniel J. Trosten , Andreas S. Strauman , Michael Kampffmeyer , Robert Jenssen

Building robust deterministic neural networks remains a challenge. On the one hand, some approaches improve out-of-distribution detection at the cost of reducing classification accuracy in some situations. On the other hand, some methods…

Machine Learning · Computer Science 2022-08-09 David Macêdo , Cleber Zanchettin , Teresa Ludermir

Decentralized learning (DL) is an emerging paradigm of collaborative machine learning that enables nodes in a network to train models collectively without sharing their raw data or relying on a central server. This paper introduces Zip-DL,…

Trajectory clustering enables the discovery of common patterns in trajectory data. Current methods of trajectory clustering rely on a distance measure between two points in order to measure the dissimilarity between two trajectories. The…

Artificial Intelligence · Computer Science 2023-10-31 Zi Jing Wang , Ye Zhu , Kai Ming Ting

Decentralized training of deep learning models is a key element for enabling data privacy and on-device learning over networks. In realistic learning scenarios, the presence of heterogeneity across different clients' local datasets poses an…

Machine Learning · Computer Science 2021-06-21 Tao Lin , Sai Praneeth Karimireddy , Sebastian U. Stich , Martin Jaggi

With the rapid advancement of neural language models, the deployment of over-parameterized models has surged, increasing the need for interpretable explanations comprehensible to human inspectors. Existing post-hoc interpretability methods,…

Artificial Intelligence · Computer Science 2024-11-08 Zijian Zhang , Vinay Setty , Yumeng Wang , Avishek Anand

Generating calibrated and sharp neural network predictive distributions for regression problems is essential for optimal decision-making in many real-world applications. To address the miscalibration issue of neural networks, various…

Machine Learning · Computer Science 2024-03-19 Victor Dheur , Souhaib Ben Taieb

Digital image correlation method is a non contact deformation measurement technique. Despite years of development, it is still difficult to solve the contradiction between calculation efficiency and seed point quantity.With the development…

Instrumentation and Detectors · Physics 2023-06-06 Yixiao Wang , Canlin Zhou , Si ShuChun , Hui Li

The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem since the ill-conditioning amplifies, in the solution, the noise present in the data. Recently introduced algorithms based…

Numerical Analysis · Mathematics 2024-02-08 Davide Evangelista , James Nagy , Elena Morotti , Elena Loli Piccolomini

Recent advances in deep learning have achieved impressive gains in classification accuracy on a variety of types of data, including images and text. Despite these gains, however, concerns have been raised about the calibration, robustness,…

Machine Learning · Computer Science 2018-11-20 Dallas Card , Michael Zhang , Noah A. Smith