English
Related papers

Related papers: Softmax Dissection: Towards Understanding Intra- a…

200 papers

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

Most existing 3D object recognition algorithms focus on leveraging the strong discriminative power of deep learning models with softmax loss for the classification of 3D data, while learning discriminative features with deep metric learning…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Xinwei He , Yang Zhou , Zhichao Zhou , Song Bai , Xiang Bai

We explore the potential for using a nonsmooth loss function based on the max-norm in the training of an artificial neural network. We hypothesise that this may lead to superior classification results in some special cases where the…

Machine Learning · Computer Science 2021-07-20 Vinesha Peiris , Nadezda Sukhorukova , Vera Roshchina

Multi-channel deep clustering (MDC) has acquired a good performance for speech separation. However, MDC only applies the spatial features as the additional information. So it is difficult to learn mutual relationship between spatial and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-06 Cunhang Fan , Bin Liu , Jianhua Tao , Jiangyan Yi , Zhengqi Wen

We consider joint optimization and learning problems arising in real-time decision systems. While most existing work focuses primarily on convex, revenue-based objectives, we extend this line of research to multi-objective formulations. In…

Optimization and Control · Mathematics 2026-04-14 Zijun Li , Aswin Kannan

Deep metric learning aims to construct an embedding space where samples of the same class are close to each other, while samples of different classes are far away from each other. Most existing deep metric learning methods attempt to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Liu Pingping , Liu Zetong , Lang Yijun , Zhou Qiuzhan , Li Qingliang

Fovea localization is one of the most popular tasks in ophthalmic medical image analysis, where the coordinates of the center point of the macula lutea, i.e. fovea centralis, should be calculated based on color fundus images. In this work,…

Image and Video Processing · Electrical Eng. & Systems 2026-02-23 Yuli Wu , Peter Walter , Dorit Merhof

Deep learning has proven to be a highly effective tool for a wide range of applications, significantly when leveraging the power of multi-loss functions to optimize performance on multiple criteria simultaneously. However, optimal selection…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Amin Golnari , Mostafa Diba

Most previous deepfake detection methods bent their efforts to discriminate artifacts by end-to-end training. However, the learned networks often fail to mine the general face forgery information efficiently due to ignoring the data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Wentang Song , Yuzhen Lin , Bin Li

Due to escalating privacy concerns, federated learning has been recognized as a vital approach for training deep neural networks with decentralized medical data. In practice, it is challenging to ensure consistent imaging quality across…

Machine Learning · Computer Science 2024-12-19 Nannan Wu , Zhuo Kuang , Zengqiang Yan , Li Yu

Face Recognition is one of the prominent problems in the computer vision domain. Witnessing advances in deep learning, significant work has been observed in face recognition, which touched upon various parts of the recognition framework…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey

Deep learning models have become an increasingly preferred option for biometric recognition systems, such as speaker recognition. SincNet, a deep neural network architecture, gained popularity in speaker recognition tasks due to its…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-13 Labib Chowdhury , Mustafa Kamal , Najia Hasan , Nabeel Mohammed

Machine unlearning, as a post-hoc processing technique, has gained widespread adoption in addressing challenges like bias mitigation and robustness enhancement, colloquially, machine unlearning for fairness and robustness. However, existing…

Machine Learning · Computer Science 2025-05-27 Xinbao Qiao , Ningning Ding , Yushi Cheng , Meng Zhang

Modern image retrieval systems increasingly rely on the use of deep neural networks to learn embedding spaces in which distance encodes the relevance between a given query and image. In this setting, existing approaches tend to emphasize…

Machine Learning · Computer Science 2020-11-18 Andreas Veit , Kimberly Wilber

Recent studies have shown that Machine Learning (ML) models can exhibit bias in real-world scenarios, posing significant challenges in ethically sensitive domains such as healthcare. Such bias can negatively affect model fairness, model…

Machine Learning · Computer Science 2025-09-05 Junyu Yan , Feng Chen , Yuyang Xue , Yuning Du , Konstantinos Vilouras , Sotirios A. Tsaftaris , Steven McDonagh

Contextual representation models have achieved great success in improving various downstream tasks. However, these language-model-based encoders are difficult to train due to the large parameter sizes and high computational complexity. By…

Computation and Language · Computer Science 2019-03-01 Liunian Harold Li , Patrick H. Chen , Cho-Jui Hsieh , Kai-Wei Chang

Self-supervised learning (SSL) has emerged as a crucial technique in image processing, encoding, and understanding, especially for developing today's vision foundation models that utilize large-scale datasets without annotations to enhance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chuang Niu , Wenjun Xia , Hongming Shan , Ge Wang

Most of previous deepfake detection researches bent their efforts to describe and discriminate artifacts in human perceptible ways, which leave a bias in the learned networks of ignoring some critical invariance features intra-class and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Ruiqi Zha , Zhichao Lian , Qianmu Li , Siqi Gu

Federated learning is an increasingly popular paradigm that enables a large number of entities to collaboratively learn better models. In this work, we study minmax group fairness in paradigms where different participating entities may only…

Machine Learning · Computer Science 2021-10-08 Afroditi Papadaki , Natalia Martinez , Martin Bertran , Guillermo Sapiro , Miguel Rodrigues

The maximum element of the vector output by the Softmax function approaches zero as the input vector size increases. Transformer-based language models rely on Softmax to compute attention scores, causing the attention distribution to…

Computation and Language · Computer Science 2025-02-03 Ken M. Nakanishi
‹ Prev 1 8 9 10 Next ›