English
Related papers

Related papers: Comparing Optimization Targets for Contrast-Consis…

200 papers

Quality diversity (QD) optimization searches for a collection of solutions that optimize an objective while attaining diverse outputs of a user-specified, vector-valued measure function. Contemporary QD algorithms are typically limited to…

Machine Learning · Computer Science 2026-05-04 Bryon Tjanaka , Henry Chen , Matthew C. Fontaine , Stefanos Nikolaidis

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Direct Multisearch (DMS) is a well-established class of methods for multiobjective derivative-free optimization, where constraints are addressed by an extreme barrier approach, only evaluating feasible points. In this work, we propose a…

Optimization and Control · Mathematics 2025-08-14 Everton J. Silva , Ana Luísa Custódio

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann

Compression-based similarity measures are effectively employed in applications on diverse data types with a basically parameter-free approach. Nevertheless, there are problems in applying these techniques to medium-to-large datasets which…

Machine Learning · Statistics 2012-10-03 Daniele Cerra , Mihai Datcu

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

In this work, we propose a novel consistency-preserving loss function for recovering the phase information in the context of phase reconstruction (PR) and speech enhancement (SE). Different from conventional techniques that directly…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Pin-Jui Ku , Chun-Wei Ho , Hao Yen , Sabato Marco Siniscalchi , Chin-Hui Lee

In this paper, we propose the use of a black-box optimization method called deterministic Mesh Adaptive Direct Search (MADS) algorithm with orthogonal directions (Ortho-MADS) for the selection of hyperparameters of Support Vector Machines…

The Federated Learning setting has a central server coordinating the training of a model on a network of devices. One of the challenges is variable training performance when the dataset has a class imbalance. In this paper, we address this…

Machine Learning · Computer Science 2020-11-13 Dipankar Sarkar , Ankur Narang , Sumit Rai

Semi-supervised learning (SSL) has played an important role in leveraging unlabeled data when labeled data is limited. One of the most successful SSL approaches is based on consistency regularization, which encourages the model to produce…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Trung Q. Tran , Mingu Kang , Daeyoung Kim

We address the problem of generalized category discovery (GCD) that aims to partition a partially labeled collection of images; only a small part of the collection is labeled and the total number of target classes is unknown. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Sua Choi , Dahyun Kang , Minsu Cho

Loss functions play a pivotal role in optimizing recommendation models. Among various loss functions, Softmax Loss (SL) and Cosine Contrastive Loss (CCL) are particularly effective. Their theoretical connections and differences warrant…

Information Retrieval · Computer Science 2025-06-19 Shengjia Zhang , Jiawei Chen , Changdong Li , Sheng Zhou , Qihao Shi , Yan Feng , Chun Chen , Can Wang

Coarsened exact matching (CEM) is often promoted as a superior alternative to propensity score matching (PSM) for addressing imbalance, model dependence, bias, and efficiency. However, this recommendation remains uncertain. First, CEM is…

Methodology · Statistics 2026-02-03 Fei Wan

Existing studies on preference optimization (PO) have centered on constructing pairwise preference data following simple heuristics, such as maximizing the margin between preferred and dispreferred completions based on human (or AI) ranked…

Artificial Intelligence · Computer Science 2025-02-10 Zhuotong Chen , Fang Liu , Xuan Zhu , Yanjun Qi , Mohammad Ghavamzadeh

Compressive Sensing (CS) stipulates that a sparse signal can be recovered from a small number of linear measurements, and that this recovery can be performed efficiently in polynomial time. The framework of model-based compressive sensing…

Information Theory · Computer Science 2015-04-22 Chinmay Hegde , Piotr Indyk , Ludwig Schmidt

Automated cell detection and localization from microscopy images are significant tasks in biomedical research and clinical practice. In this paper, we design a new cell detection and localization algorithm that combines deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Yao Xue , Gilbert Bigras , Judith Hugh , Nilanjan Ray

Diversity optimization seeks to discover a set of solutions that elicit diverse features. Prior work has proposed Novelty Search (NS), which, given a current set of solutions, seeks to expand the set by finding points in areas of low…

Machine Learning · Computer Science 2024-05-31 David H. Lee , Anishalakshmi V. Palaparthi , Matthew C. Fontaine , Bryon Tjanaka , Stefanos Nikolaidis

The remarkable performance of deep neural networks (DNNs) currently makes them the method of choice for solving linear inverse problems. They have been applied to super-resolve and restore images, as well as to reconstruct MR and CT images.…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Marija Vella , João F. C. Mota

Deep learning approaches have shown promising performance for compressed sensing-based Magnetic Resonance Imaging. While deep neural networks trained with mean squared error (MSE) loss functions can achieve high peak signal to noise ratio,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Maximilian Seitzer , Guang Yang , Jo Schlemper , Ozan Oktay , Tobias Würfl , Vincent Christlein , Tom Wong , Raad Mohiaddin , David Firmin , Jennifer Keegan , Daniel Rueckert , Andreas Maier

The speaker extraction algorithm extracts the target speech from a mixture speech containing interference speech and background noise. The extraction process sometimes over-suppresses the extracted target speech, which not only creates…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Zexu Pan , Meng Ge , Haizhou Li