English
Related papers

Related papers: CLMB: deep contrastive learning for robust metagen…

200 papers

Automated bug priority inference can reduce the time overhead of bug triagers for priority assignments, improving the efficiency of software maintenance. Currently, there are two orthogonal lines for this task, i.e., traditional machine…

Software Engineering · Computer Science 2022-12-05 Wenyao Wang , Chenhao Wu , Jie He

The cosmic microwave background (CMB) is a significant source of knowledge about the origin and evolution of our universe. However, observations of the CMB are contaminated by foreground emissions, obscuring the CMB signal and reducing its…

Machine Learning · Computer Science 2023-02-27 Jadie Adams , Steven Lu , Krzysztof M. Gorski , Graca Rocha , Kiri L. Wagstaff

High annotation costs are a substantial bottleneck in applying modern deep learning architectures to clinically relevant medical use cases, substantiating the need for novel algorithms to learn from unlabeled data. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Aiham Taleb , Matthias Kirchler , Remo Monti , Christoph Lippert

Upcoming ground-based cosmic microwave background experiments will provide CMB maps with high sensitivity and resolution that can be used for high fidelity lensing reconstruction. However, the sky coverage will be incomplete and the noise…

Cosmology and Nongalactic Astrophysics · Physics 2019-12-11 Mark Mirmelstein , Julien Carron , Antony Lewis

Complex-valued processing brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the noise reduction process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram. Complex…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-24 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante-B. , Andreas Maier

Meta-learning has recently been an emerging data-efficient learning technique for various medical imaging operations and has helped advance contemporary deep learning models. Furthermore, meta-learning enhances the knowledge generalization…

Image and Video Processing · Electrical Eng. & Systems 2023-07-14 Sriprabha Ramanarayanan , Arun Palla , Keerthi Ram , Mohanasankar Sivaprakasam

Noisy labels can negatively impact the performance of deep neural networks. One common solution is label refurbishment, which involves reconstructing noisy labels through predictions and distributions. However, these methods may introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Wenxiao Fan , Kan Li

Line-of-sight distortions of the cosmic microwave background (CMB), including gravitational lensing, cosmic birefringence, and patchy screening, encode crucial cosmological information. While quadratic estimators (QE) have been excellent…

Cosmology and Nongalactic Astrophysics · Physics 2025-03-06 Omar Darwish

We develop a new method for reconstructing cluster mass profiles and large-scale structure from the cosmic microwave background (CMB). By analyzing the likelihood of CMB lensing, we analytically prove that standard quadratic estimators for…

Astrophysics · Physics 2008-11-26 Jaiyul Yoo , Matias Zaldarriaga

Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jihai Zhang , Xiang Lan , Xiaoye Qu , Yu Cheng , Mengling Feng , Bryan Hooi

Contrastive learning (CL) has shown impressive advances in image representation learning in whichever supervised multi-class classification or unsupervised learning. However, these CL methods fail to be directly adapted to multi-label image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Zhongchen Ma , Lisha Li , Qirong Mao , Songcan Chen

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

The delensing of cosmic microwave background (CMB) maps will be increasingly valuable for extracting as much information as possible from future CMB surveys. Delensing provides many general benefits, including sharpening of the acoustic…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-20 Cynthia Trendafilova , Selim C. Hotinli , Joel Meyers

With a widespread use of digital imaging data in hospitals, the size of medical image repositories is increasing rapidly. This causes difficulty in managing and querying these large databases leading to the need of content based medical…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Adnan Qayyum , Syed Muhammad Anwar , Muhammad Awais , Muhammad Majid

Generic unstructured neural networks have been shown to struggle on out-of-distribution compositional generalization. Compositional data augmentation via example recombination has transferred some prior knowledge about compositionality to…

Computation and Language · Computer Science 2022-05-06 Linlu Qiu , Peter Shaw , Panupong Pasupat , Paweł Krzysztof Nowak , Tal Linzen , Fei Sha , Kristina Toutanova

Deep learning (DL) techniques have had unprecedented success when applied to images, waveforms, and texts to cite a few. In general, when the sample size (N) is much greater than the number of features (d), DL outperforms previous machine…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Thanh Hai Nguyen , Yann Chevaleyre , Edi Prifti , Nataliya Sokolovska , Jean-Daniel Zucker

The next-generation CMB experiments are expected to constrain the tensor-to-scalar ratio $r$ with high precision. Delensing is an important process as the observed CMB $B$-mode polarization that contains the primordial tensor perturbation…

Cosmology and Nongalactic Astrophysics · Physics 2022-10-17 Chen Heinrich , Trey Driskell , Chris Heinrich

Like in many other research fields, recent developments in computational imaging have focused on developing machine learning (ML) approaches to tackle its main challenges. To improve the performance of computational imaging algorithms,…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Maximilian B. Kiss , Ander Biguri , Carola-Bibiane Schönlieb , K. Joost Batenburg , Felix Lucka

Constraint ordering plays a critical role in the efficiency of Mixed-Integer Linear Programming (MILP) solvers, particularly for large-scale problems where poorly ordered constraints trigger increased LP iterations and suboptimal search…

Machine Learning · Computer Science 2025-04-08 Shuli Zeng , Mengjie Zhou , Sijia Zhang , Yixiang Hu , Feng Wu , Xiang-Yang Li

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie