English
Related papers

Related papers: Attention-aware contrastive learning for predictin…

200 papers

Deep neural networks have achieved strong performance in genomic sequence classification; however, relating their predictions to biologically meaningful sequence patterns remains challenging. In this work, we present AttnGen, an…

Machine Learning · Computer Science 2026-05-15 Rayhaneh Shabani Nia , Ali Karkehabadi

Accurate identification of drug-target interactions (DTI) remains a central challenge in computational pharmacology, where sequence-based methods offer scalability. This work introduces a sequence-based drug-target interaction framework…

Recently, dense contrastive learning has shown superior performance on dense prediction tasks compared to instance-level contrastive learning. Despite its supremacy, the properties of dense contrastive representations have not yet been…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Jong Hak Moon , Wonjae Kim , Edward Choi

Learning decent representations from unlabeled time-series data with temporal dynamics is a very challenging task. In this paper, we propose an unsupervised Time-Series representation learning framework via Temporal and Contextual…

Machine Learning · Computer Science 2021-06-29 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee Keong Kwoh , Xiaoli Li , Cuntai Guan

A new trend uses LLMs as dense text encoders via contrastive learning. However, since LLM embeddings predict the probability distribution of the next token, they are inherently generative and distributive, conflicting with contrastive…

Computation and Language · Computer Science 2025-10-17 Jingcheng Deng , Zhongtao Jiang , Liang Pang , Liwei Chen , Kun Xu , Zihao Wei , Huawei Shen , Xueqi Cheng

Contrastive learning, relying on effective positive and negative sample pairs, is beneficial to learn informative skeleton representations in unsupervised skeleton-based action recognition. To achieve these positive and negative pairs,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Binqian Xu , Xiangbo Shu , Jiachao Zhang , Rui Yan , Guo-Sen Xie

Understanding the structure of the human T-cell receptor repertoire is a crucial precondition to understand the ability of the immune system to recognize and respond to antigens. T-cells are often compared via the complementarity…

Molecular Networks · Quantitative Biology 2021-12-14 Paul Richter

The self-supervised pretraining paradigm has achieved great success in skeleton-based action recognition. However, these methods treat the motion and static parts equally, and lack an adaptive design for different parts, which has a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Lilang Lin , Jiahang Zhang , Jiaying Liu

Test-time adaptation aims to adapt pre-trained deep neural networks using solely online unlabelled test data during inference. Although TTA has shown promise in visual applications, its potential in time series contexts remains largely…

Machine Learning · Computer Science 2025-01-06 Peiliang Gong , Mohamed Ragab , Min Wu , Zhenghua Chen , Yongyi Su , Xiaoli Li , Daoqiang Zhang

Pathological complete response (pCR) is a key prognostic factor in breast cancer patients undergoing neoadjuvant therapy, strongly associated with long-term survival and treatment personalization. However, accurate pre-treatment pCR…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Alice Natalina Caragliano , Valerio Guarrasi , Michela Gravina , Carlo Sansone , Paolo Soda

Cancer is a complex disease characterized by uncontrolled cell growth. T cell receptors (TCRs), crucial proteins in the immune system, play a key role in recognizing antigens, including those associated with cancer. Recent advancements in…

Machine Learning · Computer Science 2025-06-12 Taslim Murad , Prakash Chourasia , Sarwan Ali , Imdad Ullah Khan , Murray Patterson

Peptide sequencing-the process of identifying amino acid sequences from mass spectrometry data-is a fundamental task in proteomics. Non-Autoregressive Transformers (NATs) have proven highly effective for this task, outperforming traditional…

Biomolecules · Quantitative Biology 2025-06-17 Xiang Zhang , Jiaqi Wei , Zijie Qiu , Sheng Xu , Nanqing Dong , Zhiqiang Gao , Siqi Sun

Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Junxuan Huang , Yatong An , Lu cheng , Bai Chen , Junsong Yuan , Chunming Qiao

Despite groundbreaking success in image and text learning, deep learning has not achieved significant improvements against traditional machine learning (ML) when it comes to tabular data. This performance gap underscores the need for…

Machine Learning · Computer Science 2024-01-10 Shourav B. Rabbani , Ivan V. Medri , Manar D. Samad

In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method for learning region-level feature representation for dense prediction tasks. Our method is motivated by the three…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Qiushan Guo , Yizhou Yu , Yi Jiang , Jiannan Wu , Zehuan Yuan , Ping Luo

Information extraction from semi-structured webpages provides valuable long-tailed facts for augmenting knowledge graph. Relational Web tables are a critical component containing additional entities and attributes of rich and diverse…

Information Retrieval · Computer Science 2021-02-19 Daheng Wang , Prashant Shiralkar , Colin Lockard , Binxuan Huang , Xin Luna Dong , Meng Jiang

Partially-supervised instance segmentation is a task which requests segmenting objects from novel unseen categories via learning on limited seen categories with annotated masks thus eliminating demands of heavy annotation burden. The key to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Xuehui Wang , Kai Zhao , Ruixin Zhang , Shouhong Ding , Yan Wang , Wei Shen

Time series classification (TSC) is an important task in time series analysis. Existing TSC methods mainly train on each single domain separately, suffering from a degradation in accuracy when the samples for training are insufficient in…

Machine Learning · Computer Science 2025-04-15 Yuxuan Chen , Shanshan Huang , Yunyao Cheng , Peng Chen , Zhongwen Rao , Yang Shu , Bin Yang , Lujia Pan , Chenjuan Guo

Unsupervised cell type identification is crucial for uncovering and characterizing heterogeneous populations in single cell omics studies. Although a range of clustering methods have been developed, most focus exclusively on intrinsic…

Artificial Intelligence · Computer Science 2025-12-12 Liang Peng , Haopeng Liu , Yixuan Ye , Cheng Liu , Wenjun Shen , Si Wu , Hau-San Wong

T cells form intriguing patterns during adhesion to antigen-presenting cells. The patterns at the cell-cell contact zone are composed of two types of domains, which either contain short TCR/MHCp receptor-ligand complexes or the longer…

Subcellular Processes · Quantitative Biology 2009-11-10 Thomas R. Weikl , Reinhard Lipowsky