English
Related papers

Related papers: Exploring Optimal Transport-Based Multi-Grained Al…

200 papers

Short text clustering has gained significant attention in the data mining community. However, the limited valuable information contained in short texts often leads to low-discriminative representations, increasing the difficulty of…

Machine Learning · Computer Science 2026-03-16 Zhihao Yao

Meta learning with multiple objectives can be formulated as a Multi-Objective Bi-Level optimization Problem (MOBLP) where the upper-level subproblem is to solve several possible conflicting targets for the meta learner. However, existing…

Machine Learning · Computer Science 2021-02-16 Feiyang Ye , Baijiong Lin , Zhixiong Yue , Pengxin Guo , Qiao Xiao , Yu Zhang

Molecular representation learning is a crucial task in predicting molecular properties. Molecules are often modeled as graphs where atoms and chemical bonds are represented as nodes and edges, respectively, and Graph Neural Networks (GNNs)…

Machine Learning · Computer Science 2023-05-23 Jiahao Chen , Yurou Liu , Jiangmeng Li , Bing Su , Jirong Wen

Integrating large language model (LLM) representations into multimodal recommendation has shown promise, yet a fundamental challenge remains largely overlooked: the semantic heterogeneity between generative LM representations and the…

Information Retrieval · Computer Science 2026-05-26 Yuecheng Li , Hengwei Ju , Zeyu Song , Wei Yang , Chi Lu , Peng Jiang , Kun Gai

The recent advancement of pre-trained Transformer models has propelled the development of effective text mining models across various biomedical tasks. However, these models are primarily learned on the textual data and often lack the…

Computation and Language · Computer Science 2021-07-02 Sriram Pingali , Shweta Yadav , Pratik Dutta , Sriparna Saha

Due to the wide range of timescales that are present in macromolecular systems, hierarchical multiscale strategies are necessary for their computational study. Coarse-graining (CG) allows to establish a link between different system…

While OCR has been used in various applications, its output is not always accurate, leading to misfit words. This research work focuses on improving the optical character recognition (OCR) with ML techniques with integration of OCR with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Abhishek Bamotra , Phani Krishna Uppala

Recent advancements in large language models have opened new possibilities for generative molecular drug design. We present Chemlactica and Chemma, two language models fine-tuned on a novel corpus of 110M molecules with computed properties,…

Learning medical visual representations directly from paired radiology reports has become an emerging topic in representation learning. However, existing medical image-text joint learning methods are limited by instance or local supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Fuying Wang , Yuyin Zhou , Shujun Wang , Varut Vardhanabhuti , Lequan Yu

Human expertise in chemistry and biomedicine relies on contextual molecular understanding, a capability that large language models (LLMs) can extend through fine-grained alignment between molecular structures and text. Recent multimodal…

Computation and Language · Computer Science 2025-03-10 Sumin Ha , Jun Hyeong Kim , Yinhua Piao , Sun Kim

Integrating multi-omics data, such as DNA methylation, mRNA expression, and microRNA (miRNA) expression, offers a comprehensive view of the biological mechanisms underlying disease. However, the high dimensionality of multi-omics data, the…

Machine Learning · Computer Science 2026-02-12 Tiantian Yang , Zhiqian Chen

While Large Language Models (LLMs) have shown exceptional generalization capabilities, their ability to process graph data, such as molecular structures, remains limited. To bridge this gap, this paper proposes Graph2Token, an efficient…

Machine Learning · Computer Science 2025-03-11 Runze Wang , Mingqi Yang , Yanming Shen

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. In this paper, we introduce a novel approach called class-aware optimal transport (OT), which measures the OT…

Machine Learning · Computer Science 2024-01-30 Tuan Nguyen , Van Nguyen , Trung Le , He Zhao , Quan Hung Tran , Dinh Phung

Medical object detection suffers when a single detector is trained on mixed medical modalities (e.g., CXR, CT, MRI) due to heterogeneous statistics and disjoint representation spaces. To address this challenge, we turn to representation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Ara Seo , Bryan Sangwoo Kim , Hyungjin Chung , Jong Chul Ye

Multimodal Large Language Models (MLLMs) have shown impressive results on various multimodal tasks. However, most existing MLLMs are not well suited for document-oriented tasks, which require fine-grained image perception and information…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ya-Qi Yu , Minghui Liao , Jihao Wu , Yongxin Liao , Xiaoyu Zheng , Wei Zeng

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Cross-modal text-molecule retrieval task bridges molecule structures and natural language descriptions. Existing methods predominantly focus on aligning text modality and molecule modality, yet they overlook adaptively adjusting the…

Computation and Language · Computer Science 2025-02-18 Hongyan Wu , Peijian Zeng , Weixiong Zheng , Lianxi Wang , Nankai Lin , Shengyi Jiang , Aimin Yang

Training data attribution (TDA) methods ask which training documents are responsible for a model behavior. However, models often learn broad concepts shared across many examples. Moreover, existing TDA methods are supervised -- they require…

Artificial Intelligence · Computer Science 2026-03-18 J Rosser

Recently, the impressive performance of large language models (LLMs) on a wide range of tasks has attracted an increasing number of attempts to apply LLMs in drug discovery. However, molecule optimization, a critical task in the drug…

Quantitative Methods · Quantitative Biology 2024-01-22 Geyan Ye , Xibao Cai , Houtim Lai , Xing Wang , Junhong Huang , Longyue Wang , Wei Liu , Xiangxiang Zeng

With the increasing attention to large vision-language models such as CLIP, there has been a significant amount of effort dedicated to building efficient prompts. Unlike conventional methods of only learning one single prompt, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Guangyi Chen , Weiran Yao , Xiangchen Song , Xinyue Li , Yongming Rao , Kun Zhang