English
Related papers

Related papers: Autoregressive Enzyme Function Prediction with Mul…

200 papers

Understanding and leveraging the 3D structures of proteins is central to a variety of biological and drug discovery tasks. While deep learning has been applied successfully for structure-based protein function prediction tasks, current…

Machine Learning · Computer Science 2024-04-03 Rong Han , Wenbing Huang , Lingxiao Luo , Xinyan Han , Jiaming Shen , Zhiqiang Zhang , Jun Zhou , Ting Chen

Inspired by the masked language modeling (MLM) in natural language processing tasks, the masked image modeling (MIM) has been recognized as a strong self-supervised pre-training method in computer vision. However, the high random mask ratio…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zhaowen Li , Yousong Zhu , Zhiyang Chen , Wei Li , Chaoyang Zhao , Rui Zhao , Ming Tang , Jinqiao Wang

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

Integrating multimodal Electronic Health Records (EHR) data, such as numerical time series and free-text clinical reports, has great potential in predicting clinical outcomes. However, prior work has primarily focused on capturing temporal…

Machine Learning · Computer Science 2025-11-10 Fuying Wang , Feng Wu , Yihan Tang , Lequan Yu

Pedestrian action prediction is of great significance for many applications such as autonomous driving. However, state-of-the-art methods lack explainability to make trustworthy predictions. In this paper, a novel framework called MulCPred…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yan Feng , Alexander Carballo , Keisuke Fujii , Robin Karlsson , Ming Ding , Kazuya Takeda

The widespread adoption of Electronic Health Record (EHR) systems in healthcare institutes has generated vast amounts of medical data, offering significant opportunities for improving healthcare services through deep learning techniques.…

Machine Learning · Computer Science 2024-01-23 Suhan Cui , Jiaqi Wang , Yuan Zhong , Han Liu , Ting Wang , Fenglong Ma

Downsampling images and labels, often necessitated by limited resources or to expedite network training, leads to the loss of small objects and thin boundaries. This undermines the segmentation network's capacity to interpret images…

Image and Video Processing · Electrical Eng. & Systems 2024-10-27 Shahzad Ali , Yu Rim Lee , Soo Young Park , Won Young Tak , Soon Ki Jung

Large Language Models (LLMs) impose massive computational demands, driving the need for scalable multi-chiplet accelerators. However, existing mapping space exploration efforts for such accelerators primarily focus on traditional…

Hardware Architecture · Computer Science 2026-04-02 Boyu Li , Zongwei Zhu , Yi Xiong , Qianyue Cao , Jiawei Geng , Xiaonan Zhang , Xi Li

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu

Accurate identification of protein nucleic-acid-binding residues poses a significant challenge with important implications for various biological processes and drug design. Many typical computational methods for protein analysis rely on a…

Biomolecules · Quantitative Biology 2023-12-21 Linglin Jing , Sheng Xu , Yifan Wang , Yuzhe Zhou , Tao Shen , Zhigang Ji , Hui Fang , Zhen Li , Siqi Sun

Recent advances in Artificial Intelligence have enabled multi-modal systems to model and translate diverse information spaces. Extending beyond text and vision, we introduce OneProt, a multi-modal AI for proteins that integrates structural,…

Alzheimer's disease (AD) is a prevalent and debilitating neurodegenerative disorder impacting a large aging population. Detecting AD in all its presymptomatic and symptomatic stages is crucial for early intervention and treatment. An active…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yasmine Mustafa , Tie Luo

Obtaining high-quality labels is costly, whereas unlabeled covariates are often abundant, motivating semi-supervised inference methods with reliable uncertainty quantification. Prediction-powered inference (PPI) leverages a machine-learning…

Machine Learning · Statistics 2026-05-29 Se Yoon Lee , Jae Kwang Kim

With the development of fast and massively parallel evaluations in many domains, Quality-Diversity (QD) algorithms, that already proved promising in a large range of applications, have seen their potential multiplied. However, we have yet…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Manon Flageat , Bryan Lim , Antoine Cully

The growing impact of global climate change amplifies the need for accurate and reliable weather forecasting. Traditional autoregressive approaches, while effective for temporal modeling, suffer from error accumulation in long-term…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Doyi Kim , Minseok Seo , Hakjin Lee , Junghoon Seo

Recipe recommendation has become an essential task in web-based food platforms. A central challenge is effectively leveraging rich multimodal features beyond user-recipe interactions. Our analysis shows that even simple uses of multimodal…

Machine Learning · Computer Science 2026-04-23 Jeeho Shin , Kyungho Kim , Kijung Shin

Molecular property calculations are the bedrock of chemical physics. High-fidelity \textit{ab initio} modeling techniques for computing the molecular properties can be prohibitively expensive, and motivate the development of…

Machine Learning · Computer Science 2022-11-28 Hatem Helal , Jesun Firoz , Jenna Bilbrey , Mario Michael Krell , Tom Murray , Ang Li , Sotiris Xantheas , Sutanay Choudhury

Intrinsically disordered regions of proteins play a crucial role in cell signaling and drug discovery. However, their high structural flexibility makes accurate residue-level prediction challenging. Existing methods often rely on…

Neural and Evolutionary Computing · Computer Science 2026-03-09 Shaokuan Wang , Pengshan Cui , Yining Qian , An-Yang Lu , Xianpeng Wang

While DeepMind has tentatively solved protein folding, its inverse problem -- protein design which predicts protein sequences from their 3D structures -- still faces significant challenges. Particularly, the lack of large-scale standardized…

Quantitative Methods · Quantitative Biology 2022-02-15 Zhangyang Gao , Cheng Tan , Stan Z. Li

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim