English
Related papers

Related papers: MicroVerse: A Preliminary Exploration Toward a Mic…

200 papers

The realization of autonomous scientific experimentation is currently limited by LLMs' struggle to grasp the strict procedural logic and accuracy required by biological protocols. To address this fundamental challenge, we present…

Computation and Language · Computer Science 2026-01-22 Yuyang Liu , Liuzhenghao Lv , Xiancheng Zhang , Jingya Wang Li Yuan , Yonghong Tian

Vertebral labelling and segmentation are two fundamental tasks in an automated spine processing pipeline. Reliable and accurate processing of spine images is expected to benefit clinical decision-support systems for diagnosis, surgery…

As Vision-Language Models (VLMs) increasingly gain traction in medical applications, clinicians are progressively expecting AI systems not only to generate textual diagnoses but also to produce corresponding medical images that integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Junjie Yang , Yuhao Yan , Gang Wu , Yuxuan Wang , Ruoyu Liang , Xinjie Jiang , Xiang Wan , Fenglei Fan , Yongquan Zhang , Feiwei Qin , Changmiao Wang

Virtual cell modeling aims to predict cellular responses to perturbations. Existing virtual cell models rely heavily on large-scale single-cell datasets, learning explicit mappings between gene expression and perturbations. Although recent…

Cell Behavior · Quantitative Biology 2026-03-02 Zhijian Wei , Runze Ma , Zichen Wang , Zhongmin Li , Shuotong Song , Shuangjia Zheng

ImageNet-1K linear-probe transfer accuracy remains the default proxy for visual representation quality, yet it no longer predicts performance on scientific imagery. Across 46 modern vision model checkpoints, ImageNet top-1 accuracy explains…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Samuel Stevens

Open-weight bio-foundation models present a dual-use dilemma. While holding great promise for accelerating scientific research and drug development, they could also enable bad actors to develop more deadly bioweapons. To mitigate the risk…

Biomedical data is inherently multimodal, consisting of electronic health records, medical imaging, digital pathology, genome sequencing, wearable sensors, and more. The application of artificial intelligence tools to these multifaceted…

Machine Learning · Computer Science 2024-08-26 Shentong Mo , Paul Pu Liang

We propose a new microscopy simulation system that can depict atomistic models in a micrograph visual style, similar to results of physical electron microscopy imaging. This system is scalable, able to represent simulation of electron…

Quantitative Methods · Quantitative Biology 2026-03-27 Ngan Nguyen , Feng Liang , Dominik Engel , Ciril Bohak , Peter Wonka , Timo Ropinski , Ivan Viola

Current video benchmarks for multimodal large language models (MLLMs) focus on event recognition, temporal ordering, and long-context recall, but overlook a harder capability required for expert procedural judgment: tracking how ongoing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Xiyang Huang , Jiawei Lin , Keying Wu , Jiaxin Huang , Kailai Yang , Renxiong Wei , Cheng zeng , Jiayi Xiang , Ziyan Kuang , Min Peng , Qianqian Xie , Sophia Ananiadou

Recent advances in unified multimodal models (UMMs) have enabled impressive progress in visual comprehension and generation. However, existing datasets and benchmarks focus primarily on single-turn interactions, failing to capture the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Wei Chow , Jiachun Pan , Yongyuan Liang , Mingze Zhou , Xue Song , Liyu Jia , Saining Zhang , Siliang Tang , Juncheng Li , Fengda Zhang , Weijia Wu , Hanwang Zhang , Tat-Seng Chua

Learned representations of scientific documents can serve as valuable input features for downstream tasks without further fine-tuning. However, existing benchmarks for evaluating these representations fail to capture the diversity of…

Computation and Language · Computer Science 2023-11-14 Amanpreet Singh , Mike D'Arcy , Arman Cohan , Doug Downey , Sergey Feldman

Recent breakthroughs in large multimodal models (LMMs), such as the impressive GPT-4o-Native, have demonstrated remarkable proficiency in following general-purpose instructions for image generation. However, current benchmarks often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jiayu Wang , Yang Jiao , Yue Yu , Tianwen Qian , Shaoxiang Chen , Jingjing Chen , Yu-Gang Jiang

Recent studies have demonstrated the feasibility of modeling single-cell data as natural languages and the potential of leveraging powerful large language models (LLMs) for understanding cell biology. However, a comprehensive evaluation of…

Quantitative Methods · Quantitative Biology 2025-05-14 Fan Zhang , Tianyu Liu , Zhihong Zhu , Hao Wu , Haixin Wang , Donghao Zhou , Yefeng Zheng , Kun Wang , Xian Wu , Pheng-Ann Heng

Recent advances in internet-scale video data pretraining have led to the development of text-to-video generative models that can create high-quality videos across a broad range of visual concepts, synthesize realistic motions and render…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Hritik Bansal , Zongyu Lin , Tianyi Xie , Zeshun Zong , Michal Yarom , Yonatan Bitton , Chenfanfu Jiang , Yizhou Sun , Kai-Wei Chang , Aditya Grover

In this paper, we propose NeoVerse, a versatile 4D world model that is capable of 4D reconstruction, novel-trajectory video generation, and rich downstream applications. We first identify a common limitation of scalability in current 4D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuxue Yang , Lue Fan , Ziqi Shi , Junran Peng , Feng Wang , Zhaoxiang Zhang

Understanding and modeling human mobility patterns is crucial for effective transportation planning and urban development. Despite significant advances in mobility research, there remains a critical gap in simulation platforms that allow…

Artificial Intelligence · Computer Science 2025-06-30 Yifan Liu , Xishun Liao , Haoxuan Ma , Jonathan Liu , Rohan Jadhav , Jiaqi Ma

Surgical video understanding is pivotal for enabling automated intraoperative decision-making, skill assessment, and postoperative quality improvement. However, progress in developing surgical video foundation models (FMs) remains hindered…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jianhui Wei , Zikai Xiao , Danyu Sun , Luqi Gong , Zongxin Yang , Zuozhu Liu , Jian Wu

Multi Scenario Recommendation (MSR) tasks, referring to building a unified model to enhance performance across all recommendation scenarios, have recently gained much attention. However, current research in MSR faces two significant…

Information Retrieval · Computer Science 2025-10-14 Xiaopeng Li , Jingtong Gao , Pengyue Jia , Xiangyu Zhao , Yichao Wang , Wanyu Wang , Yejing Wang , Yuhao Wang , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

Medical Visual Question Answering (Med-VQA) is a very important task in healthcare industry, which answers a natural language question with a medical image. Existing VQA techniques in information systems can be directly applied to solving…

Artificial Intelligence · Computer Science 2023-12-14 Xiaojie Hong , Zixin Song , Liangzhi Li , Xiaoli Wang , Feiyan Liu

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu