English
Related papers

Related papers: One Framework to Rule Them All: Unifying Multimoda…

200 papers

Multimodal Large Models (MLMs) are becoming a significant research focus, combining powerful large language models with multimodal learning to perform complex tasks across different data modalities. This review explores the latest…

Machine Learning · Computer Science 2024-07-02 Xinji Mai , Zeng Tao , Junxiong Lin , Haoran Wang , Yang Chang , Yanlan Kang , Yan Wang , Wenqiang Zhang

Financial institutions and regulators require systems that integrate heterogeneous data to assess risks from stock fluctuations to systemic vulnerabilities. Existing approaches often treat these tasks in isolation, failing to capture…

Machine Learning · Computer Science 2026-01-07 Gongao Zhang , Haijiang Zeng , Lu Jiang

Developing a universal model that can effectively harness heterogeneous resources and respond to a wide range of personalized needs has been a longstanding community aspiration. Our daily choices, especially in domains like fashion and…

Information Retrieval · Computer Science 2024-03-29 Tianxin Wei , Bowen Jin , Ruirui Li , Hansi Zeng , Zhengyang Wang , Jianhui Sun , Qingyu Yin , Hanqing Lu , Suhang Wang , Jingrui He , Xianfeng Tang

With the powerful reasoning capabilities of large language models (LLMs) and vision-language models (VLMs), many recent works have explored using them for decision-making. However, most of these approaches rely solely on language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yihao Sun , Zhilong Zhang , Yang Yu , Pierre-Luc Bacon

Recently using machine learning (ML) based techniques to optimize modern database management systems has attracted intensive interest from both industry and academia. With an objective to tune a specific component of a DBMS (e.g., index…

Databases · Computer Science 2023-03-13 Xinyi Zhang , Zhuo Chang , Hong Wu , Yang Li , Jia Chen , Jian Tan , Feifei Li , Bin Cui

Tabular Foundation Models have recently established the state of the art in supervised tabular learning, by leveraging pretraining to learn generalizable representations of numerical and categorical structured data. However, they lack…

In an era defined by the explosive growth of data and rapid technological advancements, Multimodal Large Language Models (MLLMs) stand at the forefront of artificial intelligence (AI) systems. Designed to seamlessly integrate diverse data…

The recent advances in neural language models have also been successfully applied to the field of chemistry, offering generative solutions for classical problems in molecular design and synthesis planning. These new methods have the…

Machine Learning · Computer Science 2023-05-19 Dimitrios Christofidellis , Giorgio Giannone , Jannis Born , Ole Winther , Teodoro Laino , Matteo Manica

We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models. To address these challenges, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Weihao Xia , Raoul de Charette , Cengiz Öztireli , Jing-Hao Xue

Multi-modality fusion and multi-task learning are becoming trendy in 3D autonomous driving scenario, considering robust prediction and computation budget. However, naively extending the existing framework to the domain of multi-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zhijian Huang , Sihao Lin , Guiyu Liu , Mukun Luo , Chaoqiang Ye , Hang Xu , Xiaojun Chang , Xiaodan Liang

As large-scale pre-trained foundation models continue to expand in size and capability, efficiently adapting them to specific downstream tasks has become increasingly critical. Despite substantial progress, existing adaptation approaches…

Machine Learning · Computer Science 2025-10-21 Zesheng Ye , Chengyi Cai , Ruijiang Dong , Jianzhong Qi , Lei Feng , Pin-Yu Chen , Feng Liu

Modeling the interplay between external stimuli and internal neural representations is a pivotal research area for Brain-Computer Interfaces (BCIs). A major limitation of prior work is the prevailing paradigm of specialized, single-task…

Artificial Intelligence · Computer Science 2026-05-29 Yizhuo Lu , Changde Du , Qingyu Shi , Hang Chen , Jie Peng , Liuyun Jiang , Shuangchen Zhao , Huiguang He

Multi-modal Large Language Model (MLLM) refers to a model expanded from a Large Language Model (LLM) that possesses the capability to handle and infer multi-modal data. Current MLLMs typically begin by using LLMs to decompose tasks into…

Computation and Language · Computer Science 2023-09-01 Yongqiang Zhao , Zhenyu Li , Feng Zhang , Xinhai Xu , Donghong Liu

Currently, enhancing Unified Multimodal Models (UMMs) with image understanding, generation, and editing capabilities mainly relies on mixed multi-task training. Due to inherent task conflicts, such strategy requires complex multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Dian Zheng , Manyuan Zhang , Hongyu Li , Hongbo Liu , Kai Zou , Kaituo Feng , Hongsheng Li

Foundation models update slowly due to resource-intensive training, whereas domain-specific models evolve rapidly between releases. Model merging seeks to combine multiple expert models into a single, more capable model, reducing storage…

Artificial Intelligence · Computer Science 2026-03-04 Yongxian Wei , Runxi Cheng , Weike Jin , Enneng Yang , Li Shen , Lu Hou , Sinan Du , Chun Yuan , Xiaochun Cao , Dacheng Tao

The pervasive deployment of Large Language Models-LLMs in various sectors often neglects the nuanced requirements of individuals and small organizations, who benefit more from models precisely tailored to their specific business contexts…

Computation and Language · Computer Science 2024-07-10 Jiaxi Cui , Wentao Zhang , Jing Tang , Xudong Tong , Zhenwei Zhang , Amie , Jing Wen , Rongsheng Wang , Pengfei Wu

Existing neural machine translation (NMT) studies mainly focus on developing dataset-specific models based on data from different tasks (e.g., document translation and chat translation). Although the dataset-specific models have achieved…

Computation and Language · Computer Science 2023-05-19 Yunlong Liang , Fandong Meng , Jinan Xu , Jiaan Wang , Yufeng Chen , Jie Zhou

The workflow of pretraining and fine-tuning has emerged as a popular paradigm for solving various NLP and V&L (Vision-and-Language) downstream tasks. With the capacity of pretrained models growing rapidly, how to perform parameter-efficient…

Computation and Language · Computer Science 2022-03-09 Zhengkun Zhang , Wenya Guo , Xiaojun Meng , Yasheng Wang , Yadao Wang , Xin Jiang , Qun Liu , Zhenglu Yang

State-of-the-art studies have demonstrated the superiority of joint modelling over pipeline implementation for medical named entity recognition and normalization due to the mutual benefits between the two processes. To exploit these…

Computation and Language · Computer Science 2018-12-17 Sendong Zhao , Ting Liu , Sicheng Zhao , Fei Wang

Large Language Models (LLMs) have shown great potential in intelligent visualization systems, especially for domain-specific applications. Integrating LLMs into visualization systems presents challenges, and we categorize these challenges…

Human-Computer Interaction · Computer Science 2024-07-31 Lin Gao , Jing Lu , Zekai Shao , Ziyue Lin , Shengbin Yue , Chiokit Ieong , Yi Sun , Rory James Zauner , Zhongyu Wei , Siming Chen