中文
相关论文

相关论文: An Optimization Algorithm for Multimodal Data Alig…

200 篇论文

Large Language Models (LLMs) require frequent updates to correct errors and keep pace with continuously evolving knowledge in a timely and effective manner. Recent research in it model editing has highlighted the challenges in balancing…

机器学习 · 计算机科学 2024-10-02 Tai D. Nguyen , Long H. Pham , Jun Sun

We study data curation for multimodal reasoning through the NeurIPS 2025 Data Curation for Vision-Language Reasoning (DCVLR) challenge, which isolates dataset selection by fixing the model and training protocol. Using a compact curated…

人工智能 · 计算机科学 2026-01-19 Yosub Shin , Michael Buriek , Boris Sobolev , Pavel Bushuyeu , Vikas Kumar , Haoyang Xu , Samuel Watson , Igor Molybog

We propose a framework for adaptive data-centric collaborative machine learning among self-interested agents, coordinated by an arbiter. Designed to handle the incremental nature of real-world data, the framework operates in an online…

机器学习 · 计算机科学 2025-02-07 Nithia Vijayan , Bryan Kian Hsiang Low

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

Recent advancement in code understanding and generation demonstrates that code LLMs fine-tuned on a high-quality instruction dataset can gain powerful capabilities to address wide-ranging code-related tasks. However, most previous existing…

Solving different types of optimization models (including parameters fitting) for support vector machines on large-scale training data is often an expensive computational task. This paper proposes a multilevel algorithmic framework that…

机器学习 · 统计学 2014-10-14 Talayeh Razzaghi , Ilya Safro

Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Building fully omni-capable models that can integrate text,…

人工智能 · 计算机科学 2025-11-06 Huawei Lin , Yunzhi Shi , Tong Geng , Weijie Zhao , Wei Wang , Ravender Pal Singh

Multimodal Large Language Models (MLLMs) have achieved success across various domains. However, their applicability tends to degrade when confronted with different types of data inputs, especially for MLLMs that have been fine-tuned for…

计算与语言 · 计算机科学 2025-07-02 Yang Dai , Jianxiang An , Tianwei Lin , Hongyang He , Hongzhe Huang , Wenqiao Zhang , Zheqi Lv , Siliang Tang , Yueting Zhuang

Multimodal data arise in various applications where information about the same phenomenon is acquired from multiple sensors and across different imaging modalities. Learning from multimodal data is of great interest in machine learning and…

机器学习 · 统计学 2022-01-20 Li Peide , Seyyid Emre Sofuoglu , Tapabrata Maiti , Selin Aviyente

Large Language Model (LLM) agents have shown great potential in addressing real-world data science problems. LLM-driven data science agents promise to automate the entire machine learning pipeline, yet their real-world effectiveness remains…

Value-alignment in normative multi-agent systems is used to promote a certain value and to ensure the consistent behavior of agents in autonomous intelligent systems with human values. However, the current literature is limited to…

多智能体系统 · 计算机科学 2023-05-15 Maha Riad , Vinicius Renan de Carvalho , Fatemeh Golpayegani

Multimodal learning aims to capture both shared and private information from multiple modalities. However, existing methods that project all modalities into a single latent space for fusion often overlook the asynchronous, multi-level…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Chunlei Meng , Guanhong Huang , Rong Fu , Runmin Jian , Zhongxue Gan , Chun Ouyang

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

人工智能 · 计算机科学 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

The cross-media retrieval problem has received much attention in recent years due to the rapid increasing of multimedia data on the Internet. A new approach to the problem has been raised which intends to match features of different…

多媒体 · 计算机科学 2015-12-18 Cuicui Kang , Shengcai Liao , Yonghao He , Jian Wang , Wenjia Niu , Shiming Xiang , Chunhong Pan

Large-scale multi-relational embedding refers to the task of learning the latent representations for entities and relations in large knowledge graphs. An effective and scalable solution for this problem is crucial for the true success of…

机器学习 · 计算机科学 2017-07-07 Hanxiao Liu , Yuexin Wu , Yiming Yang

Although numerous strategies have recently been proposed to enhance the autonomous interaction capabilities of multimodal agents in graphical user interface (GUI), their reliability remains limited when faced with complex or out-of-domain…

计算与语言 · 计算机科学 2025-10-06 Pengzhou Cheng , Lingzhong Dong , Zeng Wu , Zongru Wu , Xiangru Tang , Chengwei Qin , Zhuosheng Zhang , Gongshen Liu

Recently, large language models (LLMs) have notably positioned them as capable tools for addressing complex optimization challenges. Despite this recognition, a predominant limitation of existing LLM-based optimization methods is their…

人工智能 · 计算机科学 2024-03-05 Yuxiao Huang , Wenjie Zhang , Liang Feng , Xingyu Wu , Kay Chen Tan

Imitation learning (IL) provides a data-driven framework for approximating policies for large-scale combinatorial optimisation problems formulated as sequential decision problems (SDPs), where exact solution methods are computationally…

机器学习 · 计算机科学 2026-04-13 Prakash Gawas , Antoine Legrain , Louis-Martin Rousseau

Evolutionary algorithms face significant challenges when dealing with dynamic multi-objective optimization because Pareto optimal solutions and/or Pareto optimal fronts change. This paper proposes a unified paradigm, which combines the…

神经与进化计算 · 计算机科学 2023-12-05 Zhanglu Hou , Juan Zou , Gan Ruan , Yuan Liu , Yizhang Xia

Multimodal Large Language Models (MLLMs) are widely regarded as crucial in the exploration of Artificial General Intelligence (AGI). The core of MLLMs lies in their capability to achieve cross-modal alignment. To attain this goal, current…

计算与语言 · 计算机科学 2024-11-26 Fei Zhao , Taotian Pang , Chunhui Li , Zhen Wu , Junjie Guo , Shangyu Xing , Xinyu Dai