English
Related papers

Related papers: Multi-modal Summarization in Model-Based Engineeri…

200 papers

The development of Machine Learning (ML) based systems is complex and requires multidisciplinary teams with diverse skill sets. This may lead to communication issues or misapplication of best practices. Process models can alleviate these…

Software Engineering · Computer Science 2024-08-29 Sergio Morales , Robert Clarisó , Jordi Cabot

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Computation and Language · Computer Science 2025-12-09 Ming Li , Keyu Chen , Ziqian Bi , Ming Liu , Xinyuan Song , Zekun Jiang , Tianyang Wang , Benji Peng , Qian Niu , Junyu Liu , Jinlang Wang , Sen Zhang , Xuanhe Pan , Jiawei Xu , Pohsun Feng

Upon the significant performance of the supervised deep neural networks, conventional procedures of developing ML system are \textit{task-centric}, which aims to maximize the task accuracy. However, we scrutinized this \textit{task-centric}…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Kyung Ho Park , Hyunhee Chung , Soonwoo Kwon

Materials science datasets are inherently heterogeneous and are available in different modalities such as characterization spectra, atomic structures, microscopic images, and text-based synthesis conditions. The advancements in multi-modal…

Machine Learning · Computer Science 2024-11-14 Janghoon Ock , Joseph Montoya , Daniel Schweigert , Linda Hung , Santosh K. Suram , Weike Ye

Multiword expressions (MWEs) are composed of multiple words and exhibit variable degrees of compositionality. As such, their meanings are notoriously difficult to model, and it is unclear to what extent this issue affects transformer…

Computation and Language · Computer Science 2024-01-30 Filip Miletić , Sabine Schulte im Walde

The specification of requirements and tests are crucial activities in automotive development projects. However, due to the increasing complexity of automotive systems, practitioners fail to specify requirements and tests for distributed and…

Speech summarization is a critical component of spoken content understanding, particularly in the era of rapidly growing spoken and audiovisual data. Recent advances in multi-modal large language models (MLLMs), leveraging the power of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Shaoshi Ling , Gang Liu , Guoli Ye , Jinyu Li

Model merging combines the parameters of multiple neural networks into a single model without additional training. As fine-tuned large language models (LLMs) proliferate, merging offers a computationally efficient alternative to ensembles…

Computation and Language · Computer Science 2026-03-31 Mingyang Song , Mao Zheng

This paper studies the best practices for automatic machine learning (AutoML). While previous AutoML efforts have predominantly focused on unimodal data, the multimodal aspect remains under-explored. Our study delves into classification and…

Machine Learning · Computer Science 2024-12-24 Zhiqiang Tang , Zihan Zhong , Tong He , Gerald Friedland

Software reuse has long been recognized as a critical and widely studied topic in software engineering, offering substantial benefits in reducing development costs, improving software quality, and enhancing operational efficiency. This…

Software Engineering · Computer Science 2026-02-02 You Lu , Jiyang Zhang , Bihuan Chen , Chaofeng Sha , Dingji Wang , Xin Peng

Decision-making is a core engineering design activity that conveys the engineer's knowledge and translates it into courses of action. Capturing this form of knowledge can reap potential benefits for the engineering teams and enhance…

Software Engineering · Computer Science 2026-01-13 Nidhal Selmi , Jean-michel Bruel , Sébastien Mosser , Matthieu Crespo , Alain Kerbrat

Foundation models have indeed made a profound impact on various fields, emerging as pivotal components that significantly shape the capabilities of intelligent systems. In the context of intelligent vehicles, leveraging the power of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sheng Luo , Wei Chen , Wanxin Tian , Rui Liu , Luanxuan Hou , Xiubao Zhang , Haifeng Shen , Ruiqi Wu , Shuyi Geng , Yi Zhou , Ling Shao , Yi Yang , Bojun Gao , Qun Li , Guobin Wu

Multimodal models are expected to be a critical component to future advances in artificial intelligence. This field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural…

Computation and Language · Computer Science 2024-06-11 Sai Munikoti , Ian Stewart , Sameera Horawalavithana , Henry Kvinge , Tegan Emerson , Sandra E Thompson , Karl Pazdernik

This paper delves into the intricacies of code summarization using advanced transformer-based language models. Through empirical studies, we evaluate the efficacy of code summarization by altering function and variable names to explore…

Machine Learning · Computer Science 2023-10-30 Debanjan Mondal , Abhilasha Lodha , Ankita Sahoo , Beena Kumari

Model-driven engineering (MDE) simplifies software development through abstraction, yet challenges such as time constraints, incomplete domain understanding, and adherence to syntactic constraints hinder the design process. This paper…

Software Engineering · Computer Science 2024-10-17 Meriem Ben Chaaben , Lola Burgueño , Istvan David , Houari Sahraoui

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

In the past year, Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance in tasks such as visual question answering, visual understanding and reasoning. However, the extensive model size and high training and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yizhang Jin , Jian Li , Yexin Liu , Tianjun Gu , Kai Wu , Zhengkai Jiang , Muyang He , Bo Zhao , Xin Tan , Zhenye Gan , Yabiao Wang , Chengjie Wang , Lizhuang Ma

Multimodal Large Language Models (MLLMs) have become increasingly important due to their state-of-the-art performance and ability to integrate multiple data modalities, such as text, images, and audio, to perform complex tasks with high…

Blended modeling is an emerging paradigm involving seamless interaction between multiple notations for the same underlying modeling language. We focus on a model-driven engineering (MDE) approach based on meta-models to develop textual…

Software Engineering · Computer Science 2024-01-31 Weixing Zhang

Machine learning (ML) components are being added to more and more critical and impactful software systems, but the software development process of real-world production systems from prototyped ML models remains challenging with additional…

Software Engineering · Computer Science 2024-05-07 Jie JW Wu