English
Related papers

Related papers: Multi-modal Summarization in Model-Based Engineeri…

200 papers

In the systems and software modeling field, a conceptual model involves modeling with concepts to support development and design. An example of a conceptual model is a description developed using the Unified Modeling Language (UML). UML…

Software Engineering · Computer Science 2021-07-05 Sabah Al-Fedaghi

Recent years have witnessed the resurgence of knowledge engineering which is featured by the fast growth of knowledge graphs. However, most of existing knowledge graphs are represented with pure symbols, which hurts the machine's capability…

Artificial Intelligence · Computer Science 2022-12-20 Xiangru Zhu , Zhixu Li , Xiaodan Wang , Xueyao Jiang , Penglei Sun , Xuwu Wang , Yanghua Xiao , Nicholas Jing Yuan

Representing entities and relations in an embedding space is a well-studied approach for machine learning on relational data. Existing approaches, however, primarily focus on simple link structure between a finite set of entities, ignoring…

Artificial Intelligence · Computer Science 2018-09-11 Pouya Pezeshkpour , Liyan Chen , Sameer Singh

Recent breakthroughs in multimodal large language models (MLLMs) have endowed AI systems with unified perception, reasoning and natural-language interaction across text, image and video streams. Meanwhile, Unmanned Aerial Vehicle (UAV)…

Molecular dynamics (MD) enables the study of physical systems with excellent spatiotemporal resolution but suffers from severe time-scale limitations. To address this, enhanced sampling methods have been developed to improve exploration of…

Statistical Mechanics · Physics 2023-06-19 Shams Mehdi , Zachary Smith , Lukas Herron , Ziyue Zou , Pratyush Tiwary

Search-based software engineering (SBSE), which integrates metaheuristic search techniques with software engineering, has been an active area of research for about 25 years. It has been applied to solve numerous problems across the entire…

Software Engineering · Computer Science 2026-05-07 Hassan Sartaj , Shaukat Ali , Paolo Arcaini , Andrea Arcuri

Summarization of multimedia data becomes increasingly significant as it is the basis for many real-world applications, such as question answering, Web search, and so forth. Most existing multi-modal summarization works however have used…

Computation and Language · Computer Science 2020-09-18 Xiyan Fu , Jun Wang , Zhenglu Yang

The manufacturing sector is increasingly adopting Multimodal Large Language Models (MLLMs) to transition from simple perception to autonomous execution, yet current evaluations fail to reflect the rigorous demands of real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiangru Jian , Hao Xu , Wei Pang , Xinjian Zhao , Chengyu Tao , Qixin Zhang , Xikun Zhang , Chao Zhang , Guanzhi Deng , Alex Xue , Juan Du , Tianshu Yu , Garth Tarr , Linqi Song , Qiuzhuang Sun , Dacheng Tao

Automated Machine Learning (AutoML) offers a promising approach to streamline the training of machine learning models. However, existing AutoML frameworks are often limited to unimodal scenarios and require extensive manual configuration.…

Machine Learning · Computer Science 2024-08-02 Daqin Luo , Chengjian Feng , Yuxuan Nong , Yiqing Shen

Recently, there has been increasing activity in using deep learning for software engineering, including tasks like code generation and summarization. In particular, the most recent coding Large Language Models seem to perform well on these…

Artificial Intelligence · Computer Science 2024-05-30 Balázs Szalontai , Gergő Szalay , Tamás Márton , Anna Sike , Balázs Pintér , Tibor Gregorics

Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modalities. In this paper,…

Machine Learning · Computer Science 2019-04-22 Jun-Ho Choi , Jong-Seok Lee

Complex real-time control system is a software dense and algorithms dense system, which needs modern software engineering techniques to design. UML is an object-oriented industrial standard modeling language, used more and more in real-time…

Software Engineering · Computer Science 2011-11-09 He Hai , Zhong Yi-Fang , Cai Chi-Lan

We study submodular information measures as a rich framework for generic, query-focused, privacy sensitive, and update summarization tasks. While past work generally treats these problems differently ({\em e.g.}, different models are often…

Machine Learning · Computer Science 2020-10-13 Vishal Kaushal , Suraj Kothawade , Ganesh Ramakrishnan , Jeff Bilmes , Himanshu Asnani , Rishabh Iyer

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

When developing a safety-critical system it is essential to obtain an assessment of different design alternatives. In particular, an early safety assessment of the architectural design of a system is desirable. In spite of the plethora of…

Software Engineering · Computer Science 2011-07-07 Florian Leitner-Fischer , Stefan Leue

Instruction-tuned large language models (LLMs) have demonstrated promising zero-shot generalization capabilities across various downstream tasks. Recent research has introduced multimodal capabilities to LLMs by integrating independently…

Computation and Language · Computer Science 2023-11-29 Utsav Garg , Erhan Bas

Even if the verification of authentication protocols can be achieved by means of formal analysis, the modelling of such an activity is an error-prone task due to the lack of automated and integrated processes. This paper proposes a…

Cryptography and Security · Computer Science 2022-10-07 Mariapia Raimondo , Stefano Marrone , Angelo Palladino

Unified Modeling Language (UML) Use Case and Class Diagrams are fundamental modeling notations in Software Engineering (SE) education due to their importance for requirements and model-based engineering, yet their relevance is…

Software Engineering · Computer Science 2026-04-27 Giacomo Garaccione , Riccardo Coppola , Luca Ardito

Unified Multimodal Models (UMMs) offer powerful cross-modality capabilities but introduce new safety risks not observed in single-task models. Despite their emergence, existing safety benchmarks remain fragmented across tasks and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Segyu Lee , Boryeong Cho , Hojung Jung , Seokhyun An , Juhyeong Kim , Jaehyun Kwak , Yongjin Yang , Sangwon Jang , Youngrok Park , Wonjun Chang , Se-Young Yun

The field of machine learning (ML) has gained widespread adoption, leading to significant demand for adapting ML to specific scenarios, which is yet expensive and non-trivial. The predominant approaches towards the automation of solving ML…

Machine Learning · Computer Science 2024-02-20 Lei Zhang , Yuge Zhang , Kan Ren , Dongsheng Li , Yuqing Yang