English
Related papers

Related papers: A Multimedia Analytics Model for the Foundation Mo…

200 papers

Predictive models are increasingly used to make various consequential decisions in high-stakes domains such as healthcare, finance, and policy. It becomes critical to ensure that these models make accurate predictions, are robust to shifts…

Machine Learning · Computer Science 2022-09-22 Murtuza N Shergadwala , Himabindu Lakkaraju , Krishnaram Kenthapadi

Human brain is continuously inundated with the multisensory information and their complex interactions coming from the outside world at any given moment. Such information is automatically analyzed by binding or segregating in our brain.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Arda Senocak , Junsik Kim , Tae-Hyun Oh , Hyeonggon Ryu , Dingzeyu Li , In So Kweon

Modern display environments offer great potential for involving multiple users in presentations, discussions, and data analysis sessions. By showing multiple views on multiple displays, information exchange can be improved, several…

Graphics · Computer Science 2019-12-19 Christian Eichner , Heidrun Schumann , Christian Tominski

Foundational Models (FMs) are gaining increasing attention in the biomedical AI ecosystem due to their ability to represent and contextualize multimodal biomedical data. These capabilities make FMs a valuable tool for a variety of tasks,…

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

Recent breakthroughs in artificial intelligence through foundation models and agents have accelerated the evolution of computational pathology. Demonstrated performance gains reported across academia in benchmarking datasets in predictive…

Foundation models have ushered in a new era for multimodal video understanding by enabling the extraction of rich spatiotemporal and semantic representations. In this work, we introduce a novel graph-based framework that integrates a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Fatemeh Ziaeetabar , Florentin Wörgötter

Dementia care requires healthcare professionals to balance a patient's medical needs with a deep understanding of their personal needs, preferences, and emotional cues. However, current digital tools prioritise quantitative metrics over…

Human-Computer Interaction · Computer Science 2025-09-11 Rhiannon Owen , Jonathan C. Roberts

Conversational Artificial Intelligence (AI) systems have recently sky-rocketed in popularity and are now used in many applications, from car assistants to customer support. The development of conversational AI systems is supported by a…

Human-Computer Interaction · Computer Science 2020-12-23 Johan Aronsson , Philip Lu , Daniel Strüber , Thorsten Berger

The rise of social media platforms has brought about a new digital culture called memes. Memes, which combine visuals and text, can strongly influence public opinions on social and cultural issues. As a result, people have become interested…

Computation and Language · Computer Science 2023-12-12 Ming Shan Hee , Aditi Kumaresan , Nguyen Khoi Hoang , Nirmalendu Prakash , Rui Cao , Roy Ka-Wei Lee

With the advancement of web techniques, they have significantly revolutionized various aspects of people's lives. Despite the importance of the web, many tasks performed on it are repetitive and time-consuming, negatively impacting overall…

Artificial Intelligence · Computer Science 2025-08-06 Liangbo Ning , Ziran Liang , Zhuohang Jiang , Haohao Qu , Yujuan Ding , Wenqi Fan , Xiao-yong Wei , Shanru Lin , Hui Liu , Philip S. Yu , Qing Li

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

Artificial Intelligence · Computer Science 2026-01-06 Bin Xu

The rapid advancement of Generative AI has catalyzed the emergence of autonomous AI agents, presenting unprecedented challenges for enterprise computing infrastructures. Current enterprise API architectures are predominantly designed for…

Software Engineering · Computer Science 2025-02-26 Vaibhav Tupe , Shrinath Thube

In the rapidly evolving field of artificial intelligence (AI), traditional benchmarks can fall short in attempting to capture the nuanced capabilities of AI models. We focus on the case of physical world modeling and propose a novel…

Artificial Intelligence · Computer Science 2025-09-08 Sasha Mitts

The ability to reason with and integrate different sensory inputs is the foundation underpinning human intelligence and it is the reason for the growing interest in modelling multi-modal information within Knowledge Graphs. Multi-Modal…

Artificial Intelligence · Computer Science 2024-10-18 Gianluca Apriceno , Valentina Tamma , Tania Bailoni , Jacopo de Berardinis , Mauro Dragoni

In an era of rapid technological advancements, agentification of software tools has emerged as a critical innovation, enabling systems to function autonomously and adaptively. This paper introduces MediaMind as a case study to demonstrate…

Computation and Language · Computer Science 2025-02-19 Ahmet Gunduz , Kamer Ali Yuksel , Hassan Sawaf

The ever-increasing amount of user-generated content online has led, in recent years, to an expansion in research and investment in automated content analysis tools. Scrutiny of automated content analysis has accelerated during the COVID-19…

Multimedia · Computer Science 2022-01-27 Carey Shenkman , Dhanaraj Thakur , Emma Llansó

Recent research has explored using Large Language Models for recommendation tasks by transforming user interaction histories and item metadata into text prompts, then having the LLM produce rankings or recommendations. A promising approach…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , LuYao Liu , Simon Lau , Chandler Yuan , and XueY Cui , Rosie Zhang

The convergence of artificial intelligence and materials science presents a transformative opportunity, but achieving true acceleration in discovery requires moving beyond task-isolated, fine-tuned models toward agentic systems that plan,…

Foundational models have caused a paradigm shift in the way artificial intelligence (AI) systems are built. They have had a major impact in natural language processing (NLP), and several other domains, not only reducing the amount of…

Networking and Internet Architecture · Computer Science 2022-11-15 Franck Le , Mudhakar Srivatsa , Raghu Ganti , Vyas Sekar