中文
相关论文

相关论文: An overview of domain-specific foundation model: k…

200 篇论文

Integrating Foundation Models (FMs) into recommendation systems is an emerging and promising research direction. However, centralized paradigms face growing pressure from privacy concerns and strict regulatory requirements. Federated…

机器学习 · 计算机科学 2026-05-08 Zhiwei Li , Guodong Long , Chunxu Zhang , Honglei Zhang , Jing Jiang , Chengqi Zhang

Artificial Intelligence (AI) has made incredible progress recently. On the one hand, advanced foundation models like ChatGPT can offer powerful conversation, in-context learning and code generation abilities on a broad range of open-domain…

人工智能 · 计算机科学 2023-03-30 Yaobo Liang , Chenfei Wu , Ting Song , Wenshan Wu , Yan Xia , Yu Liu , Yang Ou , Shuai Lu , Lei Ji , Shaoguang Mao , Yun Wang , Linjun Shou , Ming Gong , Nan Duan

Foundation models (FMs), that are trained on broad data at scale and are adaptable to a wide range of downstream tasks, have brought large interest in the research community. Benefiting from the diverse data sources such as different…

The rise of large language models (LLMs), such as ChatGPT, Gemini, and Grok, has reshaped the AI landscape. As prominent instances of foundational models (FMs), they exhibit remarkable capabilities in generating human-like content, pushing…

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

机器学习 · 计算机科学 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Foundation models (FMs) have revolutionized computer vision, enabling effective learning across different domains. However, their performance under domain shift is yet underexplored. This paper investigates the zero-shot domain adaptation…

计算机视觉与模式识别 · 计算机科学 2024-07-11 Ugur Ali Kaplan , Margret Keuper , Anna Khoreva , Dan Zhang , Yumeng Li

Foundation Models (FMs), such as OpenAI's GPT, are fundamentally transforming the practice of software engineering by enabling the development of \emph{FMware} -- applications and infrastructures built around these models. FMware systems…

软件工程 · 计算机科学 2025-10-14 Zitao Wang , Zhimin Zhao , Michael W. Godfrey

Graph foundation models (GFM) aim to acquire transferable knowledge by pre-training on diverse graphs, which can be adapted to various downstream tasks. However, domain shift in graphs is inherently two-dimensional: graphs differ not only…

计算与语言 · 计算机科学 2026-03-12 Xingtong Yu , Shenghua Ye , Ruijuan Liang , Chang Zhou , Hong Cheng , Xinming Zhang , Yuan Fang

Foundation Models (FMs) are models trained on large corpora of data that, at very large scale, can generalize to new tasks without any task-specific finetuning. As these models continue to grow in size, innovations continue to push the…

机器学习 · 计算机科学 2022-12-27 Avanika Narayan , Ines Chami , Laurel Orr , Simran Arora , Christopher Ré

By treating data and models as the source code, Foundation Models (FMs) become a new type of software. Mirroring the concept of software crisis, the increasing complexity of FMs making FM crisis a tangible concern in the coming decade,…

软件工程 · 计算机科学 2024-07-12 Dezhi Ran , Mengzhou Wu , Wei Yang , Tao Xie

Large language models (LLMs) such as ChatGPT have shown remarkable capabilities in code generation. Despite significant achievements, they rely on enormous training data to acquire a broad spectrum of open-domain knowledge. Besides, their…

软件工程 · 计算机科学 2025-02-18 Xiaodong Gu , Meng Chen , Yalan Lin , Yuhan Hu , Hongyu Zhang , Chengcheng Wan , Zhao Wei , Yong Xu , Juhong Wang

In the rapidly evolving domain of artificial intelligence, chatbots have emerged as a potent tool for various applications ranging from e-commerce to healthcare. This research delves into the intricacies of chatbot technology, from its…

人机交互 · 计算机科学 2023-11-17 Feriel Khennouche , Youssef Elmir , Nabil Djebari , Yassine Himeur , Abbes Amira

Foundation models (FMs) have shown prominent success in a wide range of tasks. Their applicability to specific domain-task pairings relies on the availability of, both, high-quality data and significant computational resources. These…

机器学习 · 计算机科学 2023-11-10 Lekang Jiang , Filip Svoboda , Nicholas D. Lane

Deep Foundation Models (DFMs) offer unprecedented capabilities but their increasing complexity presents profound challenges to understanding their internal workings-a critical need for ensuring trust, safety, and accountability. As we…

计算机与社会 · 计算机科学 2025-04-25 Zhen Tan , Huan Liu

The rapid integration of Large Language Models (LLMs) into various industries presents both revolutionary opportunities and unique challenges. This research aims to establish a scalable and efficient framework for LLM customization,…

软件工程 · 计算机科学 2024-05-22 Panos Fitsilis , Vyron Damasiotis , Vasileios Kyriatzis , Paraskevi Tsoutsa

Foundation models (FMs) promise to generalize medical imaging, but their effectiveness varies. It remains unclear how pre-training domain (medical vs. general), paradigm (e.g., text-guided), and architecture influence embedding quality,…

Foundation models (FMs) have emerged as a powerful paradigm, enabling a diverse range of data analytics and knowledge discovery tasks across scientific fields. Inspired by the success of FMs, particularly large language models, researchers…

机器学习 · 计算机科学 2025-11-27 Sean Bin Yang , Ying Sun , Yunyao Cheng , Yan Lin , Kristian Torp , Jilin Hu

The release of ChatGPT, Gemini, and other large language model has drawn huge interests on foundations models. There is a broad consensus that foundations models will be the fundamental building blocks for future AI systems. However, there…

计算与语言 · 计算机科学 2024-07-17 Qinghua Lu , Liming Zhu , Xiwei Xu , Zhenchang Xing , Jon Whittle

Foundation models have transformed natural language processing and computer vision, and their impact is now reshaping remote sensing image analysis. With powerful generalization and transfer learning capabilities, they align naturally with…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Liling Yang , Ning Chen , Jun Yue , Yidan Liu , Jiayi Ma , Pedram Ghamisi , Antonio Plaza , Leyuan Fang