English
Related papers

Related papers: Exploring the Innovation Opportunities for Pre-tra…

200 papers

In many practical applications of AI, an AI model is used as a decision aid for human users. The AI provides advice that a human (sometimes) incorporates into their decision-making process. The AI advice is often presented with some measure…

Artificial Intelligence · Computer Science 2022-10-31 Kailas Vodrahalli , Tobias Gerstenberg , James Zou

Generative AI has received much attention in the image and language domains, with the transformer neural network continuing to dominate the state of the art. Application of these models to time series generation is less explored, however,…

Machine Learning · Computer Science 2024-06-05 Alexander Sommers , Logan Cummins , Sudip Mittal , Shahram Rahimi , Maria Seale , Joseph Jaboure , Thomas Arnold

The past decade has seen significant progress in artificial intelligence (AI), which has resulted in algorithms being adopted for resolving a variety of problems. However, this success has been met by increasing model complexity and…

Machine Learning · Computer Science 2021-11-15 Waddah Saeed , Christian Omlin

Software development requires understanding of users, user needs, user tasks and context in which they are operating. These skills are familiar to entrepreneurs, product managers, and marketing experts. However, our teaching experience…

Human-Computer Interaction · Computer Science 2020-11-19 Dusanka Boskovic , Nihad Borovina , Merima Zukic

With the rapid development of artificial intelligence technology, Transformer structural pre-training model has become an important tool for large language model (LLM) tasks. In the field of e-commerce, these models are especially widely…

Computation and Language · Computer Science 2024-02-27 Yafei Xiang , Hanyi Yu , Yulu Gong , Shuning Huo , Mengran Zhu

Artificial Intelligence models are becoming increasingly more powerful and accurate, supporting or even replacing humans' decision making. But with increased power and accuracy also comes higher complexity, making it hard for users to…

Artificial Intelligence · Computer Science 2019-07-10 Vivian S. Silva , André Freitas , Siegfried Handschuh

We survey applications of pretrained foundation models in robotics. Traditional deep learning models in robotics are trained on small datasets tailored for specific tasks, which limits their adaptability across diverse applications. In…

In real-world scenarios classification models are often required to perform robustly when predicting samples belonging to classes that have not appeared during its training stage. Open Set Recognition addresses this issue by devising models…

Machine Learning · Computer Science 2024-01-08 Marcos Barcina-Blanco , Jesus L. Lobo , Pablo Garcia-Bringas , Javier Del Ser

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

Human-Computer Interaction · Computer Science 2024-04-10 M. Namvarpour , A. Razi

Much discussion about large language models and language-and-vision models has focused on whether these models are intelligent agents. We present an alternative perspective. We argue that these artificial intelligence models are cultural…

Artificial Intelligence · Computer Science 2023-05-16 Eunice Yiu , Eliza Kosoy , Alison Gopnik

Conversational AI models are becoming increasingly popular and are about to replace traditional search engines for information retrieval and product discovery. This raises concerns about monetization strategies and the potential for subtle…

General Economics · Economics 2024-09-19 Tobias Werner , Ivan Soraperra , Emilio Calvano , David C. Parkes , Iyad Rahwan

In the era of data-driven intelligence, the paradox of data abundance and annotation scarcity has emerged as a critical bottleneck in the advancement of machine learning. This paper gives a detailed overview of Active Learning (AL), which…

Machine Learning · Computer Science 2025-11-27 Chiung-Yi Tseng , Junhao Song , Ziqian Bi , Tianyang Wang , Chia Xin Liang , Xinyuan Song , Ming Liu

This paper explores the potential of AI-powered tools to reshape data analysis, focusing on design considerations and challenges. We explore how the emergence of large language and multimodal models offers new opportunities to enhance…

Artificial Intelligence · Computer Science 2024-09-30 Jeevana Priya Inala , Chenglong Wang , Steven Drucker , Gonzalo Ramos , Victor Dibia , Nathalie Riche , Dave Brown , Dan Marshall , Jianfeng Gao

The rapid expansion of foundation pre-trained models and their fine-tuned counterparts has significantly contributed to the advancement of machine learning. Leveraging pre-trained models to extract knowledge and expedite learning in…

Machine Learning · Computer Science 2023-08-21 Yi-Kai Zhang , Lu Ren , Chao Yi , Qi-Wei Wang , De-Chuan Zhan , Han-Jia Ye

While the exploration for embodied AI has spanned multiple decades, it remains a persistent challenge to endow agents with human-level intelligence, including perception, learning, reasoning, decision-making, control, and generalization…

Robotics · Computer Science 2024-02-07 Zhiyuan Xu , Kun Wu , Junjie Wen , Jinming Li , Ning Liu , Zhengping Che , Jian Tang

Recent progress in artificial intelligence (AI) marks a pivotal moment in human history. It presents the opportunity for machines to learn, adapt, and perform tasks that have the potential to assist people, from everyday activities to their…

General Economics · Economics 2024-02-02 Guy Ben-Ishai , Jeff Dean , James Manyika , Ruth Porat , Hal Varian , Kent Walker

Artificial intelligence (AI) has achieved remarkable breakthroughs in a wide range of fields, ranging from speech processing, image classification to drug discovery. This is driven by the explosive growth of data, advances in machine…

Information Theory · Computer Science 2024-10-30 Yuanming Shi , Kai Yang , Tao Jiang , Jun Zhang , Khaled B. Letaief

Large-scale pre-training of Foundational Models (FM) constitutes a computationally intensive first phase for enabling AI across diverse scientific and societal applications. This first phase has positioned High-Performance Computing (HPC)…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-15 Dino Conciatore , Elia Oggian , Federico Da Forno , Stefano Schuppli , Jerome Tissieres , Joost VandeVondele , Maxime Martinasso

World models are emerging as a transformative paradigm in artificial intelligence, enabling agents to construct internal representations of their environments for predictive reasoning, planning, and decision-making. By learning latent…

Artificial Intelligence · Computer Science 2025-06-03 Changyuan Zhao , Ruichen Zhang , Jiacheng Wang , Gaosheng Zhao , Dusit Niyato , Geng Sun , Shiwen Mao , Dong In Kim

People rely on social skills like conflict resolution to communicate effectively and to thrive in both work and personal life. However, practice environments for social skills are typically out of reach for most people. How can we make…

Computation and Language · Computer Science 2024-04-08 Diyi Yang , Caleb Ziems , William Held , Omar Shaikh , Michael S. Bernstein , John Mitchell