中文
相关论文

相关论文: Walrus: A Cross-Domain Foundation Model for Contin…

200 篇论文

Recently, foundation language models (LMs) have marked significant achievements in the domains of natural language processing (NLP) and computer vision (CV). Unlike traditional neural network models, foundation LMs obtain a great ability…

计算与语言 · 计算机科学 2024-12-02 Yutao Yang , Jie Zhou , Xuanwen Ding , Tianyu Huai , Shunyu Liu , Qin Chen , Yuan Xie , Liang He

Humans possess an extraordinary ability to create and utilize tools, allowing them to overcome physical limitations and explore new frontiers. With the advent of foundation models, AI systems have the potential to be equally adept in tool…

We investigate the impact of tokeniser pretraining on the accuracy and efficiency of physics emulation. Modern high-resolution simulations produce vast volumes of data spanning diverse physical regimes and scales. Training foundation models…

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

The fast simulation of dynamical systems is a key challenge in many scientific and engineering applications, such as weather forecasting, disease control, and drug discovery. With the recent success of deep learning, there is increasing…

机器学习 · 计算机科学 2024-10-02 Zezheng Song , Jiaxin Yuan , Haizhao Yang

As the scale of models and training data continues to grow, there is an expanding reliance on more GPUs to train large-scale models, which inevitably increases the likelihood of encountering dynamic stragglers that some devices lag behind…

分布式、并行与集群计算 · 计算机科学 2025-05-07 Haoyang Li , Fangcheng Fu , Hao Ge , Sheng Lin , Xuanyu Wang , Jiawen Niu , Yujie Wang , Hailin Zhang , Xiaonan Nie , Bin Cui

Quantitative remote sensing inversion aims to estimate continuous surface variables-such as biomass, vegetation indices, and evapotranspiration-from satellite observations, supporting applications in ecosystem monitoring, carbon accounting,…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Zhenyu Yu , Mohd Yamani Idna Idris , Hua Wang , Pei Wang , Junyi Chen , Kun Wang

Skill effect models for long-horizon manipulation tasks are prone to failures in conditions not covered by training data distributions. Therefore, enabling robots to reason about and learn from failures is necessary. We investigate the…

机器人学 · 计算机科学 2025-09-03 Yixuan Huang , Novella Alvina , Mohanraj Devendran Shanthi , Tucker Hermans

Training a general-purpose time series foundation models with robust generalization capabilities across diverse applications from scratch is still an open challenge. Efforts are primarily focused on fusing cross-domain time series datasets…

机器学习 · 计算机科学 2024-12-13 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

Machine learning has demonstrated remarkable performance over finite datasets, yet whether the scores over the fixed benchmarks can sufficiently indicate the model's performance in the real world is still in discussion. In reality, an ideal…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Peiyan Zhang , Haoyang Liu , Chaozhuo Li , Xing Xie , Sunghun Kim , Haohan Wang

Tendon-Driven Continuum Robots (TDCRs) pose significant modeling and control challenges due to complex nonlinearities, such as frictional hysteresis and transmission compliance. This paper proposes a differentiable learning framework that…

机器人学 · 计算机科学 2026-04-29 Ziqing Zou , Ke Qiu , Fei Wang , Haojian Lu , Rong Xiong , Yue Wang

Foundation models have achieved remarkable success across video, image, and language domains. By scaling up the number of parameters and training datasets, these models acquire generalizable world knowledge and often surpass task-specific…

机器学习 · 计算机科学 2025-07-16 Tung Nguyen , Arsh Koneru , Shufan Li , Aditya Grover

Flow-based latent generative models such as Stable Diffusion 3 are able to generate images with remarkable quality, even enabling photorealistic text-to-image generation. Their impressive performance suggests that these models should also…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Julius Erbach , Dominik Narnhofer , Andreas Dombos , Bernt Schiele , Jan Eric Lenssen , Konrad Schindler

Modeling an unknown dynamical system is crucial in order to predict the future behavior of the system. A standard approach is training recurrent models on measurement data. While these models typically provide exact short-term predictions,…

机器学习 · 计算机科学 2023-03-02 Katharina Ensinger , Sebastian Ziesche , Barbara Rakitsch , Michael Tiemann , Sebastian Trimpe

The realization of universal robots is an ultimate goal of researchers. However, a key hurdle in achieving this goal lies in the robots' ability to manipulate objects in their unstructured surrounding environments according to different…

Recently, computational modeling has shifted towards the use of deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by…

流体动力学 · 物理学 2021-10-11 Suraj Pawar , Omer San , Prakash Vedula , Adil Rasheed , Trond Kvamsdal

The rapid advancement of remote sensing foundation models, particularly vision and multimodal models, has significantly enhanced the capabilities of intelligent geospatial data interpretation. These models combine various data modalities,…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Ziyue Huang , Hongxi Yan , Qiqi Zhan , Shuai Yang , Mingming Zhang , Chenkai Zhang , YiMing Lei , Zeming Liu , Qingjie Liu , Yunhong Wang

The dissertation presents four key contributions toward fairness and robustness in vision learning. First, to address the problem of large-scale data requirements, the dissertation presents a novel Fairness Domain Adaptation approach…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Thanh-Dat Truong

We present a machine learning-based framework for blending data-driven turbulent closures in the Reynolds-Averaged Navier-Stokes (RANS) equations, aimed at improving their generalizability across diverse flow regimes. Specialized models…

流体动力学 · 物理学 2025-03-05 Mourad Oulghelou , Soufiane Cherroud , Xavier Merle , Paola Cinnella

Large AI models have been widely adopted in wireless communications for channel modeling, beamforming, and resource optimization. However, most existing efforts remain limited to single-modality inputs and channel-specific objec- tives,…

机器学习 · 计算机科学 2025-11-18 Zhizhen Li , Xuanhao Luo , Xueren Ge , Longyu Zhou , Xingqin Lin , Yuchen Liu