中文
相关论文

相关论文: Modyn: Data-Centric Machine Learning Pipeline Orch…

200 篇论文

Training data is an essential resource for creating capable and robust vision systems which are integral to the proper function of many robotic systems. Synthesized training data has been shown in recent years to be a viable alternative to…

机器人学 · 计算机科学 2024-11-12 Peter Gavriel , Adam Norton , Kenneth Kimble , Megan Zimmerman

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

图像与视频处理 · 电气工程与系统科学 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Large model training often uses recomputation to alleviate memory pressure and pipelines to exploit the parallelism of data, tensors, and devices. However, existing recomputation approaches may incur high overhead when training real-world…

分布式、并行与集群计算 · 计算机科学 2025-03-31 Ping Chen , Wenjie Zhang , Shuibing He , Weijian Chen , Siling Yang , Kexin Huang , Yanlong Yin , Xuan Zhan , Yingjie Gu , Zhuwei Peng , Yi Zheng , Zhefeng Wang , Gang Chen

The optimization of the electrodes manufacturing process constitutes one of the most critical steps to ensure high-quality Lithium-Ion Battery (LIB) cells, in particular for automotive applications. Because LIB electrode manufacturing is a…

Recently, the robotics community has amassed ever larger and more diverse datasets to train generalist robot policies. However, while these policies achieve strong mean performance across a variety of tasks, they often underperform on…

机器人学 · 计算机科学 2025-05-15 Shivin Dass , Alaa Khaddaj , Logan Engstrom , Aleksander Madry , Andrew Ilyas , Roberto Martín-Martín

Deep learning classifiers face significant challenges when dealing with heterogeneous multi-modal and multi-organ biomedical datasets. The low-level feature distinguishability limited to imaging-modality hinders the classifiers' ability to…

图像与视频处理 · 电气工程与系统科学 2025-02-04 Mehmet Can Yavuz , Yang Yang

As Large Language Models (LLMs) are increasingly applied across various tasks, instruction tuning has emerged as a critical method for enhancing model performance. However, current data management strategies face substantial challenges in…

计算与语言 · 计算机科学 2025-04-15 Yangning Li , Zihua Lan , Lv Qingsong , Yinghui Li , Hai-Tao Zheng

Autonomous driving systems have a pipeline of perception, decision, planning, and control. The decision module processes information from the perception module and directs the execution of downstream planning and control modules. On the…

人工智能 · 计算机科学 2021-05-07 Junning Huang , Sirui Xie , Jiankai Sun , Qiurui Ma , Chunxiao Liu , Jianping Shi , Dahua Lin , Bolei Zhou

The Instruction Following (IF) ability measures how well Multi-modal Large Language Models (MLLMs) understand exactly what users are telling them and whether they are doing it right. Existing multimodal instruction following training data…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Shengyuan Ding , Shenxi Wu , Xiangyu Zhao , Yuhang Zang , Haodong Duan , Xiaoyi Dong , Pan Zhang , Yuhang Cao , Dahua Lin , Jiaqi Wang

With the emerging technologies and all associated devices, it is predicted that massive amount of data will be created in the next few years, in fact, as much as 90% of current data were created in the last couple of years,a trend that will…

机器学习 · 计算机科学 2015-03-19 O. Y. Al-Jarrah , P. D. Yoo , S Muhaidat , G. K. Karagiannidis , K. Taha

While traditional machine learning can effectively tackle a wide range of problems, it primarily operates within a closed-world setting, which presents limitations when dealing with streaming data. As a solution, incremental learning…

机器学习 · 计算机科学 2025-03-11 Hai-Long Sun , Da-Wei Zhou , De-Chuan Zhan , Han-Jia Ye

Modern recommendation systems rely on real-valued embeddings of categorical features. Increasing the dimension of embedding vectors improves model accuracy but comes at a high cost to model size. We introduce a multi-layer embedding…

Building a machine learning (ML) pipeline in an automated way is a crucial and complex task as it is constrained with the available time budget and resources. This encouraged the research community to introduce several solutions to utilize…

机器学习 · 计算机科学 2020-01-01 Hassan Eldeeb , Abdelrhman Eldallal

Data scarcity and noise are important issues in industrial applications of machine learning. However, it is often challenging to devise a scalable and generalized approach to address the fundamental distributional and semantic properties of…

机器学习 · 计算机科学 2021-12-08 Youngjune Lee , Oh Joon Kwon , Haeju Lee , Joonyoung Kim , Kangwook Lee , Kee-Eung Kim

Practical recommender systems need be periodically retrained to refresh the model with new interaction data. To pursue high model fidelity, it is usually desirable to retrain the model on both historical and new data, since it can account…

信息检索 · 计算机科学 2021-01-15 Yang Zhang , Fuli Feng , Chenxu Wang , Xiangnan He , Meng Wang , Yan Li , Yongdong Zhang

Network management often relies on machine learning to make predictions about performance and security from network traffic. Often, the representation of the traffic is as important as the choice of the model. The features that the model…

网络与互联网体系结构 · 计算机科学 2022-01-25 Francesco Bronzino , Paul Schmitt , Sara Ayoubi , Hyojoon Kim , Renata Teixeira , Nick Feamster

Over recent years, an increasing amount of compute and data has been poured into training large language models (LLMs), usually by doing one-pass learning on as many tokens as possible randomly selected from large-scale web corpora. While…

计算与语言 · 计算机科学 2023-08-24 Kushal Tirumala , Daniel Simig , Armen Aghajanyan , Ari S. Morcos

The use of machine learning (ML) methods for development of robust and flexible visual inspection system has shown promising. However their performance is highly dependent on the amount and diversity of training data. This is often…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Juraj Fulir , Natascha Jeziorski , Lovro Bosnar , Hans Hagen , Claudia Redenbach , Petra Gospodnetić , Tobias Herrfurth , Marcus Trost , Thomas Gischkat

Meshing is a critical, but user-intensive process necessary for stable and accurate simulations in computational fluid dynamics (CFD). Mesh generation is often a bottleneck in CFD pipelines. Adaptive meshing techniques allow the mesh to be…

机器学习 · 计算机科学 2022-12-06 Cooper Lorsung , Amir Barati Farimani

Declarative large-scale machine learning (ML) aims at the specification of ML algorithms in a high-level language and automatic generation of hybrid runtime execution plans ranging from single node, in-memory computations to distributed…

分布式、并行与集群计算 · 计算机科学 2015-03-24 Matthias Boehm