中文
相关论文

相关论文: Multi-Dimensional Ability Diagnosis for Machine Le…

200 篇论文

The rapid adoption of large language models (LLMs) in education raises profound challenges for assessment design. To adapt assessments to the presence of LLM-based tools, it is crucial to characterize the strengths and weaknesses of LLMs in…

人机交互 · 计算机科学 2026-04-16 Licol Zeinfeld , Alona Strugatski , Ziva Bar-Dov , Ron Blonder , Shelley Rap , Giora Alexandron

Computer-aided diagnosis (CAD), a vibrant medical imaging research field, is expanding quickly. Because errors in medical diagnostic systems might lead to seriously misleading medical treatments, major efforts have been made in recent years…

机器学习 · 计算机科学 2023-08-04 Farzaneh Tajidini , Mohammad-Javad Kheiri

Standard evaluation of LLM confidence relies on calibration metrics (ECE, Brier score) that conflate two distinct capacities: how much a model knows (Type-1 sensitivity) and how well it knows what it knows (Type-2 metacognitive…

计算与语言 · 计算机科学 2026-03-27 Jon-Paul Cacioli

Computer vision and machine learning are playing an increasingly important role in computer-assisted diagnosis; however, the application of deep learning to medical imaging has challenges in data availability and data imbalance, and it is…

图像与视频处理 · 电气工程与系统科学 2022-12-07 Kai Ma , Siyuan He , Pengcheng Xi , Ashkan Ebadi , Stéphane Tremblay , Alexander Wong

Despite the rapid expansion of Large Language Models (LLMs) in healthcare, robust and explainable evaluation of their ability to assess clinical trial reporting according to CONSORT standards remains an open challenge. In particular,…

人工智能 · 计算机科学 2026-02-26 Sohyeon Jeon , Hyung-Chul Lee

As deep learning applications continue to become more diverse, an interesting question arises: Can general problem solving arise from jointly learning several such diverse tasks? To approach this question, deep multi-task learning is…

机器学习 · 计算机科学 2019-10-29 Elliot Meyerson , Risto Miikkulainen

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

人工智能 · 计算机科学 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta

Assessment and reporting of skills is a central feature of many digital learning platforms. With students often using multiple platforms, cross-platform assessment has emerged as a new challenge. While technologies such as Learning Tools…

计算机与社会 · 计算机科学 2021-02-26 Zhi Li , Cheng Ren , Xianyou Li , Zachary A. Pardos

As generative AI becomes increasingly embedded in everyday workflows, it is important to evaluate its performance in ways that reflect real-world usage rather than abstract notions of intelligence. Unlike many existing benchmarks that…

人工智能 · 计算机科学 2025-05-14 Justin K Miller , Wenjia Tang

Large Language Models (LLMs) are increasingly used in settings where reliable self-assessment is critical. Assessing model reliability has evolved from using probabilistic correctness estimates to, more recently, eliciting verbalized…

计算与语言 · 计算机科学 2026-05-11 Sree Bhattacharyya , Samarth Khanna , Leona Chen , Lucas Craig , Tharun Dilliraj , James Z. Wang

Process capability indices such as $C_{pk}$ are widely used for manufacturing decisions, yet are typically applied via deterministic thresholding of finite-sample estimates, ignoring uncertainty and leading to unstable outcomes near the…

应用统计 · 统计学 2026-04-16 Fei Jiang , Lei Yang

Meta-learning aims to learn a model that can handle multiple tasks generated from an unknown but shared distribution. However, typical meta-learning algorithms have assumed the tasks to be similar such that a single meta-learner is…

机器学习 · 计算机科学 2023-12-08 Kyeongryeol Go , Seyoung Yun

Developing artificial intelligence (AI) for clinical research requires a comprehensive data foundation that supports model training and rigorous evaluation. Here, we introduce TrialPanorama, a large-scale structured resource that aggregates…

人工智能 · 计算机科学 2025-12-17 Zifeng Wang , Jiacheng Lin , Qiao Jin , Junyi Gao , Jathurshan Pradeepkumar , Pengcheng Jiang , Zhiyong Lu , Jimeng Sun

The implicit assumption that human and autonomous agents have certain capabilities is omnipresent in modern teaming concepts. However, none formalize these capabilities in a flexible and quantifiable way. In this paper, we propose…

机器人学 · 计算机科学 2024-08-12 Nils Mandischer , Marcel Usai , Frank Flemisch , Lars Mikelsons

Machine Learning is proving invaluable across disciplines. However, its success is often limited by the quality and quantity of available data, while its adoption by the level of trust that models afford users. Human vs. machine performance…

Human activity recognition serves as the foundation for various emerging applications. In recent years, researchers have used collaborative sensing of multi-source sensors to capture complex and dynamic human activities. However, multimodal…

机器学习 · 计算机科学 2026-04-28 Long Jing , Zhixiong Yang , Yajun Zhang , Xinlong Feng

Many computer vision tasks address the problem of scene understanding and are naturally interrelated e.g. object classification, detection, scene segmentation, depth estimation, etc. We show that we can leverage the inherent relationships…

计算机视觉与模式识别 · 计算机科学 2021-03-18 Yao Lu , Sören Pirk , Jan Dlabal , Anthony Brohan , Ankita Pasad , Zhao Chen , Vincent Casser , Anelia Angelova , Ariel Gordon

For the sake of recognizing and classifying textile defects, deep learning-based methods have been proposed and achieved remarkable success in single-label textile images. However, detecting multi-label defects in a textile image remains…

计算机视觉与模式识别 · 计算机科学 2021-02-02 Bing Wei , Kuangrong Hao , Lei Gao

With the advancements in computer technology, there is a rapid development of intelligent systems to understand the complex relationships in data to make predictions and classifications. Artificail Intelligence based framework is rapidly…

机器学习 · 计算机科学 2021-07-30 G Jignesh Chowdary , Suganya G , Premalatha M , Asnath Victy Phamila Y , Karunamurthy K

As a prominent direction of Artificial General Intelligence (AGI), Multimodal Large Language Models (MLLMs) have garnered increased attention from both industry and academia. Building upon pre-trained LLMs, this family of models further…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Chaoyou Fu , Yi-Fan Zhang , Shukang Yin , Bo Li , Xinyu Fang , Sirui Zhao , Haodong Duan , Xing Sun , Ziwei Liu , Liang Wang , Caifeng Shan , Ran He