English
Related papers

Related papers: Clinical BioBERT Hyperparameter Optimization using…

200 papers

Unstructured clinical text in EHRs contains crucial information for applications including decision support, trial matching, and retrospective research. Recent work has applied BERT-based models to clinical information extraction and text…

Computation and Language · Computer Science 2020-11-13 Kexin Huang , Sankeerth Garapati , Alexander S. Rich

Electronic Health Records are large repositories of valuable clinical data, with a significant portion stored in unstructured text format. This textual data includes clinical events (e.g., disorders, symptoms, findings, medications and…

Computation and Language · Computer Science 2024-09-02 Shubham Agarwal , Thomas Searle , Mart Ratas , Anthony Shek , James Teo , Richard Dobson

Much attention and concern has been raised recently about bias and the use of machine learning algorithms in healthcare, especially as it relates to perpetuating racial discrimination and health disparities. Following an initial system…

Machine Learning · Computer Science 2023-05-24 Jill A. Kuhlberg , Irene Headen , Ellis A. Ballard , Donald Martin

Several types of numerical and combinatorial optimization algorithms have been used as useful tools to minimize functional forms. Generally, when those forms are non-linear or occur in problems without a specific optimization method,…

Chemical Physics · Physics 2007-05-23 Luiz Fernando Roncaratti , Ricardo Gargano , Geraldo Magela e Silva

For the last few decades, optimization has been developing at a fast rate. Bio-inspired optimization algorithms are metaheuristics inspired by nature. These algorithms have been applied to solve different problems in engineering, economics,…

Artificial Intelligence · Computer Science 2014-07-17 Muhammad Marwan Muhammad Fuad

As we gain access to a greater depth and range of health-related information about individuals, three questions arise: (1) Can we build better models to predict individual-level risk of ill health? (2) How much data do we need to…

Machine Learning · Statistics 2021-04-27 Mark Green

Early detection of Alzheimer's disease (AD) is crucial because its neurodegenerative effects are irreversible, and neuropathologic and social-behavioral risk factors accumulate years before diagnosis. Identifying higher-risk individuals…

Machine Learning · Computer Science 2025-10-14 Xi Mao , Zhendong Wang , Jingyu Li , Lingchao Mao , Utibe Essien , Hairong Wang , Xuelei Sherry Ni

In the past decade, there has been much discussion about the issue of biased reporting in clinical research. Despite this attention, there have been limited tools developed for the systematic assessment of qualitative statements made in…

Computation and Language · Computer Science 2021-06-02 Joshua J Myszewski , Emily Klossowski , Patrick Meyer , Kristin Bevil , Lisa Klesius , Kristopher M Schroeder

Social Determinants of Health correlate with patient outcomes but are rarely captured in structured data. Recent attention has been given to automatically extracting these markers from clinical text to supplement diagnostic systems with…

Machine Learning · Computer Science 2026-01-16 Sharim Khan , Paul Landes , Adam Cross , Jimeng Sun

Medical systems in general, and patient treatment decisions and outcomes in particular, are affected by bias based on gender and other demographic elements. As language models are increasingly applied to medicine, there is a growing…

Computation and Language · Computer Science 2021-03-11 Joshua R. Minot , Nicholas Cheney , Marc Maier , Danne C. Elbers , Christopher M. Danforth , Peter Sheridan Dodds

The challenge of finding a global optimum in a solution search space with limited resources and higher accuracy has given rise to several optimization algorithms. Generally, the gradient-based optimizers converge to the global solution very…

Neural and Evolutionary Computing · Computer Science 2023-11-23 Subhrangshu Adhikary

Electronic health records (EHR) are widely believed to hold a profusion of actionable insights, encrypted in an irregular, semi-structured format, amidst a loud noise background. To simplify learning patterns of health and disease, medical…

Computation and Language · Computer Science 2022-12-13 David A. Bloore , Romane Gauriau , Anna L. Decker , Jacob Oppenheim

Pre-trained code representation models such as CodeBERT have demonstrated superior performance in a variety of software engineering tasks, yet they are often heavy in complexity, quadratically with the length of the input sequence. Our…

Software Engineering · Computer Science 2022-11-22 Zhaowei Zhang , Hongyu Zhang , Beijun Shen , Xiaodong Gu

To be effective, state of the art machine learning technology needs large amounts of annotated data. There are numerous compelling applications in healthcare that can benefit from high performance automated decision support systems provided…

Signal Processing · Electrical Eng. & Systems 2018-01-09 Scott Yang , Silvia Lopez , Meysam Golmohammadi , Iyad Obeid , Joseph Picone

Agents can base decisions made using reinforcement learning (RL) on a reward function. The selection of values for the learning algorithm parameters can, nevertheless, have a substantial impact on the overall learning process. In order to…

Robotics · Computer Science 2022-11-21 Adarsh Sehgal , Nicholas Ward , Hung Manh La , Christos Papachristos , Sushil Louis

Genetic algorithms constitute a family of black-box optimization algorithms, which take inspiration from the principles of biological evolution. While they provide a general-purpose tool for optimization, their particular instantiations can…

Neural and Evolutionary Computing · Computer Science 2023-04-11 Robert Tjarko Lange , Tom Schaul , Yutian Chen , Chris Lu , Tom Zahavy , Valentin Dalibard , Sebastian Flennerhag

Electronic health records (EHR) contain narrative notes that provide extensive details on the medical condition and management of patients. Natural language processing (NLP) of clinical notes can use observed frequencies of clinical terms…

Computation and Language · Computer Science 2023-07-04 Bryan Cai , Sihang Zeng , Yucong Lin , Zheng Yuan , Doudou Zhou , Lu Tian

Finetuning a Large Language Model (LLM) is crucial for generating results towards specific objectives. This research delves into the realm of drug optimization and introduce a novel reinforcement learning algorithm to finetune a drug…

Machine Learning · Computer Science 2025-02-12 Xuefeng Liu , Songhao Jiang , Siyu Chen , Zhuoran Yang , Yuxin Chen , Ian Foster , Rick Stevens

This paper conducts a comprehensive investigation into applying large language models, particularly on BioBERT, in healthcare. It begins with thoroughly examining previous natural language processing (NLP) approaches in healthcare, shedding…

Artificial Intelligence · Computer Science 2023-10-13 Shyni Sharaf , V. S. Anoop

HyperParameter Optimization (HPO) aims at finding the best HyperParameters (HPs) of learning models, such as neural networks, in the fastest and most efficient way possible. Most recent HPO algorithms try to optimize HPs regardless of the…

Machine Learning · Computer Science 2023-04-11 Antoine Scardigli , Paul Fournier , Matteo Vilucchio , David Naccache