Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-17T02:53:53.791Z Has data issue: false hasContentIssue false

1 Developing an annotated database to facilitate machine learning in rare pediatric cancer

Published online by Cambridge University Press:  08 May 2026

Brian Englum
Affiliation:
University of Maryland, Baltimore
Ashley Johnston
Affiliation:
Georgetown University
Minerva Mayorga-Carlin
Affiliation:
University of Maryland, Baltimore
John D. Sorkin
Affiliation:
University of Maryland, Baltimore
Brajesh K. Lal
Affiliation:
University of Maryland, Baltimore
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

Objectives/Goals: Rare pediatric cancer research has been hindered by limited sample size and disease-specific databases. The training and infrastructure required to create these datasets have been cost prohibitive. Automated electronic medical record (EMR) extraction and natural language processing (NLP) hold the potential to overcome these limitations. Methods/Study Population: In a mixed population of adults and children with thyroid cancer, we implemented an automated data extraction process for multiple data types, including structured demographic, laboratory, and billing data and unstructured free text from pathology reports. Data extraction and cleaning software transformed EMR data into a research-ready database. NLP using regular expressions extracted meaningful, structured data from free-text pathology reports. Results from the automated data extraction and NLP were compared to manual extraction, and results were quantified using accuracy, precision, recall, F1-score, and Cohen’s Kappa to account for random agreement. Additional iterations using machine learning and large language models will be performed to compare accuracy and identify an optimal strategy. Results/Anticipated Results: From 2016 to 2023, 2,899 patients with thyroid cancer were identified. In a 50-patient subset, manual extraction of pathology reports was compared to NLP-derived data. Histology type was correctly identified in 90% of cases (kappa = 0.85), and thyroid procedure identification accuracy was 89% (kappa 0.81). Focality was 98% accurate (kappa=0.96). Vascular, lymphatic, and perineural invasion, along with extrathyroidal extension and pathologic tumor stage, were 100% accurate. Pathologic nodal staging was 96% accurate (kappa=0.89). Kappa greater than 0.8 is considered almost perfect agreement. Discussion/Significance of Impact: Our results indicate that automated EMR extraction and NLP can be used to develop a thyroid cancer dataset that is highly detailed, accurate, and efficient to collect. After optimizing our system of data extraction, we will replicate this process in a multi-center study with the eventual goal to expand these algorithms across rare pediatric cancers.

Information

Type
Posters 1–50, 326 are the top 50 posters AI and Data Science
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (https://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
© The Author(s), 2026. The Association for Clinical and Translational Science