Journal Article DZNE-2026-01185

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Decoding Complications: Large Language Model-Based Classification of Free-Text Entries in Clinical Stroke Registries.

 ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;

2026
Plenum Press New York, NY

Journal of medical systems 50(1), 162 () [10.1007/s10916-026-02486-y]

This record in other databases:    

Please use a persistent id in citations: doi:

Abstract: Clinical registries capture adverse events (AEs) in free-text fields that are rarely analyzed. We developed a reproducible large language model (LLM)-assisted workflow using 11,216 free-text entries from 18,069 patients in the German Stroke Registry; 9,146 informative entries were retained after filtering. Embedding-based clustering showed poor separation, whereas an LLM-guided taxonomy identified 89 leaf labels. On the model-assisted 1,000-entry development set used for model and prompt selection, GPT-5.4 reached F1 92.4% (95% confidence interval [CI] 91.4-93.4). On 300 held-out entries, weighted F1 against clinician consensus was 96.5% (94.6-98.1) for frozen GPT-5.4 labels and 90.5% (87.5-93.5) for locally run Qwen 3.5 27B. For AE concepts with a comparable structured field, free text documented 1,345 additional instances (+19.6% over 6,867 structured instances); it also documented 7,546 instances of AE concepts without a structured equivalent, most often pneumonia, urinary tract infection and delirium. Beyond baseline covariates and the structured AE count, integrated complication concepts increased the area under the curve for prediction of good functional outcome by 0.025 (95% CI 0.021-0.028) and for death by 0.018 (0.014-0.021); gains were minimal after including the discharge National Institutes of Health Stroke Scale (NIHSS) score. On 1,979 public coronary-trial fragments from the Aggregate Analysis of ClinicalTrials.gov (AACT), the software ran end to end, demonstrating its technical applicability to a second clinical text corpus. In conclusion, this workflow enables structured analysis of clinical registry free text and complements structured adverse-event documentation.

Keyword(s): Humans (MeSH) ; Registries (MeSH) ; Large Language Models (MeSH) ; Stroke: complications (MeSH) ; Germany (MeSH) ; Natural Language Processing (MeSH) ; Adverse event detection ; Clinical information extraction ; Clinical information systems ; Clinical natural language processing ; Complication surveillance ; Endovascular thrombectomy ; Large language models ; Stroke registry

Classification:

Contributing Institute(s):
  1. Clinical Research Platform (CRP) (AG Spottke)
  2. Vascular Neurology (AG Petzold)
  3. Statistics and Machine Learning (AG Mukherjee)
  4. Clinical Single Cell Omics (CSCO) / Systems Medicine (AG Schultze)
Research Program(s):
  1. 353 - Clinical and Health Care Research (POF4-353) (POF4-353)
  2. 354 - Disease Prevention and Healthy Aging (POF4-354) (POF4-354)

Appears in the scientific report 2026
Database coverage:
Medline ; Creative Commons Attribution CC BY 4.0 ; OpenAccess ; Clarivate Analytics Master Journal List ; Current Contents - Clinical Medicine ; DEAL Springer ; Ebsco Academic Search ; Essential Science Indicators ; IF >= 5 ; JCR ; NationallizenzNationallizenz ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection
Click to display QR Code for this record

The record appears in these collections:
Document types > Articles > Journal Article
Institute Collections > BN DZNE > BN DZNE-AG Mukherjee
Institute Collections > BN DZNE > BN DZNE-AG Schultze
Institute Collections > BN DZNE > BN DZNE-AG Spottke
Institute Collections > BN DZNE > BN DZNE-AG Petzold
Full Text Collection
Public records
Publications Database

 Record created 2026-11-18, last modified 2026-11-18


OpenAccess:
Download fulltext PDF Download fulltext PDF (PDFA)
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)