guest ::
| Home > Publications Database > Benchmarking large language models for personalized, biomarker-based health intervention recommendations. > print |
| Home > Publications Database > Benchmarking large language models for personalized, biomarker-based health intervention recommendations. > print |
| 001 | 281829 | ||
| 005 | 20251113125814.0 | ||
| 024 | 7 | _ | |a 10.1038/s41746-025-01996-2 |2 doi |
| 024 | 7 | _ | |a pmid:41145883 |2 pmid |
| 037 | _ | _ | |a DZNE-2025-01210 |
| 041 | _ | _ | |a English |
| 082 | _ | _ | |a 610 |
| 100 | 1 | _ | |a Jarchow, Hans |b 0 |
| 245 | _ | _ | |a Benchmarking large language models for personalized, biomarker-based health intervention recommendations. |
| 260 | _ | _ | |a [Basingstoke] |c 2025 |b Macmillan Publishers Limited |
| 336 | 7 | _ | |a article |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Journal article |2 DataCite |
| 336 | 7 | _ | |a Journal Article |b journal |m journal |0 PUB:(DE-HGF)16 |s 1763034905_32671 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a ARTICLE |2 BibTeX |
| 336 | 7 | _ | |a JOURNAL_ARTICLE |2 ORCID |
| 336 | 7 | _ | |a Journal Article |0 0 |2 EndNote |
| 520 | _ | _ | |a The use of large language models (LLMs) in clinical diagnostics and intervention planning is expanding, yet their utility for personalized recommendations for longevity interventions remains opaque. We extended the BioChatter framework to benchmark LLMs' ability to generate personalized longevity intervention recommendations based on biomarker profiles while adhering to key medical validation requirements. Using 25 individual profiles across three different age groups, we generated 1000 diverse test cases covering interventions such as caloric restriction, fasting and supplements. Evaluating 56000 model responses via an LLM-as-a-Judge system with clinician validated ground truths, we found that proprietary models outperformed open-source models especially in comprehensiveness. However, even with Retrieval-Augmented Generation (RAG), all models exhibited limitations in addressing key medical validation requirements, prompt stability, and handling age-related biases. Our findings highlight limited suitability of LLMs for unsupervised longevity intervention recommendations. Our open-source framework offers a foundation for advancing AI benchmarking in various medical contexts. |
| 536 | _ | _ | |a 353 - Clinical and Health Care Research (POF4-353) |0 G:(DE-HGF)POF4-353 |c POF4-353 |f POF IV |x 0 |
| 588 | _ | _ | |a Dataset connected to CrossRef, PubMed, , Journals: pub.dzne.de |
| 700 | 1 | _ | |a Bobrowski, Christoph |b 1 |
| 700 | 1 | _ | |a Falk, Steffi |b 2 |
| 700 | 1 | _ | |a Hermann, Andreas |0 P:(DE-2719)2811732 |b 3 |u dzne |
| 700 | 1 | _ | |a Kulaga, Anton |b 4 |
| 700 | 1 | _ | |a Põder, Johann-Christian |b 5 |
| 700 | 1 | _ | |a Unfried, Maximilian |b 6 |
| 700 | 1 | _ | |a Usanov, Nikolay |b 7 |
| 700 | 1 | _ | |a Zendeh, Bijan |b 8 |
| 700 | 1 | _ | |a Kennedy, Brian K |b 9 |
| 700 | 1 | _ | |a Lobentanzer, Sebastian |b 10 |
| 700 | 1 | _ | |a Fuellen, Georg |b 11 |
| 773 | _ | _ | |a 10.1038/s41746-025-01996-2 |g Vol. 8, no. 1, p. 631 |0 PERI:(DE-600)2925182-5 |n 1 |p 631 |t npj digital medicine |v 8 |y 2025 |x 2398-6352 |
| 856 | 4 | _ | |u https://pub.dzne.de/record/281829/files/DZNE-2025-01210%20SUP.pdf |
| 856 | 4 | _ | |y OpenAccess |u https://pub.dzne.de/record/281829/files/DZNE-2025-01210.pdf |
| 856 | 4 | _ | |x pdfa |u https://pub.dzne.de/record/281829/files/DZNE-2025-01210%20SUP.pdf?subformat=pdfa |
| 856 | 4 | _ | |y OpenAccess |x pdfa |u https://pub.dzne.de/record/281829/files/DZNE-2025-01210.pdf?subformat=pdfa |
| 910 | 1 | _ | |a Deutsches Zentrum für Neurodegenerative Erkrankungen |0 I:(DE-588)1065079516 |k DZNE |b 3 |6 P:(DE-2719)2811732 |
| 913 | 1 | _ | |a DE-HGF |b Gesundheit |l Neurodegenerative Diseases |1 G:(DE-HGF)POF4-350 |0 G:(DE-HGF)POF4-353 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-300 |4 G:(DE-HGF)POF |v Clinical and Health Care Research |x 0 |
| 914 | 1 | _ | |y 2025 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0200 |2 StatID |b SCOPUS |d 2025-01-01 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0160 |2 StatID |b Essential Science Indicators |d 2025-01-01 |
| 915 | _ | _ | |a Creative Commons Attribution CC BY 4.0 |0 LIC:(DE-HGF)CCBY4 |2 HGFVOC |
| 915 | _ | _ | |a IF >= 15 |0 StatID:(DE-HGF)9915 |2 StatID |b NPJ DIGIT MED : 2022 |d 2025-01-01 |
| 915 | _ | _ | |a JCR |0 StatID:(DE-HGF)0100 |2 StatID |b NPJ DIGIT MED : 2022 |d 2025-01-01 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0501 |2 StatID |b DOAJ Seal |d 2024-04-10T15:42:56Z |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0500 |2 StatID |b DOAJ |d 2024-04-10T15:42:56Z |
| 915 | _ | _ | |a WoS |0 StatID:(DE-HGF)0113 |2 StatID |b Science Citation Index Expanded |d 2025-01-01 |
| 915 | _ | _ | |a Fees |0 StatID:(DE-HGF)0700 |2 StatID |d 2025-01-01 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0150 |2 StatID |b Web of Science Core Collection |d 2025-01-01 |
| 915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
| 915 | _ | _ | |a Peer Review |0 StatID:(DE-HGF)0030 |2 StatID |b DOAJ : Anonymous peer review |d 2024-04-10T15:42:56Z |
| 915 | _ | _ | |a Article Processing Charges |0 StatID:(DE-HGF)0561 |2 StatID |d 2025-01-01 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0300 |2 StatID |b Medline |d 2025-01-01 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1110 |2 StatID |b Current Contents - Clinical Medicine |d 2025-01-01 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0199 |2 StatID |b Clarivate Analytics Master Journal List |d 2025-01-01 |
| 920 | 1 | _ | |0 I:(DE-2719)1511100 |k AG Hermann |l Translational Neurodegeneration |x 0 |
| 980 | _ | _ | |a journal |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a UNRESTRICTED |
| 980 | _ | _ | |a I:(DE-2719)1511100 |
| 980 | 1 | _ | |a FullTexts |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|