Designing and Evaluating an LLM-based Health AI Research Assistant for Hypertension Self-Management; Using Health Claims Metadata Criteria
conference paper
Hypertension is a condition affecting most people over 45 years old. Health Self-Management offers many opportunities for prevention and cure. However, most scientific health literature is unknown by health professionals and/or patients. Per year about 200.000 new scientific papers on cardiovascular health appear, which is too much for a human to read. Hence, an LLM-based Health AI research assistant is developed for mining scientific literature on blood pressure and food. A user evaluation was conducted with n=8 participants who just completed an intensive lifestyle intervention for blood pressure self-management. They highlighted several challenges and opportunities for a Health AI, especially regarding claim transparency, data quality and risks of hallucinations. In the discussion we propose seven criteria using metadata and information characteristics to help evaluate ambiguous or conflicting health science claims.
Topics
TNO Identifier
996240
ISBN
978-961-286-871-0
Publisher
University of Maribor, University Press
Source title
37th Bled eConference – Resilience Through Digital Innovation: Enabling the Twin Transition: June 9 – 12, 2024, Bled, Slovenia, Conference Proceedings
Editor(s)
Pucihar, A.
Borštnar, M.K.
Blatnik, S.
Bons, R.W.H.
Smit, K.
Heikkilä, M.
Borštnar, M.K.
Blatnik, S.
Bons, R.W.H.
Smit, K.
Heikkilä, M.
Place of publication
Maribor
Pages
283-298
Files
To receive the publication files, please send an e-mail request to TNO Repository.