Publication:
A cross-sectional study on ChatGPT's alignment with clinical practice guidelines in musculoskeletal rehabilitation

dc.contributor.authorSAFRAN E.
dc.contributor.authorYILDIRIM S.
dc.date.accessioned2025-05-20T21:50:34Z
dc.date.issued2025-12-01
dc.description.abstractBackgroundAI models like ChatGPT have the potential to support musculoskeletal rehabilitation by providing clinical insights. However, their alignment with evidence-based guidelines needs evaluation before integration into physiotherapy practice.ObjectiveTo evaluate the performance of ChatGPT (GPT-4 model) in generating responses to musculoskeletal rehabilitation queries by comparing its recommendations with evidence-based clinical practice guidelines (CPGs).DesignThis study was designed as a cross-sectional observational study.MethodsTwenty questions covering disease information, assessment, and rehabilitation were developed by two experienced physiotherapists specializing in musculoskeletal disorders. The questions were distributed across three anatomical regions: upper extremity (7 questions), lower extremity (9 questions), and spine (4 questions). ChatGPT\"s responses were obtained and evaluated independently by two raters using a 5-point Likert scale assessing relevance, accuracy, clarity, completeness, and consistency. Weighted kappa values were calculated to assess inter-rater agreement and consistency within each category.ResultsChatGPT\"s responses received the highest average score for clarity (4.85), followed by accuracy (4.62), relevance (4.50), and completeness (4.20). Consistency received the lowest score (3.85). The highest agreement (weighted kappa = 0.90) was observed in the disease information category, whereas rehabilitation displayed relatively lower agreement (weighted kappa = 0.56). Variability in consistency and moderate weighted kappa values in relevance and clarity highlighted areas requiring improvement.ConclusionsThis study demonstrates ChatGPT\"s potential in providing guideline-aligned information in musculoskeletal rehabilitation. However, due to observed limitations in consistency, completeness, and the ability to replicate nuanced clinical reasoning, its use should remain supplementary rather than as a primary decision-making tool. While it performed better in disease information, as evidenced by higher inter-rater agreement and scores, its performance in the rehabilitation category was comparatively lower, highlighting challenges in addressing complex, nuanced therapeutic interventions. This variability in consistency and domain-specific reasoning underscores the need for further refinement to ensure reliability in complex clinical scenarios.Clinical trial numberNot applicable.
dc.identifier.citationSAFRAN E., YILDIRIM S., "A cross-sectional study on ChatGPT's alignment with clinical practice guidelines in musculoskeletal rehabilitation", BMC MUSCULOSKELETAL DISORDERS, cilt.26, sa.1, 2025
dc.identifier.doi10.1186/s12891-025-08650-8
dc.identifier.issn1471-2474
dc.identifier.issue1
dc.identifier.pubmed40275229
dc.identifier.scopus105003495030
dc.identifier.urihttps://hdl.handle.net/20.500.12645/40639
dc.identifier.volume26
dc.identifier.wosWOS:001475396600005
dc.rightsinfo:eu-repo/semantics/openAccess
dc.subjectTıp
dc.subjectDahili Tıp Bilimleri
dc.subjectİç Hastalıkları
dc.subjectİmmünoloji ve Romatoloji
dc.subjectCerrahi Tıp Bilimleri
dc.subjectOrtopedi ve Travmatoloji
dc.subjectSağlık Bilimleri
dc.subjectMedicine
dc.subjectInternal Medicine Sciences
dc.subjectInternal Diseases
dc.subjectImmunology and Rheumatology
dc.subjectSurgery Medicine Sciences
dc.subjectOrthopedics and Traumatology
dc.subjectHealth Sciences
dc.subjectOrtopedi
dc.subjectKlinik Tıp
dc.subjectKlinik Tıp (Med)
dc.subjectRomatoloji
dc.subjectOrthopedics
dc.subjectClinical Medicine
dc.subjectClinical Medicine (Med)
dc.subjectRheumatology
dc.subjectAyak Bakımı
dc.subjectOrtopedi ve Spor Hekimliği
dc.subjectPodiatry
dc.subjectOrthopedics and Sports Medicine
dc.titleA cross-sectional study on ChatGPT's alignment with clinical practice guidelines in musculoskeletal rehabilitation
dc.typearticle
dspace.entity.typePublication
local.avesis.idaa3483cf-4e54-4961-b8af-792cc12f4509

Files