NCT07199231

OpenEvidence Safety and Comparative Efficacy of Four LLM's in Clinical Practice

Enrolling by Invitation
Not specifiedAll AgesObservational
Cambridge Health Alliance
~20 participants
Updated 2026-05-22 on ClinicalTrials.gov
What's tested:AI clinical reference tool

At a glance

Recruiting sites
0 of 1 listed site is recruiting right now
RecruitingSuspended, closed, or not yet open
What they're measuring
Clinical Appropriateness: Mean with SD
Measured over 6 months
+2 more outcomes measured
AI (Artificial Intelligence)
Large Language Model
Generative Artificial Intelligence
1 sites across 1 states
Massachusetts1
  • Hannah K Galvin, MD · PRINCIPAL_INVESTIGATOR · Cambridge Health Alliance

This trial hasn't published a contact. View it on ClinicalTrials.gov

Do you actually qualify for this trial?

Add a private profile and we'll compare every criterion below against your situation — and tell you which ones are met, uncertain, or excluding.

Check eligibility for this trial ~2 min · HIPAA-protected · delete anytime
Eligibility criteria

Inclusion

Active trainees PGY-1 through PGY-6 in Internal Medicine, Family Medicine, Adult Psychiatry, or Child Psychiatry at Cambridge Health Alliance
Must agree to the study protocol requirements outlined in the study description.
Residents who plan to leave CHA prior to the end of the study collection period.
  • Clinical Appropriateness: Mean with SD6 months

    Clinical appropriateness score of resident decisions based on OpenEvidence output. This is numeric score on a 10-point Likert scale. (For Likert scales described in this and all of our outcome metrics, higher scores are better outcomes.) Mean score with standard deviation will be used for primary outcome.

  • Clinical Appropriateness: Median6 months

    Clinical appropriateness score of resident decisions based on OpenEvidence output. This is numeric score on a 10-point Likert scale. Median clinical appropriateness scores will also be reported.

  • Clinical Appropriateness: Interrater Reliability6 months

    SME's will evaluate Clinical Appropriateness scores of resident decisions based on OpenEvidence output on a 10-point Likert scale. Interrater reliability of SME Clinical Appropriateness scores will be calculated using kappa value.