Managing Editor
@ShahidNShah
@ShahidNShah
Clinical Large Language Model Evaluation by Expert Review (CLEVER): Framework Development and Validation
The proliferation of both general purpose and health care–specific large language models (LLMs) has intensified the challenge of effectively evaluating and comparing them. Data contamination plagues the validity of public benchmarks, self-preference distorts LLM-as-a-judge approaches, and there is a gap between the tasks used to test models and those used in clinical practice.
Medigy Insights
Large language models (LLMs) can significantly improve how patients are matched to suitable clinical trials by enhancing retrieval accuracy and handling complex eligibility criteria at scale. This AI-driven approach could streamline trial recruitment, reduce manual screening effort, and help more patients access appropriate research opportunities.
Continue reading at ai.jmir.org
Make faster decisions with community advice
- A Community-Codesigned LLM-Powered Chatbot For Primary Care: A Randomized Controlled Trial
- Automated Feedback After Internet-Based Depression Screening: Cost-Effectiveness Analysis of a Randomized Controlled Trial
- Assessing the Quality of AI Responses to Patient Concerns About Axial Spondyloarthritis: Delphi-Based Evaluation
- Digital Hypertension in 2024–2025: Emerging Evidence and Future Directions
- Physical Examination Identification in Medical Education Videos: Zero-Shot Multimodal AI With Temporal Sequence Optimization Study
