.Nature Medicine, Released online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although sizable language designs (LLMs) present guarantee in controlled environments, a study right now reveals their restrictions in real-world clinical applications as well as points the way towards robust analysis and benchmarking prior to clinical usage.