@iScienceLuvr
Google did a prospective clinical study of their AMIE medical LLM chatbot in the clinic! They used AIME to conduct clinical history taking and present potential diagnoses for patients to discuss with their provider at urgent care appointments at Beth Israel Deaconess Medical Center. Blinded assessment of AMIE and primary care provider differential diagnosis (DDx) and management (Mx) plans suggested similar overall DDx and Mx plan quality, without significant differences for DDx (p = 0.6) and appropriateness and safety of Mx (p = 0.1 and 1.0, respectively). "PCPs outperformed AMIE in the practicality (p = 0.003) and cost effectiveness (p = 0.004) of Mx. "