> It’s almost always the headlines and PR pieces that exaggerate it.

That is definitely happening here.

https://jamanetwork.com/journals/jamainternalmedicine/fullar...

> evaluators did not assess the chatbot responses for accuracy or fabricated information

Yikes. (I do fault the researchers quite a bit for quietly slipping that little detail into a page-long "limitations" section.)