> I think actually the problem is it always answers confidently

This isn't a problem restricted to ChatGPT, there are humans who display this trait too. This might be appealing at a superficial level, but if you start believing speakers with this trait it's a slippery slope. A very slippery slope.

I'm trying really hard to avoid Godwin's law, so let me suggest that Elizabeth Holmes could be one example of this.