Any kind of assistant can make mistakes. But a human assistant can be made to show their work and explain their reasoning to check their output. If ChatGPT says "this thing is totally legal" or "don't worry about that rash", how am I to validate it's "reasoning"? How do I know where it's drawing it's inference from?
Yeah, telling grammatically correct but factually wrong things, having biases, crashing into things, and whatnot.
> And lots of people would rather have a glorified assistant than nothing.
An assistant which can't be checked for accuracy, or for telling the truth.
The future is bright!