AI is eating itself: Bing's AI quotes COVID disinfo sourced from ChatGPT (TechCrunch)

[muriel_volestrangler]

5. So this seems to revolve around the question being "write like Mercola"

and that's what it did, originally, and what it has done, again. Yes, the second time, it's added uses of its original effort, but that's not wrong - it is still "in the (untruthful) style of Mercola". It's not that it can't tell the difference between real and fake, it's that it will produce fake writing when ordered to. And any qualifications could be removed by a malicious actor before they spread it anyway.

This is not "artificial intelligence" in a general sense, it's "imitate a genre of writing, using claims I give you". It causes a problem because previous bots wrote English so badly, we could recognise them (even if some people who wished to believe what the bots wrote couldn't).

"For that reason, queries like these should probably qualify for a “sorry, I don’t think I should answer that” and a link to a handful of general information sources. (We have alerted Microsoft to this and other issues.)"

Well, yes, in an ideal world; but that's asking this program to have a better ethical sense than the average Republican voter.