It cannot. Somewhere, there's some new hire doing something with it, and somewhere there is a flaw in its error-detecting coding. Happens all the time.
I remember doing a multi-product review for one of the computer magazines I wrote for in the 90s. Key to the review article was a huge spreadsheet with the names of the products in the first row, and comparison data and rankings of a long list of features in columns.
It took most of two weeks for me to test all of the products and build the spreadsheet. Now, I'm obsessive about saving such spreadsheets each time they are modified. I used a self-designed version control system to make certain I couldn't lose my work. As long as it was just me, that was no problem, but once I send the entire review to the magazine, I lost control over it.
Usually that wasn't a problem. But, for that particular article, it was a huge problem. At some point in the editing process, some assistant editor followed the instructions given to him by a senior editor and sorted the table alphabetically, based on the product names in the first row of the table.
New kid, I guess. He ended up selecting that row and having Excel sort it. But, he forgot to select all of the data before the sort. Then, he ignored the warning box from Excel and just clicked OK. So, the entire table got scrambled. Nobody at the magazine really knew and understood what was in that table, cell by cell. I did, of course, but my work was done and the magazine was in a frenzy to meet its deadline.
So, the article was published with the scrambled table. Nobody noticed what had happened. I didn't notice, because I didn't see the actual magazine until it was out and distributed. Even then, I didn't notice, because I was working on something else.
So, the day after the magazine hit the stands, I get a call from the Editor-in-Chief, yelling at me for screwing up the article. I listened. As soon as the problem was described to me, I knew exactly what had happend to that table. I explained, and immediately sent the Editor-in=Chief the table from my own computer, as I had sent it to them in the first place. I even explained what had happened and how.
I was off the hook, but I was also really, really pissed. They had skipped the step of having me check the article before it went to press. Too busy, they thought.
Anyway, someone got fired, the magazine got a black eye, and from then on every article was given a final readthrough by the author of the article, before the publication deadline. Every time.
AI software is no different. Some human is sending it prompts and should be checking the output for facts and logic. If that's not happening, the AI software is going to produce some worthless shit from time to time that is going to embarrass someone else. It's not really intelligent, and it can't safely operate autonomously. Until every learns that and behaves accordingly, there are going to be disasters.
= new reply since forum marked as read