OpenAI finally admits they created a problem with ChatGPT, but they can't fix it [View all]

[highplainsdem]

From Gizmodo: OpenAI’s New AI-Detector Isn’t Great at Detecting AI

https://gizmodo.com/open-ai-chatgpt-ai-text-detector-1850055005

OpenAI, the artificial intelligence company behind viral text-generator ChatGPT, has released a new AI tool intended to help manage the mess wrought by its previous creation. Unfortunately, it’s not very good.

-snip-

However, in OpenAI’s own tests, the tool only correctly identified generated text as “likely AI-written” about a quarter of the time. Moreover, about one in ten times, the classifier falsely lists human-made words as computer-generated, the company noted in a blog post.

-snip-

OpenAI admits that ChatGPT has thrown a complicating wrench into classrooms, newsrooms, and beyond—where the tool and others like it have stoked fears of rampant cheating, misleading info, and copyright violations. In response, the company now says it wants to help. “We recognize that identifying AI-written text has been an important point of discussion among educators, and equally important is recognizing the limits and impacts of AI generated text classifiers in the classroom,” the company said in its Tuesday blog. “While this resource is focused on educators, we expect our classifier and associated classifier tools to have an impact on journalists, mis/dis-information researchers, and other groups.”

But in its current form, this new detection tool probably still isn’t accurate enough to meaningfully address growing concern over AI-enabled plagiarism, academic dishonesty, and the propagation of misinformation. “Our classifier is not fully reliable,” the company wrote. “It should not be used as a primary decision-making tool.”

-snip-

Gizmodo also tested the new AI-detector and got dismal results. They point out OpenAI is in a race with itself, with each improvement making it harder to detect.

It was IMO criminally stupid and reckless of OpenAI to release ChatGPT, given the problems and disruptions it started causing immediately.

Any 10--year-old could have informed them that it would immediately be used for cheating in school.

And tossing software that will tempt employers to replace workers with free AI was the economic equivalent of lighting a match in a fireworks factory.

But at this point OpenAI sounds mainly concerned - though nowhere near as concerned as they should be if they were operating ethically - about education...but they want teachers to help bail them out.

From the blog post Gizmodo cited:

https://openai.com/blog/new-ai-classifier-for-indicating-ai-written-text/

We recognize that identifying AI-written text has been an important point of discussion among educators, and equally important is recognizing the limits and impacts of AI generated text classifiers in the classroom. We have developed a preliminary resource on the use of ChatGPT for educators, which outlines some of the uses and associated limitations and considerations. While this resource is focused on educators, we expect our classifier and associated classifier tools to have an impact on journalists, mis/dis-information researchers, and other groups.

We are engaging with educators in the US to learn what they are seeing in their classrooms and to discuss ChatGPT’s capabilities and limitations, and we will continue to broaden our outreach as we learn. These are important conversations to have as part of our mission is to deploy large language models safely, in direct contact with affected communities.

If you’re directly impacted by these issues (including but not limited to teachers, administrators, parents, students, and education service providers), please provide us with feedback using this form. Direct feedback on the preliminary resource is helpful, and we also welcome any resources that educators are developing or have found helpful (e.g., course guidelines, honor code and policy updates, interactive tools, AI literacy programs).