👋 Home 📚 Library 📡 Posts 📓 Wiki 🗂️ Tables

Search

Pull for commands
📡 Posts 2023 01 31
Casey Gollan
♥ liked @ben@mastodon.adida.net 3 years ago
Ben Adida B
Ben Adida @ben@mastodon.adida.net · 3y 🐘

So OpenAI just released a detector of AI-generated text, I assume because of concerns in education / homework.

https://openai.com/blog/new-ai-classifier-for-indicating-ai-written-text/

Maybe this is good?

No, it's very bad.

They claim 26% true positives, 9% false positives. Assume 10% of submitted homework is chatgpt generated, you get the classic counterintuitive outcome of poor predictive power: if a homework is flagged, there's a 3:1 chance it's *human* generated.

This is going to cause a lot of harm. It should be immediately recalled.

OpenAINew AI classifier for indicating AI-written textWe’re launching a classifier trained to distinguish between AI-written and human-written text. We’ve trained a classifier to distinguish between text written by a human and text written by AIs from a variety of providers. While it is impossible to reliably detect all AI-written text, we believe good classifiers

Loading webmentions…