K-12 IMPLOSION UPDATE: New York City schools ban AI chatbot that writes essays and answers prompts.

New York City schools have banned ChatGPT, the artificial intelligence chatbot that generates human-like writing including essays, amid fears that students could use it to cheat.

According to the city’s education department, the tool will be forbidden across all devices and networks in New York’s public schools. Jenna Lyle, a department spokesperson, said the decision stems from “concerns about negative impacts on student learning, and concerns regarding the safety and accuracy of contents”.

ChatGPT was created by OpenAI, an independent artificial intelligence research foundation co-founded by Elon Musk in 2015. Released last November, OpenAI’s chatbot is able to create stunningly human-like responses to a wide range of questions and various writing prompts. ChatGPT is trained on a large sample of text taken from the internet and interacts with users in a dialogue format.

According to OpenAI, the conversation format allows ChatGPT “to answer follow-up questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests”. Users can request rephrasings, summaries and expansions on the texts that it churns out.

The decision to ban the chatbot in New York schools comes amid widespread fears that it could encourage students to plagiarize.

ChatGPT seems very limited right now, but it’s only going to get smarter:

The bot doesn’t work perfectly. It has a tendency to “hallucinate” facts that aren’t strictly true, which technology analyst Benedict Evans described as “like an undergraduate confidently answering a question for which it didn’t attend any lectures. It looks like a confident bullshitter that can write very convincing nonsense.”

It’s the early days — Skynet isn’t smiling just yet, but it will eventually.