Discussion about this post

User's avatar
Dangerous Bill's avatar

Now that I'm retired and no longer trying to save mankind, I can watch passing events like a disinterested spectator.

My first thought upon encountering AI was "the earliest and main application of Sparky will be to fire employees", which explains the vast amount of money and hype invested in an unproven technology. Right now, AI is mainly a reflection of the humans who train it, witness Elon Musk's NaziGrok/MechaHitler and its insistence on consulting Musk's political ideology before formulating an answer.

Sparky falls on its face hardest when confronted with questions involving hard technology (STEM). It's clear it skipped the science lectures, to the point of being dangerous.

Exhibit A, an exchange on Reddit from someone who asked Chatgpt how to clean an aluminum pan. Sparky said, just put lye in the pan with some water and heat it up. Well, if Sparky hadn't slept through the class on Group III elements, he would know that aluminum and lye react violently. Without waiting for external heat, the lye solution quickly boils, and vast amounts of explosive hydrogen are emitted.

If you are lucky, the bottom won't fall out of the pan, dousing you with boiling lye. (Fun fact: Drug cartels use boiling lye to dispose of corpses.)

Some academics, plagued by Sparky-written term papers and theses, have searched for solutions. AI-sniffing programs are popular and famous for malicious accusations against innocent students. Instead, some professors merely ask questions of students ABOUT THEIR OWN WORK. It appears that students who get Sparky to write their garbage don't bother to read the output before turning it in. Otherwise, why would they use AI at all, if they took their education seriously?

Still watching the advance of AI with morbid curiosity.

Expand full comment
Virginia's avatar

This is way more sophisticated than my analysis (I am just a lowly adjunct, having spent most of my life in clinical practice rather than education) but I do try to tell my students some of these things. Sadly, they do not care: All they see is the shortcut.

Students have of course always sought shortcuts but this one is probably the most seductive and destructive I have seen. In 20 years, that may not be the case (think Google, Wikipedia). Who knows? In the meantime, though, the uncritical adoption of every shiny new thing is fraught with the same kind of danger as that shortcut through the woods our parents warned us about.

Expand full comment
5 more comments...

No posts