Whether you’re looking for medical advice or tips on industrial agriculture, one thing is abundantly clear: never trust an AI chatbot without first getting a second opinion, preferably from a human who has actual expertise in the topic.
That’s the takeaway from an incident in the small city of Chuzhou, China, after a large langue model dispensed some advice that led to the untimely death of 25 acres worth of produce.
According to the Taiwanese publication CTWANT, a 67-year-old farmer surnamed Wu decided to start consulting an AI chatbot for advice nearly a year ago. He was reportedly skeptical at first, though the farmer began to let his guard down after some early successes with the AI’s farming tips.
Since that time, Wu has come to rely on his LLM for everything from fertilizing guidance to scheduling various tasks around the farm. After months of fruitful consultations, he decided to follow his AI chatbot’s new pesticide plan to the letter, letting loose on some 25 acres of precious sesame seedlings, all without ever double-checking with an expert or outside documentation.

