One of my recent customers had GPT tell them to attach the black (hot) wire to one terminal of a switch and the white (neutral) wire to the other. If you know the slightest thing about electricity, you’ll know that this results in a dead short from hot to neutral when the switch is closed (aka not good, best case pops the breaker, worst case electrical fire)

1

The illusion people have that these LLMs are legitimate superintelligences like some people would have you believe and not just word-guessing machines is going to get people killed if it hasn’t already

1