A new Coddy Developer Survey found that four in five developers, 80%, say their use of AI has felt more like a dependence than an advantage.
A new Coddy Developer Survey found that four in five developers, 80%, say their use of AI has felt more like a dependence than an advantage.
Basically the same conclusion I came to. Which is terrifying when you think of all the devs who depend and all the money thats riding on it.
And syntax is the kind of thing llm’s should be awesome at. If they can’t even get that right we’re all cooked.
In fairness, this was all on a switch, where the commands are very tightly tied to the vendor and their underlying in-house shell. So commands may vary by release greatly. I was already explicitly telling the bot what software version and licenses I had, but ultimately I had to resort to the CLI’s help function at times and tell the bot “The command you gave me didn’t work. Here’s where it broke, and here’s the commands it will accept”. Given that information, it could (generally) figure it all out.
I dunno if you had this experience but the one I used made up commands if it didn’t know them.
It basically hallucinated them.