I’m still in the “wow” phase, marveled by the reasoning and information that it can give me, and just started testing some programming assistance which, with a few simple examples seems to be fine (using free models for testing).
AI is fine with simple programming tasks, and I use it regularly to do a lot of basic blocking out of functions when I’m trying to get something working quickly. But once I get into a specialty or niche it just shits the bed.
For example, my job uses oracle OCI to host a lot of stuff, and I’ve been working on deployment automation. The AI will regularly invent shit out of whole cloth even knowing what framework I’m using, my normal style conventions, and a directive to validate all provided commands. I have literally had the stupid fuck invent a command out of thin air, then correct me after I tell it the command didn’t work about how that command didn’t exist and I needed to use some other command that doesn’t exist instead, or it gives me a wrong parameter list or something.
Hell, even in much more common AD management tasks it still makes shit up. Like, basic MS admin work is still too much for the AI to do in its own.
AI correcting the user is so insane. I’ve had Mistral’s agentic ai (Vibe) confidently tell me that you can’t, in Unity3D, implicitly cast a MonoBehaviour to a bool. Even though this has been a feature since before Unity 2018.
Not to mention I have to delete 90% of the code it generates because it doesn’t serve any function. I’m sure you can wrangle it to write some boilerplate for you but rest assured I’m not impressed by its capibilities.
AI is fine with simple programming tasks, and I use it regularly to do a lot of basic blocking out of functions when I’m trying to get something working quickly. But once I get into a specialty or niche it just shits the bed.
For example, my job uses oracle OCI to host a lot of stuff, and I’ve been working on deployment automation. The AI will regularly invent shit out of whole cloth even knowing what framework I’m using, my normal style conventions, and a directive to validate all provided commands. I have literally had the stupid fuck invent a command out of thin air, then correct me after I tell it the command didn’t work about how that command didn’t exist and I needed to use some other command that doesn’t exist instead, or it gives me a wrong parameter list or something.
Hell, even in much more common AD management tasks it still makes shit up. Like, basic MS admin work is still too much for the AI to do in its own.
AI correcting the user is so insane. I’ve had Mistral’s agentic ai (Vibe) confidently tell me that you can’t, in Unity3D, implicitly cast a MonoBehaviour to a bool. Even though this has been a feature since before Unity 2018.
Not to mention I have to delete 90% of the code it generates because it doesn’t serve any function. I’m sure you can wrangle it to write some boilerplate for you but rest assured I’m not impressed by its capibilities.