That is correct, but it’s also kinda beside the point. A compiler doesn’t “understand” anything either, it’s just a program, but it’s still very useful. So useful in fact that most programmers nowadays trust it unconditionally to the point where we say “a programmer doesn’t need to understand the code the compiler outputs”.
But AI is just really not trustworthy, and the question is whether they will ever be trustworthy enough that we can say “The programmer doesn’t need to understand the code the AI outputs”.
(The AI does not, in fact, understand it. The AI doesn’t understand anything at all. It’s a statistical text prediction machine.)
That is correct, but it’s also kinda beside the point. A compiler doesn’t “understand” anything either, it’s just a program, but it’s still very useful. So useful in fact that most programmers nowadays trust it unconditionally to the point where we say “a programmer doesn’t need to understand the code the compiler outputs”.
But AI is just really not trustworthy, and the question is whether they will ever be trustworthy enough that we can say “The programmer doesn’t need to understand the code the AI outputs”.