A compiler also doesn’t “understand” like a human does, but it’s so accurate and reliable, that collectively we decided that a programmer doesn’t need to understand the output of the compiler any more. We can trust it, because it works perfectly reliable.

So the question isn’t so much whether AI “understands” the way a human understands things, but instead whether it will become reliable enough to be trusted. And I don’t see any evidence towards that yet.