What’s costlier than increasing RAM?
Getting a GPU with higher RAM.

I’d say, we need to optimise for VRAM usage much more.