While I agree in practice (and the resultant harm is real), in theory mathematical limits exist. (And this is without appealing to the idea that humans might eventually not be limited to a single planet.)