Tbf, putting buildings up signalling use didn’t suddenly cause conquerors of any geographic to suddenly respect that the land was already in use. See: Roman Imperial Expansionism, Mongol Empire, numerous Chinese dynasties, the Aztecs, the Nazis, the British Empire, the East India Companies, the Zulu, Mali (well Mansa Musa basically destabilized gold wherever he went).