If the tribe can do something to remove the building from the land if they want, I don't see a reason why not. An artificial restriction like only being able to build on tribal land that is yours, period, I think goes against the spirit of the game.