Sparky, removing a totem just to replace it with another isn't a very good idea, each totem is given a unique ID, and everything built inside that totems range is tied to that unique ID, replace that totem and none of the buildings will belong to the new totem.
It's that bad that you can't even build on top of any of the older buildings, I reclaimed an old tribe ground of mine on War and had to dismantle everything just to be able to place any new building projects in there, even had to get the guides in to move my totem so I could replace the floor it was sitting on.