Untrue Atreyu. Only those that also are "Vulnerable" would be able to even touch the totem. And with a large HP, it would take a LOT of players to actively attack the Aggressors totem without siege weapons to cause much of a dent in it. And if they do, well then, it's up to the Aggressor's Tribe to also defend their own Totem.
No reward without the risk, no pain, no gain.