How about this for quick fix?

Get rid of totems altogether and allow players to build as they please and turn player-to-player damage off until things can get worked out.