After swimming with a group for several minutes, all surrounding players disappear until the camera angle is adjusted to a specific angle. This can make it difficult for players to stay grouped together.

Of the three of us swimming, two of us suffered from this problem and it started around the same time across multiple zones in the lake.