Clocks must not stop even when either of the player leaves the game