When Can You Interrupt A Speaker?