Proposal to use `interlock_wait_time`
from the official docs https://esphome.io/components/switch/gpio.html
>interlock_wait_time (Optional, Time): For interlocking mode, set how long to wait after other items in an interlock group have been disabled before re-activating. Useful for motors where immediately turning on in the other direction could cause problems.
I think it's worth to consider the usage, as about the value I took it from Shelly 2.5 example https://esphome.io/components/cover/current_based.html?highlight=interlock_wait_time
Maybe 200ms it's a bit too much.