After you turn your Tx off, if the receiver still sending the last rc stick position the board cannot known there is a failsafe.
In this case you should setup the failsafe in your receiver.
The onboard failsafe works in case the receiver stop sending pulses or a wire is disconnected.
You can look at SystemHealth, if INPUT alarm goes Orange there is a board failsafe.