You get that option only when an application gets blocked, and it doesn't hang around forever (nor does it stack, you don't get multiple options if you try to run multiple blocked apps): you have to click it when it's relevant, and if you don't, it disappears after a short while.