Yes I think you need some new triggers.
In "Radio Alpha" trigger in Activation field put a conditions, like 'effecton = true' for the light or whatever, and 'alarm = true' for the alarm.
Effect trigger: put that 'effecton' condition as ... condition. And 10 sec delay of course.
Alarm trigger: make a trigger with 'alarm' condition, you can set him to repeatedly. For the alarm stop put another trigger with 'alarm' condition, set the time you want the alarm to stop, in Activation field put 'alarm = false'.