Security Champion Programs - Necessary? What works? What doesn't?

Let's discuss the merits, benefits, and challenges of Security Champions programs. What have you tried? What worked for you? What didn't work?

This will be an open discussion not a presentation so please bring your thoughts/ideas!