The right of the many to feel safe overrides the right of the few who would choose to be safe, if they were given that choice.
But seriously, it's not about the right to feel safe, it's about petty tyrants who feel they have the right to control others.