Since very, very few peeple will have the combination of madness, drive and techincal skill to be part of the "faction" they should not be a big problem, but they are good enought for some dramatic tension in a fic or two... And for untold myths and paranoia conspiracies that overstate their danger by several magnitudes...