You are taking that to mean non-violence, which is not what it means. It is referring to personal retaliation, not self-defense against criminal activity. When Jesus says that we are to love our enemies, he is not telling us to love the enemy at the expense of our family's safety and well-being.
The context of the passage has nothing to do with the military and it has nothing to do with protecting our families. It is about not retaliating against offenses to personal honor, not retaliating with law suits for minor personal offenses, not to retaliate when we are persecuted. It is about not taking out revenge on others, but to extend the love of Christ.
It is NOT intended to mean that if our family is in danger from an assailant that we are to simply hand them over to said assailant. That is not loving your enemy, nor is it loving one's family. It is a dereliction of Christian, manly duty before God and you will face judgement before God for mistreating your family in that way. I would not want to be in your shoes if you give your family over to an assailant.
You have a very sloppy, extremist, irresponsible and sinful approach to this matter. It is, at its heart, very unchristian and is not in keeping with Scripture.
Pacifism is a secular, worldly concept. You are trying to pencil a sinful, worldly concept into the Bible and so far, no authentic Christian is buying into it.