Same thing happened to me recently, and I felt the same way. I told my therapist I fantasized about punching the guy, then apologized. She said, “Why the hell should you feel bad for wanting to threaten or hurt someone who was threatening and hurting YOU?” Yep. Right there.