And if you retaliate an any way other that restraining them, then you will get done with assault with a deadly weapon... any person trained in fighting (boxers, MMA etc) will be treated this way.
Personally, I like to think of myself as an agile person, and not on the small side either... so if someone was able to push me to the ground, then I would imagine i was outmatched in a fight in a first place, so walking away would be the sensible option...