Unfortunately most people will flame you for this despite Blizzard flat out saying the same thing. They don't consider it harassment if players don't put their harassers on ignore. It implies willingness to communicate with your supposed harassers which tells Blizzard you aren't terribly bothered by the contact.