What Unit Frames do you use currently? And is only "lets the frames look differently depending if they are from me or not" acceptable? Or would Filtering (removing those you do not want to see) also be acceptable? If yes, try Aura Frames. Also ordering with letting your debuffs appear at the
front (Aura Frames can also do this) might be an option.