Well, no. Raids and dungeons are there own thing entirely and don't use cross-realm phasing like the outside world. The raid leader can invite anyone anywhere, but that person doesn't phase onto the raid leaders realm until the are close by or, in a raid instance. Unless you are actively 'realm hopping' you wouldn't notice any difference.