Maybe that's because people interact with their guild and friends rather than random strangers?
Also you definitely can add people from other servers to your friendslist. The game does also prioritize putting you on the same shard as friends, guildies and people from your server. It just also tries to balance the H:A ratio.
CRZ is problematic, but "social interaction" is not it.