The majority of my friends leaving is due to.. well, life, not even the game. Luckily, I tend to find new but one looks at the friend list with a sigh..
- - - Updated - - -
Another thing that sadly scares away new people, or returning people. I've seen such in various MMOs.