Working as intended.
You can't start immediate kick, its at least 2 minutes.
If you forced your party members to wait you for that long, you deserve to be kicked.
Kick gives you deserter debuf if you was kicked before any action. This was made to prevent people from sitting on their butt at the beginning of the dungeon saying "I don't like this dungeon, kick me". With this system there is no reason for them whether to leave by themselves or to be kicked.
This situation would NEVER happen to someone who does everything fair, because if you are inside dungeon and not afk, you can not be kicked within 15 minutes.
There are some additional mechanics in lfg system which can be used for good or evil purposes, but overall most of them are quite logical.