This is what the kick feature is for, If you allow it (or the group) then this is more or less your own fault (s)

I know in Jp data centers they will wait for people before starting fights most of the time, if you are afk to long, you get kicked.