If you weren't rude to them, then you wouldn't need to worry about a suspension.

If you go AFK, the game kicks you after 10 minutes. If you go AFK for shorter than that, the party can kick you because AFK is one of the available kick reasons.