Just say "Whoops, my house is on fire, gotta go" before you leave the party.