This has been bothering me as well. There really needs to be a button to forfeit the game and make it an automatic loss...