This isn't really an issue, you started as a pugilist so you gotta finish as one.

Just restart and speedrun the first 20 floors or so if you want to change to monk.