Asking nicely clearly doesn't help, so as I see you really only have two options:
1) Just leave together with the other members who want to do so.
2) Give the current FC owner an ultimatum: Either he shapes up as leader quickly, or hands over the leadership to someone else - or the lot of you will leave. And then stick to it.