This is exactly what I do.
The group of friends I play with also think I'm weird with how I move around...I changed the Q/E strafe keys to A/D and removed the default A/D completely...and I can only move my char if I have RMB held in. They all think I'm weird but I don't see how they can play with the default movement system. It's so weird and clunky to me.
