You can't use the mouse buttons in the keybind setting since that's also used for setting and unsetting them, so the LMB+RMB is set in stone.
Plus there are times you'll need to click on things and not move!