You can absolutely re-arrange party members.
Go to your party list (letter "O" shortcut for me) and in the lower left corner you will see up/down arrows. Highlight the party member you want to move and knock yourself out.