I don't even care about the nautical terms, its that the two words are spelled almost exactly the same and It's confusing in a rush
This is exactly why sailors changed it from larboard to port. Because during a storm or in the heat of a battle, when somebody shouts "LARBOARD" from a distance, larboard sounds an awful lot like starboard. Hence the confusion and change.