Since SE is trying to maintain a realistic sense of physics within Eorzea, it would be strange if you were able to swim normally while wearing 100 pounds of metal armor.