Yes, just login via Steam on new computer.
But, you should export your System Configuration and Character Data via Character Screen first, or you will loose all your hotbar / gui settings etc.
Just click both of the two icons near you character name to upload each of these two, system settings and character settings to the ffxiv server, so you can later import them again.