I think the analogy is more apt when comparing a fencer trying to box with their foil. If the gold medal fencer is also an olympian boxer due to years of training (FFXIV equivalent of levelling-up), then yes, it is entirely feasible that by dropping a foil and picking up boxing gloves they will be quite formidable at boxing.