Yes, equip it.
After equipping it, it says something like "74-70" on the weapon above your rank (which results in 4)
and something like "12" on the weapon below your rank.

12 is better than 4, so..usually the lower one is better unless you are VERY close to the optimal rank (1-2 ranks below).