If you are using Windows (Windows 7 specifically), right click on your volume icon on the lower right and click on "Mixer" or "Open Volume Mixer", then look for FFXIV and click mute.