You can only release a retainer from service at a retainer bell, and you have to fill in a checkbox now to confirm.

EDIT: Worth repeating, you lose all items, crystals, and gil on a retainer when you release it.