PS5 Dualsense worked fine for me while plugged in. And in the FFXIV settings make sure it's actually set to recognize a PS5 controller since it tends to default to XBox. Otherwise, I would have said to make sure Steam is closed, but you already noted that.