I would hazard a guess the hangup is with the way the overlay is done for FFXI--DX8, rendering to texture outside the normal frame buffer and all that mess (same reason AA doesn't work). If they ever give it the full rework to DX9, it might work somewhat in true fullscreen mode.

Raist