It's because glamour plates are stored in a separate database, and just like the glamour dresser inventory, retainers, etc. accessing this additional database in a zone with enemies and battle data would strain the servers.