You might want to consider changing. On my server when I am randomly up at 5-6am I notice a huge population drop from late night/early morning to day time. Some servers for example a few JP servers have a good group of NA players/FC that it wouldn't make a difference of time zones. If you are having that hard of a time I would switch only way I wouldn't is if I had close friends/old LS members that moved to that server specifically.