I am in the same boat as you. I have a very demanding work schedule and very few days off, as well as a wife and 2 kids. I have to figure out what I want to focus on each time I log on. Right now its my relic weapon. (Stupid crystal grind) Soon it will be my last 2 ponies and I throw in a VA run once a week, every week. Savage raiding is out for me cause I cant devote the time so I just focus on keeping my ilvl up so I can clear normal content and story. Luckily I am in an awesome FC so accomplishing the goals I set for my limited play time isn't to much of a chore.

TLDR: Basically focus on what you want for your character and keep your Ilvl up to stay current with normal content and story.