You will always track the most recent 5 quests you have. If it is bothering you, you can go in to your Journal and select 5 quests that you want to follow, or select 5 Crafting leves, which will just highlight the guildleve npcs then.

If you're talking about removing icons for quests you haven't taken yet, there's no UI fix for it currently.