My server has a lot of shard listings and when I have put shard/crystals up they sell quick.

You have a choice. If you are leveling up crafting, you can buy them, or if they aren't available, farm just what you need. For lower levels, you can also farm them for money, as they sell better than a lot of the low items since many can be bought from vendors.

You say there is no market for shards right now on your server, I'm assuming you mean there are none on the market. That sounds like a perfect opportunity for you to make a lot of money. If on the other hand you mean there is not much profit to be made because there are so many people listing them, then cheap shards for you and you don't have to gather. Either way, I only see a win for you.