I honestly think it's now easier to gather shards/crystals than ever before. Just make your retainer go do it for a few hours.