That's what high level retainers are for though. Although not all of the materials can be gathered by them (Blue Coral being the most annoying) they can get most of the materials. Plan ahead!