To be fair we've always had to carry arrow stacks of various kinds in past FF titles. I think a scavenge type skill would work nicely if they dont already have that. Just make it so the ability doesnt give large amounts at once.

Besides, once arrows of various damage and stat debuff types work, wont you guys have to carry stacks of different arrows anyway?