You can reach the items without the Toil but you'll waste attempts digging them reachable depending how high gathering one has.