main hand weapon affect drop rates. so yes, you have to have the sword equipped