You can scroll down but like you said there is a limit on the amount of items shown which leads to the problem we both share, though I got around it by putting a load of my gear in my retainer not everyone has that choice, so I agree with you that something's needs to be done.

You solution of it being items from inv only is good or even better, they up the limit on how many are in the list.