I completely agree.
Back on Tonberry my FC house would get raided once a month by people that would just eat all our food and leave.
It would also clean up the presentation a bit because if you can't interact with the item it won't have that arrow hovering over it.