D-Pad keys without holding down either L2 or R2(Or both if you use the additional bar option) will either switch between whatever filter settings targets you have with the left/right and through party with the up/down. So, you could be pressing those without meaning to.