You can play this game without gear swapping. You just won't be as effective as the players that do. You won't be helpless either, as long as your set is good. If you're okay with that, good.
I don't do much gear swapping myself. I could never really garner enough interest to figure it out. I have a Chakra set that I'm pretty proud of, but oddly that's like the one thing most Monks don't care enough to gear swap for. I also have a Cursna set for my WHM. But I get by. I seem to accomplish the goals I set out to accomplish, and I have fun.