As someone said, learn his cards and number sides. Then form a deck for his weak sides, and bait his good sides. I still hate Swift, even after getting all his cards. Win rate is always nearly 50% I think, no strategy because of Chaos. Even with a 3star deck he can wreck you because of that lovely Shiva card that you can only defend against 1 side, and flipped by all others.
Also this is what you're looking for:

http://forum.square-enix.com/ffxiv/t...ft-hate-thread