Cheer up buttercup!
DF will always have its woes.
If you want to decrease your woes, queue with friends.
Don't have friends? Try to make some. Mor Dhona is a good place to meet people!

It's possible from your story that you were actually the one making it a rough run for others! Just remember that you can't force people to play the way you want them to.
For example, Limit Breaks are not requirements for most Duties and can really be casted whenever without seriously impacting your ability to complete the duty successfully!
If you have high expectations from Duty Finder you will get disappointed all the time. It's a game so you should try to have fun and not let bad DFs bring you down.

If you insist on being a negative nilly, you could always level up in FATEs, where you could play alone if you wanted to.