LotA is something most groups just skate through, since the current gear level outstrips the encounters so much it's ridiculous. So a lot of players have a very "blah" attitude toward it.
The next one, ST, is similar, but you'll need to be iLevel 80 to do it, which isn't that hard to do.
The towers aren't hard. You should be worried if you actually DO start wiping in them.