I wouldn't say restrict ALL of them, but I'd be fine with restricting a few more for the sake of class uniqueness.

There are skills however that cross-class very well like Feint as well as skills we need for Incapacitation. If you restricted those it would make things like incapacitation harder, especially with the 8-player group restriction. It wouldn't be extremely helpful if you HAD to bring a certain class along just to incapacitate and then just take up space after that.