I may be way off here, but in my limited time with the game it seems like certain classes are just hard counters for other classes. For example, as a conqueror I have no problem dealing with vanguards, but the hybrids and assassins are much more difficult for me to fight. Meanwhile my raider handles those more easily but has a tough time with heavies.