After all, no matter how "big" those Minor Sects get, they only have a few people, at most a dozen or so.
So if you want to remember these Minor Sects, the names of these ten-odd people will be extremely easy to memorize.
But let's put those Minor Sects aside. Those Major Sects casually have several thousand up to ten thousand people. There's even one Major Sect that doesn't have any particular standout trait—its only characteristic is sheer numbers, more than twenty thousand disciples. Even though in this expedition outside the Wall they suffered losses and only one or two thousand remain, they still outnumber those Minor Sects.
And the reason this Sect has so many people is that it has enough resources to feed that many mouths. Though they have neither Alchemy nor Artifact Refining masters, and the disciples are just purely cultivating, that alone is already remarkable. A Sect that can support more than ten thousand disciples in battle is no small feat.
