Given that wisdom and worldliness are opposite to ignorance, not necessarily intelligence I don’t think the OP is stating that the under/unprivileged people would be smarter by dint of their oppression.

However, maintaining bloody minded ignorance is not only hard work, but stupid. This is why tremendous effort is applied to keeping the ignorant in a culture that props up their ignorance.