Many people assume AGI/Superintelligence will solve all problems. But what if AI tells us Socialism, and banning Billionaires is the best way forward?
One of the paradoxes of the trillions being poured into the AI race is that "winning" the race means AGI, but no one has given much thought to what comes next. It's assumed that as this future AI will be super-intelligent, it will be passively and automatically obeyed. But the world's not like that.
Some people prefer to be ruled by low-IQ dumbos and resent experts. What makes you think these people will listen to a super-intelligent AI? Above-average IQ humans already make them scared, resentful, and angry.
So unless you make this supersmart AI a dictator, what difference does it make how smart it is if no one wants to listen to it?
That is why open source models and open weights matter.
I know open source but can you explain what open weights means in this context?
Weights are a way to control an LLM’s output by changing how strongly concepts are linked. It’s more complicated than this, but you can ‘weight’ it to avoid linking the concepts “best way forward” and “socialism”.
If you can program an AI 'what' to think then it's not AI. It's just a really expensive opinion influencer and mouthpiece for whoever paid for it.