I'm already deeply pessimistic about what we achieved so far when it comes to machine intelligence. It's impossible to stop or reverse this progress and we're on the fast track to creating tools with the destructive potential of nuclear weapons which are simultaneously available to everyone with enough money.
Don't get me wrong, I'm not talking about mushroom clouds and some kind of machine uprising, the consequences will be far worse and more insidious.
We'll see completely new levels of manipulation, oppression and surveillance instead.
Any kind of tool will be abused, this tool might turn out to be too powerful for us to handle.
This is largely anecdotal, so make of it what you will:
I've observed high IQ scores to correlate more often with troubled lives than exceptional performance in job and status.
It seems to me that these people tend to extremes and environmental aspects play a strong role in how these tendencies develop.
Outright dismissing IQ would be detrimental, but its predictive value seems vague beyond some basic observations.
It's predictive to an extant. Many people who have taken up the mantel of IQ have taken it too far. And their (largely political) detractors have dismissed them merely because they have taken it too far. But much of it is still true from a more measured perspective.
Which has some very inconvenient / awkward implications for many people who are seeking to dismiss it outright, rather than dismiss particular proponents of it...
But taking any idea to the extremes, bulldozing over context and constraints of the data, and making grand generalizations from very simple base ideas is the bread and butter of politics, economics, and any bestselling non-fiction.
Popular discourse may be a tribal battle between extremes, but real life isn't...
Don't get me wrong, I'm not talking about mushroom clouds and some kind of machine uprising, the consequences will be far worse and more insidious. We'll see completely new levels of manipulation, oppression and surveillance instead. Any kind of tool will be abused, this tool might turn out to be too powerful for us to handle.