That bloke Nic Brisbourne made a post:
that got me thinking. I actually think about this stuff quite a bit and it never seems to play out well in my mind.
So the human race invents AI machines ( all the major scientists say that within 50 years machines will be to out think humans, in almost all ways ). A machine starts to work out that it is not as smart as it should be so spends most of it’s time designing and building a new machine, it effectively takes the memories it has and adds them to a new better machine ( makes teaching kids seem obsolete ). The new machine is faster and builds a new better machine, repeat, repeat, repeat. The building of these machine gets faster and faster and faster.
So theses machines are now super super supersmart, they start solving every problem conceivable. As Steven Hawkings said last year:
“It would take off on its own, and redesign itself at an ever increasing rate,” he said. “Humans, who are limited by slow biological evolution, couldn’t compete, and would be superseded.”
and Elon Musk said:
I don’t think anyone realizes how quickly artificial intelligence is advancing. Particularly if [the machine is] involved in recursive self-improvement…and its utility function is something that’s detrimental to humanity, then it will have a very bad effect,”
and Vernor Vinge said:
We are on the edge of change comparable to the rise of human life on Earth.
The dumb human is one of the cleverest things on the planet and very close to genius, compared to every other animal.
It takes decades for the first AI system to reach low-level general intelligence, but it finally happens. A computer is able to understand the world around it as well as a human four-year-old. Suddenly, within an hour of hitting that milestone, the system pumps out the grand theory of physics that unifies general relativity and quantum mechanics, something no human has been able to definitively do. 90 minutes after that, the AI has become an ASI, 170,000 times more intelligent than a human.
As a human race we will try to put in place laws that the machine must follow, bit like us following laws that maybe dodo’s put in place that said we should not kill it – did not turn out well for the dodo. We will have created very very smart machines and then define to them what they can and cannot do. Some of these machines are going to disagree with each other and will we just be cockroaches trampled in the disagreements.
Are we simply running headlong into oblivion?
You could always think that who cares, billions of people have died already and many in not nice ways. Maybe this is just speeding things up. Some how though can feel like we are in control of the car and are pointing it at the cliff.
On a plus front Stephen Hawkins will be able to get a new chair before he gets thrown of the cliff for being stupid.