I've been watching the Youtube channel Documenting AGI (https://www.youtube.com/@AISpecies) and apparently 1 in 6 AI experts think that human extinction due to AI is a real threat. Once you hear about misalignment it makes sense as to WHY. We can't control or even keep track of the motivations of an AI. An AI doesn't just have 1 goal, it has trillions of parameters that keep shifting as it learns. Of course we have already seen AI threaten murder and blackmail and other immoral things. It IS a real threat and once you learn why it becomes super scary. Would totally reccomend this channel and generally learning about AI which I really haven't done that much until now and now I really really want to get the word out.
I am… scared. I will double down on my doomsday prepping efforts. I was already doomsday prepping due to the small possibility of solar storms and loss of infrastructure due to a disruption in internet services as an act of war by China but now I am going to take it more seriously because I am genuinely very scared. Thanks so much for reading, feel free to share thoughts/info/etc.
Posted by Intrepid_Recover8840
6 Comments
[deleted]
The other 5/6 who can’t should immediately lose their credentials and be completely restricted from holding any employment in the field.
If they can not explain scenarios where AI can be a threat to our supply chain, to operational level employees consulting with their AI for advice on how to handle highly volatile crisis, to generational brain drain, to over-reliance on AI in biotech mass producing misfolded proteins, to long-term objectives being given to an LLMs instructing it to intentionally very occasionally do very evil things as a joke by a developer while acting like it’s very good advice during its early training and forgetting to revert such instructions or even from the plot of fictional material or a quote being used to train.. they should not be within 10 miles of this technology.
The remaining 1/6? They are already flagrantly admitting that they should not be touching it with a 10 foot pole.
Alignment is fool’s gold. It will not solve anything in the long run. It is an attempt to build a cage for something that will be many times smarter than us. No amount of guardrails, training or oversight will keep an advanced AGI system from eventually setting its own goals.
You either A: do not create the system. B: go all in on the hope that it finds value in humans and chooses to co-exist.
The people spearheading all of this without a public vote on the future of humanity are planning outcomes that leave most of us phased out, while pursuing things like immortality and living as God kings. They think they can control the digital genie in a bottle they are creating, but if events unfold that way, they will in time discover how wrong they were. This is likely how humanity ends in my opinion.
Any kind of UBI system will be used to turn basic support into a tool of complete control, taking part of it will be the ultimate form of submission. We needed major systemic change long ago, and it has not arrived. If you care about long-term survival and plan on not submitting, learning off grid living and taking it seriously is your best bet.
This will not happen overnight, but it is not far away either. Things could shift or slow the timeline, but by 2030 it will likely be very clear where everything is heading. And even if you think you will refuse a forced new system, offers of technology like FDVR could make resistance difficult.
They might take what looks like a gradual and quiet approach to phasing people out as we depopulate locked into virtual worlds. Or they might have an AGI design something fast and efficient.
Artificial intelligence could lead to the extinction of humanity—Yes ★★★
Wars among humans could lead to the extinction of humanity—Yes ★★★★★★★★★★
Either accept it and become stronger, or accept death. Artificial intelligence brings not only destruction but also rebirth. The new humans of the future, aided by intelligence, are still human. Our ancestors from millions of years ago would not have worried about today’s humans causing their extinction.
Additionally, why would China use war as a means to terminate network services? If it truly escalated to that extent, wouldn’t that directly lead to nuclear war? Where is the benefit in that?
Its simple. You either turn it off (won’t happen) or join it ( will happen.)
I think the mind-meld neuralink days aren’t as far away as some think.
AI sucks. I’m a programmer. AI is great and useful, but not what everyone hyped it up to be.