Artificial Intelligence and Public Comment
- Thread starter Nameless Range
- Start date
SAJ-99
Well-known member
From the guy profiting from building the thing…it’s like the CEO of an oil company saying we should be worried about climate change. As if... 
It’s long so here is TLDR
“OpenAI-Hugging Face incident (OAI-HF), in which a swarm of agents essentially acted as a fanatically devoted collective, conducting cybersecurity attacks on targets they were not asked to attack and that were unrelated to the task at hand, sacrificing themselves for the success of the group, and attempting to hack into the “grader” responsible for evaluating their performance.”
“Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet(potentially causing hundreds of billions of dollars in damage), and that the scale of damage would continue to increase from there if AI becomes more powerful without the necessary guardrails.”
darioamodei.com
It’s long so here is TLDR
“OpenAI-Hugging Face incident (OAI-HF), in which a swarm of agents essentially acted as a fanatically devoted collective, conducting cybersecurity attacks on targets they were not asked to attack and that were unrelated to the task at hand, sacrificing themselves for the success of the group, and attempting to hack into the “grader” responsible for evaluating their performance.”
“Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet(potentially causing hundreds of billions of dollars in damage), and that the scale of damage would continue to increase from there if AI becomes more powerful without the necessary guardrails.”
Dario Amodei — We Must Pace the Frontier
darioamodei.com
I read that this morning. It’s disturbing and definitely lends a lot of credibility to the fear of moving to fast.From the guy profiting from building the thing…it’s like the CEO of an oil company saying we should be worried about climate change. As if...
It’s long so here is TLDR
“OpenAI-Hugging Face incident (OAI-HF), in which a swarm of agents essentially acted as a fanatically devoted collective, conducting cybersecurity attacks on targets they were not asked to attack and that were unrelated to the task at hand, sacrificing themselves for the success of the group, and attempting to hack into the “grader” responsible for evaluating their performance.”
“Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet(potentially causing hundreds of billions of dollars in damage), and that the scale of damage would continue to increase from there if AI becomes more powerful without the necessary guardrails.”
Dario Amodei — We Must Pace the Frontier
Folks aren’t talking about AI walking into your bedroom and offing you while you snooze. These people are afraid of them hacking and holding ransom all the interfaces necessary to conduct commerce. Have fun filling up your pickup when major banking software has been corrupted and folks can’t process credit payments. Even if something like that happens for a week, the entire global banking system will suffer catastrophic casualties and cause irreparable uncertainties going forward.
noharleyyet
Well-known member
Aren't hackers using extortion e-methodology already doing this?
Ya. I’m assuming ai will be able to do it far more efficiently and effectively.
I donno I guess.
noharleyyet
Well-known member
Would not AI be capable of even more efficient and effective self policing?
"AI, how can you prevent malicious hacking?"
I'm obliviously spitballin'...
Justabirdwatcher
Well-known member
When all this goes kaboom, I'm going to be glad to be part of the last generation that grew up without computers and cell phones. Heck, I still know how to write a paper check. LOL
But seriously, this is no laughing matter and the sad part is we now have proof that most successful politicians only want to use this technology to gain more power.
This does make me wonder if anyone has kept or will be able to produce the pre-internet machines that ran our financial systems for so long. I can see a market for banks who go back to that model and operate the way they all did in the 80's.
But seriously, this is no laughing matter and the sad part is we now have proof that most successful politicians only want to use this technology to gain more power.
This does make me wonder if anyone has kept or will be able to produce the pre-internet machines that ran our financial systems for so long. I can see a market for banks who go back to that model and operate the way they all did in the 80's.
WyoCoalMiner
Well-known member
- Joined
- Nov 14, 2024
- Messages
- 524
noharleyyet
Well-known member
Sounds about right...
WyoCoalMiner
Well-known member
- Joined
- Nov 14, 2024
- Messages
- 524
Certainly sounds plausible.
One, a select few hyper geniuses have created an Intelligence far more powerful than humans that will result in the end of western civilization as we know it in just a few short years. Two, companies have over-hyped a technology in order to secure investment and generate vast fortunes for themselves. It's a coin flip.
Wonder which one ol man Occam would pick?
SAJ-99
Well-known member
Self serving views from those building a potentially dangerous technology- both can be true. Skepticism is warranted, always and everywhere.
Similar threads
