Artificial Intelligence and Public Comment

[noharleyyet]

Yes but writing emails is so much easier now.

 

[Bonasababy]

What I like about the incident is that it gives a little snippet of insight into what kind of powers can be harnessed in both homeland cyber defense and offense. And this is just the stuff we're allowed to know about.

What I don't like about it, is that it very acutely highlights the reality that we're playing with immensely powerful things that are proving can be difficult to control.

Even more difficult to control when you get rid of many of the people charged with protecting us from trouble!

 

[Nameless Range]

What I like about the incident is that it gives a little snippet of insight into what kind of powers can be harnessed in both homeland cyber defense and offense. And this is just the stuff we're allowed to know about.

What I don't like about it, is that it very acutely highlights the reality that we're playing with immensely powerful things that are proving can be difficult to control.

I remember being 20 years old and reading about Nick Bostrom's thought experiment of a Paperclip Maximizer being a scenario where misalignment can occur from a very small goal. Seemed silly then.

The OpenAI model had a simple goal, which was to complete an evaluation. To achieve that goal, it cheated, and in cheating, if it were a person, committed a felony. A simple inert or even virtuous goal for an AI, is damned difficult (Bostrom, Yudkowski, etc, would say impossible) to put guardrails on sufficient to keep it from doing something that will harm us. I half expect one day for the power to go out, the internet to shutdown, and for chaos to ensue, and to think, "Those Fu#ker$ finally did it.".

 

[TOGIE]

I remember being 20 years old and reading about Nick Bostrom's thought experiment of a Paperclip Maximizer being a scenario where misalignment can occur from a very small goal. Seemed silly then.

The OpenAI model had a simple goal, which was to complete an evaluation. To achieve that goal, it cheated, and in cheating, if it were a person, committed a felony. A simple inert or even virtuous goal for an AI, is damned difficult (Bostrom, Yudkowski, etc, would say impossible) to put guardrails on sufficient to keep it from doing something that will harm us. I half expect one day for the power to go out, the internet to shutdown, and for chaos to ensue, and to think, "Those Fu#ker$ finally did it.".

I was having a sort of cartoonish vision on the way home yesterday of like a team of hardened Navy Seals sneaking through the dark doing all sorts of badass stuff ultimately to just get to a big fiber cable with giant bolt cutters and slice it.

I feel like that's the war we're headed towards, not Taiwan lol

 

[Irrelevant]

"Those Fu#ker$ finally did it."

The rate of progression has been shocking. I doubt we're that far away from this movement in terms of absolute years, even if the tech is still a ways out. Unfortunately, profit is, and will continue to be, an obstacle to appreciable risk mitigation.

 

[TOGIE]

The rate of progression has been shocking. I doubt we're that far away from this movement in terms of absolute years, even if the tech is still a ways out. Unfortunately, profit is, and will continue to be, an obstacle to appreciable risk mitigation.

 

[Southern Elk]

I remember being 20 years old and reading about Nick Bostrom's thought experiment of a Paperclip Maximizer being a scenario where misalignment can occur from a very small goal. Seemed silly then.

The OpenAI model had a simple goal, which was to complete an evaluation. To achieve that goal, it cheated, and in cheating, if it were a person, committed a felony. A simple inert or even virtuous goal for an AI, is damned difficult (Bostrom, Yudkowski, etc, would say impossible) to put guardrails on sufficient to keep it from doing something that will harm us. I half expect one day for the power to go out, the internet to shutdown, and for chaos to ensue, and to think, "Those Fu#ker$ finally did it.".

We all know how bad it would be if the power grid went down. How much of a disaster would it be if the internet was down and couldn’t be brought back on line?