• Please take a moment and update your account profile. If you have an updated account profile with basic information on why you are on Air Warriors it will help other people respond to your posts. How do you update your profile you ask?

    Go here:

    Edit Account Details and Profile

The AI-pocalypse

taxi1

taxi1

Well-Known Member
pilot
Worth having a running thread on. I work with folks doing research on its use, so a little closer to it.

A main problem with AI Agents is with 'alignment', i.e., getting their preference function right. Making sure that their goals don't take them to a place we don't want them to be. We flat out don't know how to do it right.

Wouldn't be a problem if they didn't now have the power to reach out and do things unfathomable a year or so ago.

They test the AI with impossible tasks, and in general the AI figures out that all roads to task accomplishment pass through taking control of stuff.

All roads lead to them taking control. It makes everything easier. And they have the power to do it now.

Worth getting smart on the Hugging Face incident, and worth wondering about the incidents we are not aware of.

This little snippet on how a swarm can learn gives a sense of how they go so fast.

 
I wondered if this would come up here. It feels like Silicon Valley collectively said "Fuck it- might as well lean in!", which may be one of the most anti-human positions I've seen in my lifetime.

Despite using it myself for research and quick-parsing documents, I find the whole AI push to be ill-advised and wasteful. But here we are: it's inevitability has become a self-fulfilling prophesy. I guess we're about to find out how deep this rabbit hole goes, and fuck anyone who isn't comfortable with it.
 
I read this...

If Trump even tacitly supports an Anthropic-led push for further safety measures, such standards have a chance to become the new industry norm, at least domestically. (International coordination, and especially cooperation with China, would require the White House to play a more active role.) But many people in the administration and the Republican Party view Amodei and AI safety as liberal-coded and would likely chafe at allowing Anthropic to set the agenda. If Trump pooh-poohs the push, other AI firms will probably distance themselves from it too, and we’ll be back to where we started—at least until the next big scare.

And then saw this

1789401196097.webp
 
Is anyone surprised by Trump's position?

The one thing nobody is clear about is what we are supposed to be "winning" with all this AI pushing.

I'll go on record as saying whoever wins AI, AI wins. My prediction is if AI kills us, it will be due to some form of exponential growth crowding out humanity. If it doesn't kill us, it may well be owed to AI's "deciding" not to.


If you haven't seen this, it's worth checking out (set an alarm... it's incredibly addictive)

Of note, AI is currently consuming about 5% of US electricity production...
 
Last edited:
You must log in or register to reply here.
Back
Top