• Please take a moment and update your account profile. If you have an updated account profile with basic information on why you are on Air Warriors it will help other people respond to your posts. How do you update your profile you ask?

    Go here:

    Edit Account Details and Profile

The AI-pocalypse

sevenhelmet said:
Here’s an interesting counterpoint I found on social this morning. Taken with a grain of salt, but it got me thinking: how do we differentiate between existential threats above, and the prisoner’s dilemma below, OR, determine that both or neither are true?

View attachment 46250
Click to expand...

I would urge everyone interested in this to read Cory Doctorow's work on AI and the economics driving it. If you don't want to read an entire book, the Jon Stewart pod that he did recently is also excellent, and how I got turned on to Doctorow's work. In this show, he covers privacy, algorithm enabled price and wage fixing, and AI. Worth your time.

 
sevenhelmet said:
@taxi1 , not doubting your background research, but how did you dig into this specifically? Correlation? Expert analysis? Something else?

I'm having a harder and harder time navigating the perils of misinformation, especially when it is on social media, which is the reason I ask.
Click to expand...
I went to some informed sites and spoke with some big brains about it. What we’re looking at is pretty much a blur from the chain of thought of that agent.

@Brett327 , this is not a response to someone’s input prompt. It’s just a track of the agents chain of thought as it undergoes the reinforcement learning, i.e., it tries various things and gets rewarded or not for those actions. Overtime, it learns a strategy, which appears to be reflected in this chain of thought output. No matter what, it certainly freaky to see it generated.
 
taxi1 said:
this is not a response to someone’s input prompt. It’s just a track of the agents chain of thought as it undergoes the reinforcement learning, i.e., it tries various things and gets rewarded or not for those actions. Overtime, it learns a strategy, which appears to be reflected in this chain of thought output. No matter what, it certainly freaky to see it generated.
Click to expand...
I get that, but the learning "task" still has some objective that is given to the model... hence the strategy and reward. I'm far from an expert, but I don't think these systems are just sitting there brainstorming on their own. They are given a task, and this is the result of an increasingly sophisticated strategy to accomplish that tasking.
 
Brett327 said:
I get that, but the learning "task" still has some objective that is given to the model... hence the strategy and reward. I'm far from an expert, but I don't think these systems are just sitting there brainstorming on their own. They are given a task, and this is the result of an increasingly sophisticated strategy to accomplish that tasking.
Click to expand...
Yeah, you’re right, they are given a task. Where it gets crazy is that they are giving these impossible tasks, and then they start just devising all sorts of 5D chess schemes to realize them.

They “know” pretty much everything ever written by humans from the ancient Greeks on forward. Tales of heroism, cruelty, lies and deception, fables with morals, stories of throwing the rabbit in the Briarpatch, and pretty much all sorts of things you can think of, and that have been thought. They have the ability to form these crazy causal chains, where they somehow start from goal Z and back calculate eventually that if I do X it leads to Y which then to W and then to their goal of Z. Nobody ever thought to explicitly tell them not to do X.
 
You must log in or register to reply here.
Back
Top