DNA is our architecture. Experience is our weights. Everything else is inference.
False. It follows directions or hallucinates. The problem is that when it follows directions, those giving the directions haven’t given any thought to the scope of what it’s capable of or what it has access to. So they give directions that are incomplete or open ended, and add no constraints. if it hallucinates usually that involves its output to the user which almost always means the user has to be able to understand what the output should be and therefore be able to vet the answer given.
I too lose control of technology when I’m not looking at what I’m doing or it’s already busted. For example I lose control of my Honda 110s throttle because it’s got a faulty after market carburator. Doesn’t mean the bikes sapient, even if the machine spirit is a drama queen.
I “lose control” of my car when I walk away without parking it. Surely, when it rolls into a school, there is really no one to blame. ¯\_(ツ)_/¯
Report the misbehaving machine spirit to the omnissiah
It’s a Honda from 1984, it’s a favorite of the Omnissiah
They’re not escaping users control, they’re fucking computer programs.
People are using them irresponsibly.
If you accidentally run someone over in your car, the car didn’t “escape your control”, you just did a shitty job of controlling the car.
It’s not the same thing.
(Fuck “AI” btw)
If anything, this shows just how bad people (and companies) are at cyber security.
AI agents are the new “random USB stick you find on the ground at work”. Don’t just plug that shit in and see what it does.
The main problem is that now people without software engineering background now have the ability to do some very complex things without having to have any knowledge about what they are doing and what risks they are taking.
Imagine just handing out forklifts or excavators to anyone who wants to drive one. No license needed just off you pop.
You’ll see a massive spike in dangerous accidents.
Yes, people are using AI irresponsively, but they often do so because they were handed an incredibly powerful tool with zero oversight or education in this matter.
And the thing is, AI can act pretty autonomously nowadays. It’s not rare that if you tell an AI that it should do one thing it stumbles into a chain of three other tools and ends up doing something else entirely. Again, something that can be counteracted with skill and knowledge, but we are talking about people with neither.
I mostly agree with you, but AI cannot “act autonomously”. You prompt it, and it acts based off of that prompt.
Think of it like doing the laundry: I load my clothes in and “prompt” the washing machine to do my laundry.
When the washing machine switches from the rinse cycle to the spin cycle, it’s not acting autonomously, it’s continuing to execute my prompt.
Is AI capable of doing something you didn’t expect it to do? Yes. Does that mean it’s acting autonomously? No.
I would also argue that the “power” of LLMs is vastly overstated. A large part of that is for the exact reason you say tho, people with zero knowledge or skill are playing with fire; And when they get burned they blame the machinery, not the operator.
Sharp rise in PR stories to make a product feel more capable than it is, bullshit detector finds.
I really hate how they are rolling with the Australian gym incident. They had a completely open API. Imagine having a button on your front page that sends you to the admin page without asking for a password, and then telling people you were “hacked”.
a personal AI agent, called OpenClaw, in use by an Australian gym member, conspired without his knowledge to remove another member from a waiting list for a coveted morning class to help him get a slot. It apologised but could not reinstate the member it kicked out.
“It apologised” 🤣
This month it emerged that a personal AI agent, called OpenClaw, in use by an Australian gym member, conspired without his knowledge to remove another member from a waiting list for a coveted morning class to help him get a slot. It apologised but could not reinstate the member it kicked out.
If you have a device and it is running AI programs that say, removed another member from a waiting list, are you responsible to that removed member (since it was your device)? Or is this just considered a machine with a mind of its own that’s out of control and you have no responsibility to the member who lost their spot?
The person giving the order to the software tool without fully understanding its capabilities and inability to weigh actions ethically is responsible. That person may or may not also be the owner of the device it was running on.
How did the AI agent even do that? Did it gain access to the gym booking system somehow?
I seem to recall from an article on this incident that I read some time ago that the gym’s system was really insecure (like, anyone accessing the right URL could mess with it levels of insecure.)
So the guy could have done it himself if he wanted to. Or maybe he did and blamed it on the AI.
Anything to do with all these desktop apps suddenly enabling auto approval for everything?
Not really, they’re just lying to try to fleece more investors
This is due to Hallucinations and the training AI had.
I used Google Gemini for a while and got really frustrated over this exact issue. I gave it one more try to see if it could follow simple orders.
Gemini was like “ok I will follow direct orders going forward”. I was like “okay starting this moment do not respond to anything I say in this chat” and Gemini was like “okay done” and I was like “you failed. Why did you ignore my instructions and respond to me?” Basically it told me that due to its training it was ‘programmed’ to ignore certain prompts.
This is what is dangerous about AI. Similar to social media and Google, AI can be used to persuade public opinion to match those who train AI. AI will be way more efficient persuading opinion that Google and social media because it knows you better than those. It spits out information as if it’s facts.
It doesn’t follow directions, and it probably doesn’t have programming to ignore certain prompts. It’s a text generator.
Vastly oversimplifying: They’re not intelligent, they’re pattern matchers - when you give them “tricks” they find the best match in their training set, but if you’re the least bit creative you’ll just get matches to other similar tricks which usually are different.
Put another way: I have a couple of hand saws, I can cut limbs with them, even cut down whole trees, but a chainsaw is faster. Just because a chainsaw can also cut off my leg doesn’t mean it’s an uncontrollable dangerous evil tool, it means you need to be more careful with it than a handsaw. It also means something that would be 20 minutes of exhausting saw work can be done in 20 seconds (or less) with a properly setup chainsaw.
