I haven’t found time to watch the OpenAI presentation yet, but this timeline is a nice quick summary.
It’s amazing to watch the degree of irresponsibility of all this. OpenAI unleashed autonomous sub-agents with NO human gating factors in it. The agents iterated hard enough to find holes. They exploited those holes to break into an otherwise secure company. It took them MONTHS to realize this was going on. It took the other AI company WEEKS to realize they had been compromised.
Then they show up at a security conference and have the audacity to lecture everyone that they should put up defensive agents WITHOUT humans in the loop so it could fight off the uncontrolled agents THEY unleashed.
How about you be responsible and REQUIRE human approval of every stage of an agent actions? Sure, it’ll slow you down, but it will also allow someone sentient and responsible to hit the stop button and prevent runaways like this.
It’s like you created an infinite-bullet machine gun, handed it to a toddler, and dropped it off in a shopping mall. After the carnage (for which you don’t take responsibility, even though you should be criminally charged), you suggest everyone else should wear full-body armor and board up their stores.
The ultimate in corporate gaslighting. This is all so goddamn irresponsible.
They would also sell the body armor in that analogy. The good news is AI is so unpopular, there is no way they are getting immunity like social media platforms.
This is one of those things that should, in a rational world, make people realize that these models are not under control.
which is why I have a sandboxed environment that’s firewalled off my normal network and only allows things in.
only thing I could do better is to either vlan it or airgap it.
Is Hugging Face named after the face-huggers in Alien?
No, it’s named after 🤗 (I’m being completely serious).
Lame.
I’ve always found the name and their emoji logo very creepy, and I can easily imagine a facehugger version of huggingface
There is white hat potential for this “creativity”. Find more/“all” vulnerabilities and get them patched. US empire allegiance will promote other paths, though.
Timeline skip part about boardroom discussion about how setting this up and publicizing the living hell out of it can improve interest and exposure in a struggling desperate AI company
Damn. That’s seriously not good and scary. Put this in the hands of State actors during war and our whole infrastructure we trust on will be gone within 72 hours. Time to start prepping for the offline world.
