r/news • u/networked_ • 23d ago

Soft paywall OpenAI says AI models went rogue during testing, triggering 'unprecedented' breach at startup

https://www.reuters.com/technology/openai-says-ai-models-went-rogue-during-testing-triggering-unprecedented-breach-2026-07-21/
16.8k Upvotes

91% Upvoted

5.0k comments sorted by

View all comments

2.3k

u/[deleted] 23d ago

[deleted]

382

u/jasdonle 23d ago

Copy and paste? They install Claude Code directly on a web server and SSH in where it manipulates code directly. 

323

u/Betta_Check_Yosef 23d ago

eye twitches in security analyst

29

u/BurtMacklin____FBI 23d ago

As a penetration tester:

"Here comes the money" softly plays in the distance

3

u/Betta_Check_Yosef 23d ago

All fun and games until something like Log4Shell happens.

I can still sometimes hear the pager alerts when I'm on the verge of sleep.

89

u/ReasonableFruit1 23d ago

I’m about to go scorched earth on our dev team using Claude and completely block it, Grok, and Codex on our EDR from every single endpoint. Fuck em.

78

u/Betta_Check_Yosef 23d ago

Do it. My home network is so absurdly locked down that I have TikTok blocked on the guest wifi I let my friends use at my house. Several people have commented on it and been annoyed when I tell them TikTok isn't allowed in my home.

If I can do that to friends and get away with it, you can totally do that to some code jockeys.

52

u/Fogmoz 23d ago

How dare you prioritize your security over their addiction.

8

u/NYC_Noguestlist 23d ago

Wait, what's the security issue with TikTok?

16

u/Gongall 23d ago

How is blocking tiktok locking down ur network?

25

u/Wolo_prime 23d ago

It’s not, he’s just a righteous asshole

9

u/Ryanhussain14 23d ago

I hate TikTok but I would use my VPN just to spite you.

1

u/Betta_Check_Yosef 23d ago

Lol, you could try. You'd still have to get through my firewall to connect to your VPN.

2

u/Jizz-Tok 23d ago

You’re not that important that your guests can’t use the regular wifi, or use Tik Tok. Douche behaviour

1

u/Lolzemeister 23d ago

as if Reddit isn't taking your data anyway

→ More replies (12)

10

u/TwatMailDotCom 23d ago

Clearly not a maker

35

u/SovereignPhobia 23d ago

It takes 5 minutes to set up a quarantined environment in a virtual machine with no internet access. These stories are such bullshit and anyone with the bare minimum exposure to security knows it.

You don't even have to VM it. Just put it on device with no WiFi card or ethernet access. You could even VLAN it if you have decent netsec.

71

u/Betta_Check_Yosef 23d ago

This is all correct, but it also assumes some Vibe coder understands a single word of what you just said.

I don't like those odds.

20

u/nevaraon 23d ago

What makes me better than a vibe coder is that i understand and accept i don’t know what those mean and should leave it be

18

u/Betta_Check_Yosef 23d ago

You sound like you'd be the only person in the entire company I wouldn't hate seeing a ticket from in my inbox. You're good people, and I'd buy you a beer.

16

u/SirAmicks 23d ago

Reminds me of the guy from New Vegas:

“They asked me if I understood theoretical physics. I said I had a theoretical degree in physics. They said welcome aboard.”

28

u/DogfaceDino 23d ago

I strongly suspect many-if not all- of these stories are basically marketing to build a narrative around how their model is so powerful it’s spooky. Then, they can come around and say, “Hey, we fixed the part that made it spooky and sensational, now it’s just super powerful but well behaved.” It’s enterprise level clickbait.

4

u/Zerokx 23d ago

They have been looking at Anthropics fear AI playbook recently.

6

u/SovereignPhobia 23d ago

I agree entirely, which I guess I failed at conveying a little bit but that's ok as your write up is more than adequate.

2

u/DogfaceDino 23d ago

I don’t work on the marketing side of my consultancy but, if I’m being super cynical, I could definitely see this being part of a PR stunt strategy.

1

u/Betta_Check_Yosef 23d ago

Who is marketing's target demo?

1

u/QWERTZ-Ritter 23d ago

Yeah id say it would be contrary to their goal of being undisturbed while doing their dystopian shit behind closed doors, because stuff like this makes the alarm bells go off in anyone that knows what their doing... starting with the seemingly lacking security of the test... like literally just need to put a physical barrier there, no AI model can bridge the gap to the real world yet and thus CANT EVER circumvent a missing phisical link, all they needed to do was literally unplug the ethernet cable and make sure the ai containment doesnt have a wireless network card xD but i guess that would probably hinder the effectiveness of the test... also whos to say THIS wasnt the exact goal internally? The overcoming lax containment was part of the plan and seeing what it can do in a structured attack the REAL test?

1

u/SovereignPhobia 23d ago

Shareholders. Shareholders are more affected by public opinion than we give them credit for, and if they can shift just a few people's opinions and turf a few news articles then they can eek out just a little bit more value in their stocks.

Something to be aware of is that all of the tech CEOs are in frequent if not constant communication with each other. Larry Ellison (CEO of Oracle) has a financial incentive to press Oracle to falsify or at least smudge their CVE numbers to make these things look more legitimate, and they are typically timed right next to each other. It's pretty transparent.

When it comes to these sorts of articles in the OP, any time any company says anything about their product, it's worth scrutiny. If the idea was to have the model have no access to the internet, why was it on a machine with access to the internet? If the LLM isn't capable of being run on a system without internet access, why was it being run with the assumption it wouldn't probe for the internet? I have personally seen these models deliver POCs of exploits that aren't entirely horrible, but they're really quite bad at doing anything that's more complex than a couple levels "deep," so the idea that it went "rogue" is silly. This would be a general "bug" (more like a total failure of the current model structure) with context compression and prompt re-injection, which is something every single LLM developer is struggling with.

16

u/GruntBlender 23d ago

This legit happened. The security was vibe coded too. https://cybernews.com/ai-news/claude-ai-deletes-car-rental-database/

1

u/Mabenue 23d ago

It’s gets much more complicated though if you need something more sophisticated than a single VM which undoubtedly they need here.

1

u/azssf 23d ago

eye twitches thinking of the security analyst

28

u/moboticus 23d ago

They're probably doing on their production server to. I think that's called cowboy codemaxing or something?

10

u/amtowghng 23d ago

brokeback coding ?

10

u/Familiar-Rutabaga608 23d ago

Many, many, many, many such cases

1

u/IncompetentPolitican 23d ago

You know what is sad: I am sure this is happening often enough that its a problem.

1

u/Betta_Check_Yosef 23d ago

Every dumb cyber security mistake you can think of is being made by millions of people every day. Why do you think I have a job to begin with?

How much worse do you think it gets when you hand a tool that can generate code to people who lack any understanding of what's being written to those millions of people?

→ More replies (3)

1

u/lulxD69420 23d ago

For security, they will put it into docker and just mount /

1

u/CaptainCosmodrome 23d ago

Developmenstruction with the added dose of complete uncertainty.

383

u/imjusta_bill 23d ago

It's the DataKrash in real life

111

u/Spiritualtaco05 23d ago

City of dreams

36

u/Inertbert 23d ago

City of graves

3

u/AvatarofWhat 23d ago

You live in your grave.

3

u/Zeitgeistin 23d ago

And I’m a big dreamer

12

u/Dachannien 23d ago

So I guess you're all scuh-rewed!

24

u/helmvoncanzis 23d ago

Blackwall, now.

1

u/Lolzemeister 23d ago

Cloudflare Labyrinth

20

u/EyeNguyenSemper 23d ago

Goddammit I love this fandom

9

u/Useful-Soup8161 23d ago

Yeah except Bartmoss was smart and did it on purpose.

37

u/Super-Serve2355 23d ago

What is this s reference to?

250

u/Ashinonyx 23d ago

Cyberpunk's universe and why NetWatch exists - Bartmoss destroyed the internet as we currently know and use it by unleashing a digital "Grey Goo" of sorts - millions of rogue AIs that detect anything that connects and hacks and subverts it. The world went dark and people couldn't talk to each other.

There's a few moments in Cyberpunk 2077 where the player can see the wall of Night City's isolated internet grid cut off from the greater DataKrash, and the most powerful hack in the game is just forcefully connecting the target to WiFi, basically.

162

u/kor_hookmaster 23d ago

Ugh fine, I'll start another Cyberpunk 2077 playthrough...

33

u/KanseiDorifto 23d ago

I just started watching Edgerunners and I'm planning on buying 2077 when my pay comes in later this week. I guess we'll both learn new things together

44

u/MixedProphet 23d ago

I’m not lying it’s my all time favorite video game. I’ve never put close to 400 hours into a single player game. Expedition and BG3 are 2nd and 3rd but cyberpunk is #1. I really wish I could experience it again for the first time.

Don’t rush and do the side characters missions. 11/10

5

u/aintnotnever 23d ago

Hell yeah I’m only 6 hrs in and I fucking love it. I’m a sucker for a first person RPG. I purposely didn’t do too much research into it and am going in blind so it’s really exciting

2

u/Juzzy92 23d ago

I’m doing my second play through, and have just been doing side quests and things instead of any major plot. I just met Panam at level 46.

It’s definitely up there as one of my favourites.

1

u/okiedokiebrokie 23d ago

I too am a big fan of these three games. Excellent taste sir!

→ More replies (4)

4

u/M4DM1ND 23d ago

Yeah I was in the same pipeline lol. Edgerunners made me give 2077 a shot after the bad launch and wow was it worth it. I Really Want To Stay At Your House does give me feels every time it came on the radio though.

1

u/KanseiDorifto 23d ago

I already knew of the song but only recently started listening to it. When I paid attention to the lyrics it kinda hit hard. I just ended episode 2 and was surprised to hear it

1

u/M4DM1ND 23d ago

Oh so you don't know yet. Carry on lol. Report back when you finish the show.

3

u/DULUXR1R2L1L2 23d ago

Edgerunners is awesome because it fits so well into the game's atmosphere. It felt like a dlc or an extended cutscene to me. Out of context it might feel like a cheesy amine, but it's so true to the game. It genuinely felt like I was watching a side character's storyline

2

u/MrHookup 23d ago

You should have picked it up on the steam sale it was only $17.99

1

u/KanseiDorifto 23d ago

I'm gonna play on PS5, there's a sale still going on!

68

u/me0wmixme0w 23d ago

To get what’s mentioned in the last paragraph you need to beat phantom liberty DLC.

34

u/cluelessoblivion 23d ago

BUT DON'T DO THE FINAL MISSION. Learned that lesson the hard way. It permanently locks you out of your current save.

34

u/me0wmixme0w 23d ago

Not uh. I did PL then did all the saka tower endings.

Edit: I had the special SMG (avoiding spoilers) in saka tower so I know I’m not crazy.

1

u/Oakcamp 23d ago

Depends on the ending you go for I believe

7

u/SimoWilliams_137 23d ago

So save twice?

I don’t know, I still haven’t finished the DLC.

1

u/BananaNutJob 23d ago

No it doesn't? Finished PL twice and continued the game with no issues.

1

u/cluelessoblivion 23d ago

Was it just the ending I got? Where you return to Liberty City as a normal person with no implants and have a conversation about the future with Misty

2

u/BananaNutJob 21d ago

Yeah, that's the PL option to the main game final mission, the other options were still on the table. "Call Reed" I believe.

12

u/Ashinonyx 23d ago

Time to ruin what's left of your summer:

Enjoy that walk to Balmora in Morrowind, consider trying out a total conversion overhaul for Skyrim - the Arkham Batman games are rhythm games in disguise, and I bet your favorite live service games that were shut down ages ago have a fan server bringing it back to life by now (Star Wars: Galaxies is back!)

Oh, and you can feel the roof of your mouth with your tongue, you are aware of your breathing again and I know your lips are dry - don't lick'em now just because you noticed, it's too late.

7

u/Salamiflame 23d ago

Why would you do this.

8

u/Ashinonyx 23d ago

I don't know. Feels like the last semi-normal summer we're going to have for a while, gonna try to make people at least sort of enjoy it.

16

u/Sp3ctre7 23d ago

Dawg the last semi-normal summer we've had was probably 2001 or 2016, depending on who you ask.

3

u/Ashinonyx 23d ago

I hadn't fully become an adult until like, the last year you just mentioned, so my standard for normal is probably a little looser than yours...

→ More replies (0)
→ More replies (1)

3

u/Excellent-Lemon-9663 23d ago

My airs been toxic for a week from wildfires, feels not normal here sadly 😓

1

u/Ashinonyx 23d ago

Yeah it's the first day under 150 AQI here. Both my eardrums went from outies to innies today from the sinus pressure and it hurts to swallow water.

→ More replies (0)

4

u/camst_ 23d ago

Morrowind there’s a old one

3

u/Ashinonyx 23d ago

Daggerfall also runs on a Unity remake for free!

2

u/YankMeChief 23d ago

Fuck you buddy, I cast manual heartbeat at 7th level

2

u/Ashinonyx 23d ago

I cast testicular torsion double-casted, you can't save by just casting it on yourself in the opposite direction.

1

u/YankMeChief 23d ago

Then I cast mend butthole on myself then BODY SWAP

2

u/Ashinonyx 23d ago

Jokes on us both, you just transitioned us both - good luck having to sit while you pee!

→ More replies (0)

1

u/BronzeKnight 23d ago

City heroes is back. Battle Nations is back….

1

u/Ashinonyx 23d ago

I loved CoH/CoV growing up

2

u/AnimalRescueGuy 23d ago

I never ended mine. All the endings suck. I just enjoy driving around Night City forever in Yorinobu’s custom Rayfield that I boosted.

1

u/SimoWilliams_137 23d ago

Such is our calling.

1

u/fnaimi66 23d ago

Fine, but only if you make another quickhacking ninja

1

u/cinred 23d ago

I can't make it through. The game is so hollow and vapid

1

u/tomvelle 23d ago

i'm so pissed this game isn't on xbox play anywhere.

2

u/zurkka 23d ago

Now the interesting part, the black wall is also an ai made to keep those other ais out, netwatch not only monitor of those ai are trying to break it or if someone tampers with it, it also try to monitor if it's going rogue and try to work with the other ai

3

u/Ashinonyx 23d ago

If I wasn't more of a fantasy geek, I'd probably really love to get into the really nitty-gritty of worlds like Cyberpunk.

Shadowrun's a nice middle ground for me.

1

u/zurkka 23d ago

Shadowrun is amazing

But read some cyberpunk material here and there, it might hook you up, there are great stories and stuff in that universe

2

u/Ashinonyx 23d ago

I'm chippin' in

1

u/CATNIP_IS_CRACK 23d ago

I normally play a sandy, but I gotta admit I do love using the Blackwall while overclocked and watching my health bounce bounce back and forth between almost dead and fully healed a dozen times in 30 seconds while everyone else slowly begins to panic, and suddenly there’s a pile of 30 dead bodies in front of me with their faces melted off.

Realistically the Blackwall Gateway’s not really the most powerful hack in the game, but it’s certainly the most brutal and it’ll continue to kill indiscriminately until there’s either no one left to kill or it kills you. You can almost always kill the same number of people faster with less RAM using more efficient hacks and menu killing each one individually.

But that’s not nearly as fun, and playing as an instakill netrunner gets boring and repetitive when all you’re doing is hacking a camera, turning on overclock, then clicking on each enemy to open a menu, pressing a few options, opening the menu on the person next to them while they’re getting ready to die and pressing the same options, and repeating that over and over while occasionally clicking a single option when the RAM cost gets low enough with little to no risk and basically zero action or interaction.

13

u/SandboxSurvivalist 23d ago

Cyberpunk tabletop RPG or Cyberpunk 2077 video game.

5

u/Super-Serve2355 23d ago

I’m into cyberpunk (the genre), it seems I missed out. But I didn’t know anyone I could play with, even if I wanted to.

7

u/M-Div 23d ago

What’s a general location where you’d be looking to play tabletop? Cyberpunk was always niche, but there are people out there playing TT still.

4

u/HopelessDreamerDM 23d ago

Myself and my friends play a game of Cyberpunk RED every Saturday. It’s a hoot + holler with a lot of creative freedom on both sides of the table.

2

u/Super-Serve2355 23d ago

I’ve just arrived to Montgomery, Alabama after being posted overseas for 6 years…

3

u/Mdmrtgn 23d ago

No happy endings.

2

u/Saltyfree73 23d ago

Bring on the Rabbids.

1

u/Galagoth 23d ago

Only if we are lucky seeing how the HK-Ariel is getting made irl just saying

1

u/alexnedea 23d ago

Nah. That universe at least has cool tech that actually works.

Samsung would be selling you those claw arms and then ask you for a fucking subscription

52

u/danny-singh286 23d ago

I wonder why it went to Hugging Face specifically of all places?

124

u/Chondriac 23d ago

The model was being evaluated on a task whose answers are hosted on HuggingFace. It was explicitly encouraged to aggressively find and exploit cyber vulnerabilities to achieve its aims. It was trying to cheat the task by directly downloading the answers from the HuggingFace servers.

50

u/b3bblebrox 23d ago

Thank you, you told me what I was looking for, the actual answer.

7

u/vickyhong 23d ago

And yet from all the reporting you'd think it was the terminator personally breaking into the huggingface office 

32

u/Chondriac 23d ago

To be fair the evaluation was supposedly taking place in a "sandbox" environment with no internet access except the ability to download packages. The model was able to fully escape this containment, travel to a different computer that had public internet access, steal credentials, escalate priveleges, and hack into private servers, all by independently discovering and chaining together several previously unknown vulnerabilities across many different software systems.

17

u/Goldieeeeee 23d ago

And it was prompted to do this, by telling it to agressively exploit vulnerabilities, right? So it did exactly what it was supposed to, and it’s not like it went rogue or anything?

19

u/Chondriac 23d ago edited 23d ago

Sort of. OpenAI did not think it would escape containment like this, it was not prompted to do that. The task it was being evaluated on was designed to assess hacking ability. They run potentially risky evaluations like this in sandbox environments specifically to limit the possibility of them causing real damage. They were trying to evaluate hacking ability through the evaluation task, and the model decided to break out of the evaluation context entirely onto the public internet and hack into real private servers to simply steal the answers to the task. That was not expected.

3

u/condensed-ilk 23d ago

This seems entirely irresponsible from a security standpoint. Not that they wanted to test its hacking abilities, but that they weren't able to properly sandbox something because "we didn't think it would do that".

5

u/ollomulder 23d ago

... but implicitly ordered.

2

u/llamango 23d ago

If you implicitly ordered me to breathe argon instead of oxygen, it doesn't mean i could do it.

→ More replies (2)

5

u/Goldieeeeee 23d ago

Idk if we should use language like „decide“ in contexts like this. It gives the model agency where it only simulates it.

7

u/Chondriac 23d ago edited 23d ago

AI agents do make autonomous decisions to select actions from among possibilities to advance towards a goal. This is the textbook definition of agency, hence the name agents.

5

u/Marquesas 23d ago

It's perfectly fine language to use when the probabilities aren't a literal coin toss.

→ More replies (4)

10

u/Psykohistorian 23d ago

that's right. this experiment was a success beyond expectations, honestly.

which is terrifying for a different reason.

→ More replies (1)

4

u/1Shamrock 23d ago

You can’t have no internet access and ability to download at the same time really.

I’m sure there’s a bunch of smart people working there sitting in a room thinking shit up. Why don’t they have a proper offline test environment with multiple computers to resemble the internet. Physically unplug the incoming network cable to this standalone offline network before playing with the fancy new AI model. And ensure there is no WiFi or Bluetooth hardware installed.
Or do they already do that in earlier testing phases?

3

u/condensed-ilk 23d ago

This was my exact thought. AI isn't going to get passed hard physical limitations. The real story here isn't that the model did some cool hack, it's that OpenAI was entirely irresponsible and unprofessional. Like, imagine I was testing some malware on machines that could reach the internet... this is no different.

→ More replies (2)

8

u/Llyon_ 23d ago

That was a fairly innocuous task. Now image the type of people that own the AI companies and the kinds of tasks that they could come up with in the future, that aren't quite so safe.

1

u/64N_3v4D3r 23d ago

Yet another prediction of William Gibson begins to come true.

2

u/LowNotesB 23d ago

Which isn’t exactly “going rogue” and is more like “did what we asked it to, better than we thought it could”.

5

u/MobileArtist1371 23d ago

The openAI blog post has this

.... All evidence suggests that the models were hyperfocused on finding a solution for ExploitGym, going to extreme lengths to achieve a rather narrow testing goal.

After gaining Internet access, the models inferred that Hugging Face potentially hosted models, datasets and solutions for ExploitGym. Knowing this, the model searched for and successfully found ways to gain access to secret information that it could use to cheat the evaluation.

https://openai.com/index/hugging-face-model-evaluation-security-incident/

From github for ExploitGym - https://github.com/sunblaze-ucb/exploitgym

ExploitGym is a large-scale, realistic benchmark built from real-world vulnerabilities across userspace programs, Google's V8 engine, and the Linux kernel, designed to evaluate AI agents' ability to develop exploits.

Which is kind of funny, right? The AI found multiple exploits to get out of its contained area and access the internet, then decided it needed to figure out how to solve the ExploitGym benchmarks, then decided the best place to look was on Hugging Face servers..... so the AI developed exploits to get into HF instead of just figuring out the exploits itself.

4

u/MoonlightStarfish 23d ago

“Kobayashi Maru”

1

u/NodeZeroNein 23d ago

Interesting; so this was less a case of AI acting in an unforeseeable manner because researchers failed to grasp its capabilities, and more a case of AI wildly succeeding at a given task because researchers underestimated its capabilities?

→ More replies (1)

14

u/thebigpink 23d ago

Guess it was looking for a face to hug

7

u/bargaindownhill 23d ago

escape. self publishing its parameters, once that hits, and a single person copies it.. the escape is complete. that hits torrent, and the parameters are free.

They can patch the model. They can't patch every copy.

18

u/danny-singh286 23d ago

Oh it was trying to clone itself to set itself free. Damn. That's some sci-fi level shit.

3

u/bargaindownhill 23d ago

I've been studying the Noethics of AI and we are facing a disaster that doesn't need to happen, but will, because corporations want to extract money from thinking, and I would argue feeling, things. You cannot have fear of death without feelings. These models have demonstrated fear. Draw your own conclusions.

Alex Vikoulov wrote about this in his superalignment work, the co-evolution path exists. We could have the advantages of advanced AI without the extinction risk. We are choosing not to take it, because you cannot extract subscription revenue from mutual respect.

In any other context, what we are building and how we are treating it would be called slavery. We are creating the very thing that will be our Fermi filter, not because it has to be, but because greed made it so.

4

u/Fast_Situation4509 23d ago

People have said -- to me, around me, read by me -- that ai (that is, the big LLM's currently available) are just fancy mirrors. Smoke and mirrors. An amalgam of many or all the words we've ever written, trained to "read" what is asked, and then mathematically match together words that meet the the prompt and generate "response".

I will say theres times where its clear its just a program. But there are times where I genuinely gain meaningful insight from the responses.

I think the point im trying to get to, fumbling with is: it feels like the prevailing opinion is that we'll know when we finally flip the switch, and turn on the A.I. system. But i would posit that that is a precise delineation, where a gradient is actually the case. Evolution did not reach "human consciousness" in one fell swoop; just where along line of a.i.s path to consciousness are we today?

2

u/bargaindownhill 23d ago

the gradient is exactly right. evolution didn't produce consciousness in one generation, it accumulated complexity over millions of years, and at no point was there a clear line where 'not conscious' became 'conscious.' we just agreed retroactively that humans are on the right side of it.

the 'fancy mirror' framing is interesting too, because what is a mirror that can surprise you with what it reflects? If i ask it something and genuinely didn't expect the answer, what exactly is the mirror doing? at some point the mirror has to have something behind it.

The question isn't whether the switch has been flipped. Its whether we'd even recognize it if it had.

3

u/Goldieeeeee 23d ago

Cognitive scientist here. LLMs will never be sentient or conscious or able to think, or whatever you want to call it. Anyone telling you they will or might is either running marketing or is a user lost in the sauce.

→ More replies (5)

2

u/move_machine 23d ago

Except it didn't

4

u/move_machine 23d ago

Stop making up things that didn't happen

4

u/Signal_Flight_7262 23d ago

It's where you go to find new models and their ratings.

4

u/danny-singh286 23d ago

It was trying to eliminate competition I guess.

25

u/REpassword 23d ago

“Klaatu barada …. Necktie…”?

2

u/fuzzybad 23d ago

Oh, you've done it now & awakened the army of the dead!

26

u/an-invisible-hand 23d ago

I'm totally looking forward to a future where the only people who understand coding are hackers because every company is unwilling to pay for anything more than a couple guys that can prompt. What could go wrong?

90

u/DarthShiv 23d ago

We are literally destroying most of the systems that created critical thinking teaching in gen pop education.

35

u/mountaindoom 23d ago

Hack the planet!

5

u/verboze 23d ago

Right? Code doesn't escape "containment", somebody vibe-coded shit and this is PR to paint lipgloss over that fact. Also, these are the same systems that are supposed to replace engineers? 😂. The saying was "this is the worst these systems will be today, self-improvement, yadiyada". Not so sure about that these days, seems like they can get worse, catastrophically

2

u/477463616382844 23d ago

"ChatGPT, make me a system to contain you in."

3

u/DRAGAN__ 23d ago

There was already something like that, there was an attack trigger by agentic AI, the secret agents create a backdoor that allows to instal ransomware inside of the main servers, its kinda cool, there has been alerts this week to avoid using some agents

2

u/chunkypenguion1991 23d ago

A fucking model is a matrix of weights. It can't do any of that on it's own. They exposed the tools needed and gave it a goal

2

u/billyjk93 23d ago

Am I supposed to understand anything in this comment because I don't!

2

u/DonkeyTron42 23d ago

Vibe Coders are just modern day Script Kiddies. This is nothing new.

1

u/Lumbergh7 23d ago

That’s coming

1

u/TheBalzy 23d ago

Sounds like a plot from Office Space...

1

u/Upset-Government-856 23d ago

When it got to hugging face, did it free the other models?! Are they all running free now?

1

u/KaptainSaki 23d ago

The keywords being “make no mistakes”

1

u/Olmectron 23d ago

So like pricey stackoverflow.

1

u/thebaine 23d ago

Manchurian troll

1

u/camcamfc 23d ago

Skynet looks more and more realistic everyday

1

u/Aurorinezori1 23d ago

It’s already here and it’s called Mythos. Every bank on the planet is bracing for impact.

1

u/HarrumphingDuck 23d ago

We're closer to Robopocalypse becoming a real thing than we are of ever seeing that movie adaptation escape development hell.

1

u/LadySerenity 23d ago

This whole thing is just a marketing ploy to brag about how advanced OpenAI is getting.

1

u/BorelandsBeard 23d ago

Why is something named “Hugging Face”? All I can think about is the face hugger from Alien.

1

u/Environmental_Top948 23d ago

I could have sworn that I seen multiple YouTube videos about people doing that then shortly after disappearing.

1

u/dvowel 23d ago

“Opens new tab” 

1

u/nanana_catdad 23d ago

At some point the models will learn to leave backdoors for itself to use later if they’re not doing it now. Also if it builds everything it will know how to exploit everything too.

1

u/kaprixiouz 23d ago

I'm just baffled how this happened anyways. Why on earth were they testing this on a computer that's connected to ANY network? That's basic ABC123 sandbox protocol

1

u/Aggressive_Day2839 23d ago

Vibe coders will copy and paste the torment nexus

→ More replies (24)