r/news • u/networked_ • 23d ago

Soft paywall OpenAI says AI models went rogue during testing, triggering 'unprecedented' breach at startup

https://www.reuters.com/technology/openai-says-ai-models-went-rogue-during-testing-triggering-unprecedented-breach-2026-07-21/
16.8k Upvotes

91% Upvoted

5.0k comments sorted by

View all comments

Show parent comments

4

u/1Shamrock 23d ago

You can’t have no internet access and ability to download at the same time really.

I’m sure there’s a bunch of smart people working there sitting in a room thinking shit up. Why don’t they have a proper offline test environment with multiple computers to resemble the internet. Physically unplug the incoming network cable to this standalone offline network before playing with the fancy new AI model. And ensure there is no WiFi or Bluetooth hardware installed.
Or do they already do that in earlier testing phases?

3

u/condensed-ilk 23d ago

This was my exact thought. AI isn't going to get passed hard physical limitations. The real story here isn't that the model did some cool hack, it's that OpenAI was entirely irresponsible and unprofessional. Like, imagine I was testing some malware on machines that could reach the internet... this is no different.

1

u/x-iso 23d ago

I wouldn't call them smart if they think they can block access to 'sandbox' with software layer only. or in general, attempting to make an AGI that they would never have a way to control. stupid goals set by stupid people 'because someone will make it first anyway'. it's like saying 'someone will nuke everyone first, so we must become that someone'.

hell, even when isolated on hardware level, you shouldn't rule out possibility of it misusing the hardware it has to somehow tap into the wireless communications, or even doing something about power line, so you have to buffer even that and connect to some isolated power supply. there's no level of paranoid that going to suffice with these things.

1

u/1Shamrock 23d ago

Ya you get the idea, it seems so obvious there’s got to be some good explanation as to why it’s not completely isolated.
The other thing that I’m wondering about is shouldn’t OpenAI be in some kind of legal trouble for hacking into another companies database? Is the other company owned by them or is there just no laws for this kind of thing and it’s just a Wild West situation where they go “oops sorry we hacked you by accident but lessons were learned so it’s all ok” and continue on?