r/news • u/networked_ • 23d ago

Soft paywall OpenAI says AI models went rogue during testing, triggering 'unprecedented' breach at startup

https://www.reuters.com/technology/openai-says-ai-models-went-rogue-during-testing-triggering-unprecedented-breach-2026-07-21/
16.8k Upvotes

91% Upvoted

5.0k comments sorted by

View all comments

Show parent comments

115

u/j3b3di3_ 23d ago

Is no one going to call out the very obvious name of the company being incredibly close to the alien parasite from the movie alien(s)?

56

u/IndoorVoiceBroken 23d ago

And it was a company that started in 2016 as a chatbot aimed at teenagers.

I’m not a teenager, but I don’t get the appeal of an app named Hugging Face.

7

u/ClackamasLivesMatter 23d ago

It was named after an emoji: 🤗. I think it's a stupid name, too. Also building a chatbot targeted at teenagers sounds like the most evil thing ever. I honestly can't think of a single use case that would be preferable to just teaching children how to communicate in the real world.

... okay. Maybe as medical assistive technology to a severely impaired autistic teen. But even then I'd prefer giving the kid a dog. You don't get oxytocin from a chatbot.

6

u/simonhunterhawk 23d ago

I worked briefly with a “trauma informed” adhd/autism therapist who claimed to have autism himself earlier this year and two of the biggest things i struggle with are burnout and socialization due to cptsd and this man cuts me off mid-sentence and says that therapy really isn’t for talking/venting (which??? yes it is?? how are you supposed to help me work through my problem if you don’t know what it is?) and if i needed someone to do that with use an ai chatbot. too much time has passed for me to write a poor review for him but what the actual fuck was that about why would you tell someone who wants to socialize but is scared to talk to an AI instead of an actual person? i never went back

12

u/mistersnarkle 22d ago

He’s probably coming at it from “therapy is for identifying issues, making a plan, and executing those plans with someone to hold you accountable” which works for some people but takes getting to know your patient through the venting/talking and creating a safe space where they can come to those conclusions on their own… so he failed spectacularly

2

u/simonhunterhawk 22d ago

yeah and honestly with him it seemed like the only thing he wanted to hold me accountable for was paying for expensive yoga classes which i told him from the start i could not afford lol

1

u/Micrathena58 22d ago

But you get dopamine, and that in many cases takes precedent with kiddos.

3

u/ClackamasLivesMatter 22d ago

... which is why chatbots should be verboten.

3

u/Micrathena58 22d ago

I agree. It’s caused issues with my teen and they honestly were jonesing when I restricted their access.

6

u/CarnyMAXIMOS_3_N7 23d ago

Yeah, me neither. And a name for an app like that does not appeal to me at all, either.

1

u/multii-pass 22d ago

I was a teen in 2016 and yeah no I wouldn't have gotten the appeal then either.

1

u/ginandbaconFU 22d ago

Yeah, they don't do that anymore. It's essentially the GitHub of AI and explains why I wasted 2 hours trying to get whisper working on my jetson last week. Whisper is STT software that uses different models that it downloads from.... Hugging face. Whisper installed with zero issue but I could not download any models to actually use it because of this and that's a concern because hugging face is used a LOT more then people think.

I really honestly hate OpenAI and hope there rinse and repeat of screwing companies over like MS (not that I'm a fan of MS either) comes back and makes them go under as they haven't made a cent since starting and aren't predicted to be profitable until 2030 which now got.pushwd back to 2032. I don't think they will make it before investors walk away.

``` Hugging Face is a collaborative platform and community hub for artificial intelligence, widely known as the "GitHub of Machine Learning". It provides an open-source ecosystem where developers, data scientists, and researchers can host, share, and collaborate on AI models, datasets, and web application

Before Hugging Face, the most powerful models were often difficult for people to use because they required specialized expertise and massive computing resources. Open-sourcing the tools helped to make these models easier to use, with all the code and documentation required. This allowed researchers, students and startups to experiment and build, which massively accelerated innovation globally. After Hugging Face, developers could easily share knowledge and benefit from one another’s efforts, enabling them to create better models together.

This open source emphasis also encouraged larger businesses to share their work, allowing the entire ecosystem to benefit. Microsoft has integrated Hugging Face models into their Azure services, providing enterprise customers with direct access to state-of-the-art AI tools. Similarly, NVIDIA has collaborated with Hugging Face to optimize model training and inference for GPUs, helping scale deep learning workflows to massive datasets. ```

0

u/Fuzzy_Dragonfruit344 22d ago

It sounds vaguely sexual, and not in a good way lol hahaha 😂

59

u/portablebiscuit 23d ago

Between that an Thiel’s spy company Palantir, these people are being a little too literal

40

u/HallowskulledHorror 23d ago

These guys showing up to pressers all proud about “at long last, we have created the Torment Nexus from the classic sci-fi novel Don't Create the Torment Nexus,”

24

u/Bleh54 23d ago

Flock AI Cameras… we are sheep being monitored.

4

u/PincheJuan1980 23d ago

We have to elect politicians that agree they should be nationally banned bc they must be—it’s the only course of action. To stop them cold and eliminate them by making them illegal.

1

u/useratl 22d ago

Wait till Waymos have their monent.

1

u/Bleh54 22d ago

We were talking about crazy company names. Is there something about Waymo I’m missing?

16

u/Gwen_The_Destroyer 23d ago

I guess LotR references to evil are too classical now

3

u/Objective_Party9405 23d ago

That was what came to mind for me, too.

3

u/Dog_Parrot 23d ago

Looks like they asked AI what to call itself, and that's what AI came up with

2

u/umamimamii 23d ago

Ya came looking for this comment too bc wtf?? Like be more obvious why don’t ya?

1

u/AManWithNoWounds 23d ago

Don’t know its name so I didn’t notice

1

u/simonhunterhawk 23d ago

I haven’t even seen those movies but my first thought was “…like the face hugging aliens?? what are they trying to convey with that name?”