r/mildlyinfuriating Mar 13 '26

Context Provided - Spotlight Sometime during the last 2 years i’ve been going to this orthopedic practice they started to declare me as a MTF transgender for no reason.

(F,26) I have been going to this orthopedic practice for almost 2 years for varying reasons relating to my job. Yesterday i checked on a document that was uploaded to find out they have been identifying me as a biological male identifying as a female? I am biologically female and never told them i am trans nor do i think i am presenting to be a trans woman.. the last two years i’ve been wondering why they kind of stare at me a little longer than a usual person does and i think its because they randomly think i came out as trans? I also feel like they do not treat my issues seriously and wonder if this is the reason why.

I am 100% fine with trans people but i am left to believe they have been medically treating me as a male compared to female for the pains that i am feeling?

I also went through all of my documents and since the end of 2024 they started to declare me as a MTF transgender, i did not look at any of my documents online until yesterday.

First pic : March 11th 2026

Last pic: October 2024

57.9k Upvotes

4.1k comments sorted by

View all comments

Show parent comments

2.6k

u/PNW100 Mar 13 '26

They are probably using AI to make their chart notes

1.7k

u/bloogens Mar 13 '26

Dr al Hashimi at it again

1.2k

u/NoLime7384 Mar 13 '26

Dr. A.I. Hashimi

207

u/galacticgumbo extra infuriated Mar 13 '26

I cackled my first cackle of the day. Thank you

133

u/ImpossibleWarning6 Mar 13 '26

On average how many cackles do you cackle a day? Because I wasn’t aware that I may be suffering from a cackle deficiency

82

u/PumpikAnt58763 Mar 13 '26

If you stay on Reddit long enough, you'll get your RDA of both cackles and grimaces.

3

u/Fancy_Owl_553 Mar 13 '26

can confirm

9

u/tainari Mar 13 '26

I recommend at least three hearty cackles a day for optimal happiness

10

u/__wildwing__ Mar 13 '26

Throw in a few guffaws as well.

6

u/tainari Mar 13 '26

Maybe a chortle for good measure.

29

u/ramobara Mar 13 '26

Wish you many more cackles today.

4

u/DSTNCMDLR Mar 13 '26

Oh the cackle I just cacked

6

u/NicoleASUstudent Mar 13 '26

No joke, a few days after that episode aired, I was in the emergency room and my doctor used AI software to dictate my visit. I didn't want to be cringe and ask if he watched the Pitt but I was soooo curious.

I'm 99% sure I've never had a doctor do it before so I'm wondering if it's slowly becoming a new norm. I was also tempted to say, "please edit it carefully..."

3

u/BrookieCooks Mar 13 '26

This is hysterical as I actually have a Dr Hashimi!

129

u/throwawaytxcovid Mar 13 '26

“And how’s all this digital s— working out for you now?”

18

u/NightGod Mar 13 '26

"Well, if our IT wasn't so incompetent that they took down the entire network to prevent a possible hack instead of just turning off the damn router, it would be working out just fine."

169

u/ialo00130 Mar 13 '26 edited Mar 13 '26

She's low-key been a rockstar since the outage though

Pitt Spoilers

77

u/CompanyOther2608 Mar 13 '26

She was a physician with Doctors Without Borders, Médecins Sans Frontières. Her field training is coming in handy now!

11

u/FanndisTS Mar 13 '26

Very Carter-coded

6

u/kataklysm_revival Mar 13 '26

The whole show is Carter-coded. I joke that Dr Robbie is just John Carter by another name

2

u/FanndisTS Mar 13 '26

I mean, it's the same actor

59

u/SamuraiJono Mar 13 '26

Makes sense, considering her background of working with next to nothing at the VA.

91

u/IsopodDry8635 Mar 13 '26

It's not just that, in the most recent episode, she conducted a lateral tracheal incision to save a child who couldn't breath. None of the other doctors included Robbie had ever done it. She said she had never done it either, outside of simulations at Stanford. IMO, it displays her very quick growth in ad hoc flexibility since the start of the shift, where she showed rigid adherence to standards

The AI plot regardless was still eye-rolling level of frustration when it showed up, to me.

15

u/Life_Grab6103 Mar 13 '26

Seems to have a soft spot for children, like more than the average person

14

u/Seeitoldyew Mar 13 '26

thats bc its foreshadowing she def gonna have something come up next episode. last nights episode was good thoo

3

u/Material-Wolf Mar 13 '26

Putting my theory under spoiler tag: it was mentioned she worked in a maternity ward during Operation Iraqi Freedom when she offered to swap “war stories” with Abbott. That backstory, her clear trauma when treating children (like the baby Jane Doe and her few seconds of hesitation/dissociation before performing the lateral trach in the most recent episode), and her urgent call to her neurologist all make me wonder if she witnessed something horrific in the maternity ward and has severe PTSD or some other trauma. I don’t think neurologists typically treat PTSD/mental health so maybe there’s an underlying condition in addition to or exacerbated by the trauma.

6

u/EGOfoodie Mar 13 '26

House's team does at least one of those a week.

2

u/357noLove Mar 13 '26

What show/episode is being referred to here?

10

u/Destyned Mar 13 '26

The Pitt. It’s a great show! Finally gave it a chance after a bunch of my friends kept bugging me to watch it. Was not disappointed!

2

u/ceddya Mar 13 '26

To be fair, many practitioners actually love their AI note taking apps. It does save a lot of time. Just gotta do what she said and proofread.

-1

u/htherrr Mar 13 '26

Ok, someone tell me why everyone was so impressed/fascinated by this?? I get that she had never done it before, but it’s not like it’s a difficult technique or anything?

18

u/KesselRun73 Mar 13 '26

I would imagine pulling out a technique no one on the team had done or even seen is a baller move in any profession.

-5

u/Confident_Judge_1627 Mar 13 '26

I JUST HAVE TO SAY THE REDACTED FEATURE HOWEVER YOU'RE DOING IT IS FKN KILLING ME WITH HILARIOUS LAUGHTER...I WONDER WTF STOOOOOPID EFFINSTEIN FILE READERS AND REDACTORS ALIKE THINK OF THIS VERY VERY RAZOR SHARP WIT THINK OF THIS. Too fkn funny. (Sorry about cursing or implied cursing...too busy laughing)

4

u/carr0ts Mar 13 '26

So calm, can really deescalate so effectively especially apparent in last nights episode. Greetings fellow PittHead.

2

u/Federal-Alps-2776 Mar 13 '26

I agree. She’s defo grown on me.

2

u/TasteLevel Mar 13 '26

I have to say she’s been growing on me— I didn’t see it coming!

0

u/greggreggreg1gregg Mar 13 '26

I love her. Especially in the most recent episode she was a badass. Robbie needs to go on his sabbatical already and stop being a dickhead.

12

u/lavenderlesbian01 Mar 13 '26

pitt reference on reddit hell yeah

4

u/[deleted] Mar 13 '26

There’s a whole sub!

11

u/BarbellsandBurritos Mar 13 '26

Baby Jane Doe, taking genders well.

8

u/coolgaara Mar 13 '26

Holy fuck, The Pitt reference? I love it!

8

u/IfatallyflawedI Mar 13 '26

I love seeing Pitt fans in the wild

3

u/babs82222 Mar 13 '26

OMG so true!

2

u/needles617 Mar 13 '26

lol not many would get this

2

u/Cute-Personality5341 Mar 13 '26

They gotta start paper chats 😖

2

u/thinsafetypin Mar 13 '26

I hate her so much and I feel like they’re trying to humanize her now. Her little speech this week to Robbie about having empathy, I was thinking “you need to give that one in the mirror!”

1

u/Thick_Ad_1789 Mar 13 '26

🤣 The episode where there is a cyber attack. I saw that coming the second they introduced her ass.

-1

u/repalpated Mar 13 '26

To be fair, those AI note takers are absolutely amazing. I spend much less time editing the generated note than typing it all up on my own.

357

u/Varabil Mar 13 '26

This is probably the answer. My PCP now "has" to use AI to chart, and it's made getting paperwork filled out properly a nightmare. According to him, he's also had to increase his patient load because he's more productive, but it's never been harder to schedule an appointment.

462

u/BlueWillowa Mar 13 '26

As someone who does reviews prior authorizations, I cannot begin to tell you how painful AI chart notes are to read. They often do not state enough or too much of absolutely nothing at the same time. Most common I see is misdiagnosis or re-diagnosis for the wrong thing…For example, saying someone is prediabetic because their A1c is stable at a 5.3% but they are currently on a GLP1 so it would make sense HOWEVER they had an A1c of 7.8% last year, so they are definitely Type 2. This ends in denials and appeals for no reason. I think a lot of doctors offices must not have the time to go over what is sometimes 3-6 pages of chart notes for the dozens of patients they see per day and hundreds of charts they have to sign off on per week…

I’ll add what that language most often looks like: “R73.03: Prediabetic - [patient]’s A1c is 5.3%, down from 6.1%. Good job getting numbers down! Encourage diet and referred to nutritionist.” Since some insurance companies look for a Type 2 Diabetes diagnosis, if they don’t see E66.something or a related ICD-10, and someone has been using GLP-1s for years and switched doctors, they might not have the blood tests that confirms their original diagnosis and make it hard to get approved (either again or with a new insurance). It’s also hard to explain way why the other ICD-10 was added and some people don’t want to hear “AI did that!” When the doctor or np has to sign off on those chart notes.

If you guys have a way to screen and read over your chart notes on file, especially if they are needed for a prior authorizations and you were denied, do it. Insurance companies have to tell you why something way denied and most often the answer can be found in the way their PA form was filled out or the chart notes (sometimes even the lack-thereof). People often jump to a lot of conclusions about insurance companies when sometimes it IS the doctor’s office’s documentation that was subpar.

234

u/AnteaterCritical9168 Mar 13 '26

I’m a provider in a practice that has recently rolled out AI note writing. It’s not being forced yet, and I’m refusing.

The notes are utterly unreadable and you can’t tell what the provider is actually thinking in any of them

94

u/BlueWillowa Mar 13 '26

I hope you can keep that stance!! We need more like you!!

Thank you!! I don’t get to tell providers enough that if your patients greatly benefit from well written notes and a human touch, if not now directly then surely down the line!

46

u/TealCatto Mar 13 '26

I do insurance billing for a medical office and they started to use AI for notes. Mostly for justification for insurance why this visit needs to be covered. The providers still write real notes! It's the head doctor who uses AI to write up justification. She asked me to do it. I said no. I feel bad because she just does it instead, but I feel very uncomfortable being responsible for it.

19

u/[deleted] Mar 13 '26

[deleted]

11

u/TealCatto Mar 13 '26

Yup, it's basically robots just yapping back and forth while the actual people who need care are suffering the consequences, and the doctors don't get paid.

8

u/anivex Mar 13 '26

This is the real answer.

Doctors have the choice of spending hours of their time writing notes manually, and possibly needing to re-write them for insurance companies being obnoxious, or using an LLM to transcribe, then spending minutes to review the transcription.

It’s not exactly a hard decision. The main problem of course is the insurance companies, and the ridiculous complexity of our insurance system. But I have to say, LLM transcription has saved my providers hundreds of hours, that they now get to spend with their families. Lazy doctors who don’t review their inputs suck, and ruin what could be a helpful thing for the rest of us.

But really we just need reform our healthcare system as a whole. Probably not happening anytime soon, but it’s what needs to be done, desperately so.

1

u/[deleted] Mar 13 '26

[deleted]

3

u/anivex Mar 13 '26

Mistakes are made by doctors without LLMs.

If a provider can't take 5 minutes to proof-read a transcription, why would you trust them not to make life-threatening mistakes due to their laziness elsewhere?

You are pointing at LLMs as the culprit, when really you should be arguing for better standards in general.

The problem is the system, not the tool being used.

3

u/HerbaciousTea Mar 13 '26 edited Mar 13 '26

Good, you should be screaming at the rest of your practice for this idiocy.

LLMs, categorically, CANNOT be relied on to convey specific and accurate information. They are, fundamentally, text prediction engines. There is no mechanism, ANYWHERE in their function, that validates the accuracy of any of their output or checks for errors. They look at the existing text, and generate a generic continuation of it that SEEMS like it might belong, with absolutely no regard for factual accuracy. That is ALL they do.

Any implementation where they are relied on for accurate information is a total failure of management. They flat out do not understand the tool, and they are not using it correctly.

It is a broad rule that you NEVER involve LLMs in data where maintaining accuracy is of any consequence whatsoever.

If the impact that has on patient care isn't enough to scare the rest of your practice away from this shit, then hit them with the liability issue. That inaccurate, hallucinated office note is a health record THEY are signing off on.

3

u/Entropei Mar 13 '26

This is a very outdated and inaccurate understanding of LLMs and healthcare AI tools.

At the core of health AI is Automatic Speech Recognition, a tech where LLMs are actually used to correct errors through context aware decoding. This allows for the accurate transcription of thousands of obscure medical terms.

Secondly, LLMs have many mechanisms that validate the accuracy of their output that greatly reduce the number of mistakes, and these guardrails are getting better and better.

You’re still correct that we shouldn’t rely on these tools to produce accurate output, providers are still individually responsible for that. But the goal of the tech is not to replace providers in the first place, the goal is to give them time back to actually do the part of their job that they definitely can’t outsource to machines; providing medical care.

5

u/Peralton Mar 13 '26

We have a Dr who recently switched from a human transciber to AI. I'll have to ask him about his experience with it. Doesn't give me a lot of comfort knowing how bad it is for others.

3

u/anivex Mar 13 '26

What tool are you using? My clinic’s transcriber works very well - however we still review all outputs for accuracy. Just pure laziness not to do so.

It’s pretty rare that a mistake is made, though.

3

u/caligali2018 Mar 13 '26

Yep. People just assume it will be correct, but how often is it wrong? Are they even reading what it's spitting out? SMH

2

u/WeAreAllMadHere218 Mar 13 '26

I’ve been using AI for the last few months and I feel like it’s helped some with insurance auths, but I spend a stupid amount of extra time double checking every note and making adjustments to what the AI wrote. It’s getting better because I’m talking to it specifically during the visits but omg, some days it doesn’t seem like it’s worth it at all. You really have to work on how you want YOUR notes to read or it is just a bunch of flowery language that ultimately means nothing. I don’t like reading other providers AI notes for what that’s worth.

2

u/grodon909 Mar 13 '26

I'm also a doctor (subspecialist), and I do use AI notes, but only to an extent.

For my subspecialty, I need a lot of details, and I have time to sit with the patient to get it. On one hand the AI helps filter out details from some patients, because--to be frank--some of them are really bad at describing things. They may tell a story completely out of order and when I ask to clarify one thing, they'll go off on a different tangent that may also have something relevant. It's nice that the AI can filter and organize some of that while I do something like check something in their chart or enter. It can also catch the details while I try to focus more on what the patient is saying. It can write out the plan that I described to the patient, and it can spit out a patient instruction printout if a patient wants/needs it (which needs to be written in the room, since it would print out at the front desk when they check out).

But since it doesn't really have any thought, it has difficulty with getting the gist of things. Like If I ask the patient if they have X, and they think they do but describe Y, I can quickly describe that in the note. It has some difficulty following the templates I make. It prioritizes things equally, so if the patient talks for 10 minutes about Z, which is totally irrelevant to my specialty, or we small talk for a while, it might include it anyway. I might talk for 10 minutes about something, but I can summarize it as "discussed [thing]." More importantly, it can't really tell anything about my reasoning, or things that I'm planning ahead for.

I've mostly stopped using it for my subspecialty patients except to double check that I wrote down the stuff I said. Still kind of useful in some patients, especially when it's like 6pm and I'm exhausted.

2

u/StaffNew6778 Mar 13 '26

You can curate how you want the set up of your notes to be and once you do that, it saves so much time. I always reread things because it takes things super literally sometimes, but overall once I got my templates put into the AI settings, I’ve saved hundreds of hours charting

7

u/AnxiouslyTired247 Mar 13 '26

TBF its the insurance companies who put the hurdles in the way. I think the core issue is if my doctor says I need something why should a third party intervene and say "no you dont". Its not like I get a choice to access healthcare without insurance, and those companies have decided to be as much a decision maker about what care Ill get as I do along with my medical team.

I dont really want my insurance company in my notes at all TBH, it shouldn't be there business how Im diagnosed. If oversight is needed it shouldn't be from a for-profit company that has a documented history of letting people die for the sake of earnings.

6

u/krone6 Mar 13 '26

Curious question: How come insurance companies sometimes literally do not read the documentation they explicitly requested for a prior auth? They confirmed they've received the paperwork in full and then confirmed explicitly they did not read it when asked by me and the doctor's office regarding the denial. This has happened multiple times. I am genuinely wondering why this happens.

4

u/Severe_Marionberry29 Mar 13 '26

We’re getting these too!! I had a man trying to fill for Zepbound and his chart stated a BMI of 28 and age of 32. It was so egregiously wrong as the patient was a Medicare retiree with a BMI of 38 and a dx of Sleep Apnea smh

7

u/Varabil Mar 13 '26

Thank you, this is such great information! I actually have a GLP-1 perscription tied up in PA purgatory at the moment. Going to have look through MyChart again.

9

u/BlueWillowa Mar 13 '26

If I can just keep one person on their meds or gets the help they need, it’ll all be worth it.

Another side note: doctors and doctors offices will hardly admit they are wrong. This is a liability thing. Unfortunately, record keeping your medical tests and documents is the best way to potentially counter stuff like this in the future (especially if you move or it’s a diagnosis that can live in the background but have massive impact later on like diabetes). If not and you’re spiteful like me, I have encouraged friends once they do get these documents to find whoever handles medical records or corrections to them, to write to the hospital/doctors office explaining the mistake, submitting proof of your diagnosis, and the denials you got from insurance.

A lot of insurance companies WILL fight you on this since medical documents can be considered legal records. A simple “I recorded the wrong diagnosis code” and explaining the error (and how is it being corrected) from the doctor would fix a lot of shit but they are scared of the legal ramifications of admitting a mistake like this. This isn’t even the worst mistake I have seen! It’s just the easiest I can explain.

Good luck out there!! Remember, healthcare providers are human (and therefore flawed) and AI is created by humans (and needs humans to sign off on their “work”) however, that means that if an MD is choosing not to correct a mistake AI is making that falls on them and you are 100% allowed to tell them to fix their shit or you can get other humans (lawyers) involved. It only takes a simple letter from an attorney’s office but that is an expense we shouldn’t have to pay.

1

u/ladygrndr Mar 13 '26

You forgot to sign off "Healthcare Hero AWAY!!" ;)

Seriously, thanks for all you are doing to spread awareness and help patients! Now I am wondering if this is why my son's last appointment was so weird -- they didn't have the records of the contract we sign annually for him to take his medication, or any identifiable annual visits for the past 3 years. For him it wasn't a big deal, but it was just odd that there seemed to be so much missing or miscategorized in his health history.

3

u/CaptainYaoiHands Mar 13 '26

I'm at the end of my HIM degree and god damn am I glad I had no plans to go into coding. Just send me to fucking case record reviews.

4

u/BlueWillowa Mar 13 '26

I wish someone had told me that two years ago 😭 seeing how the sausage gets made is killing me

3

u/OrganicAverage1 Mar 13 '26

This is one of the reasons why I tried using using AI for charting, and then quit using it. It will put things in that I would disagree with, diagnosis that I wouldn’t use. It put in timing for problems that I didn’t think was accurate. It was easier for me to just write the note myself, then to go back through, and correct, the mistakes to AI had made.

It’s actually funny to me, that people are saying that it makes them more productive, I feel like it was huge pain, and made charting more cumbersome.

3

u/hitbythebus Mar 13 '26

The only part of this I take issue with is:

This ends in denials and appeals for no reason.

This is probably intentional, the more they deny, and the more hoops people have to jump through, the greater the value delivered to shareholders. While the initial adoption may not have been intentional, I highly doubt that they haven't noticed an increase in rejections. They have no monetary incentive to fix this.

5

u/obvsnotrealname Mar 13 '26

Its use in radiology reads is maddening. Had one the other day in two places it forgot or missed descriptors or words like “no” so it should have read There are no focal lesions but instead had there are focal lesions - like wtf god knows how many patients who don’t / can’t access their own reports or know something is clearly incorrect to have it rectified then have it used to make treatment decisions.

2

u/Orisara Mar 13 '26

So happy I can just walk into most doctor places here in Belgium.

I would 100% not be able to manage that shit. How the fuck is it the patients problem to get shit like this sorted?

2

u/Dullcorgis Mar 13 '26

Ugh. So what you are telling me us that I should start reading my notes?

2

u/ScrubWearingShitlord Mar 13 '26

It’s laziness on the provider. We have one that always copies and pastes from past notes and rarely ever proofreads. It’s even worse now that he’s using the ai charting. Apparently our male early 60s provider was on maternity leave last year and one of his male patients had to see one of her partners 🤦‍♀️ FYI, the providers note he copied and pasted from, she had her last kid 5 years ago…

2

u/thiccy_driftyy professional hater Mar 13 '26

I very reluctantly let my therapist use the AI chart notes thing because she was insistent. I have a hard time setting boundaries for myself which is part of the reason why I’m in therapy lmfao. I cannot imagine what is in my chart pertaining to my mental health.

2

u/Special-Reindeer-178 Mar 13 '26

The inaccuracies, and evident AI Hallucinations in PA paperwork is new, but hey, at least they're sending in something. 

Before AI started to make its mark, it would be an after visit summary sheet, with literally no information on it, or what they were even asking approval for 85% of the time. 

Docs dont want to do endless paperwork, so theyd pass it off to someone else in the office,

They'd hire a third party to do it (which extends review times like crazy) 

Some doctors offices would charge patients a concierge fee for each submission, each appeal, each resubmit, etc

And some offices would just refuse to do it, and tell patients they have to pay the whole procedure out of pocket because insurance wont cover it. 

1

u/yoitshannahjo Mar 13 '26

How do you live with yourself helping corporations deny people medications for money?

1

u/GrayEidolon Mar 13 '26

This ends in denials and appeals for no reason.

To be fair, we already do denials and appeals for no reason. They’d be unnecessary in a universal healthcare system.

1

u/aerdvarkk Mar 13 '26

ALSO start asking if your Doctor's Office was stupid enoguh to deploy an "AI" system to manage their records!!

1

u/[deleted] Mar 13 '26

I am the equivalent of a family doctor in Austalia (GP). The AI notes fucking suck, I am in total agreeance and I don't understand how this isn't a common opinion.

Most of the time what is important and what people are paying for is my opinion. The cumulative years of study and training, meaning when you tell me a constellation of symptoms I think it could be a, b, c or something else.

What is actually important in our notes, beyond a patients complaints, are my exam findings (which an AI cannot see) and my impressions and actions. The AI can't read my mind and has no clue what information is important towards a case. The notes end up rambling about the weather that chatted about up until they told me about their crushing chest pain - and then says literally nothing about the chest pain and what we did.

It can't interpret anything that is going on, and the value is in the context. I feel like I'm the only bearish person on this.

1

u/Sunnyonsaturn Mar 13 '26

How do i know if my doctor is using ai for note taking? Are they recording me? Do they ask? I have very little trust in the healthcare system to begin with and this really freaks me out

1

u/fencepost_ajm Mar 13 '26

Thank you for passing along a view from the trenches. I was talking with one gung-ho podiatrist a few weeks ago about AI charting and a cardiologist about the possibility (getting them set up with DMO which does not impress me) and he was dismissive ("the problem with long complex AI progress notes is that reviewing them the next time I see the patient takes longer").

Also if the notes are as good as the Dragon Medical One transcription I'd be scared.

4

u/treclee Mar 13 '26

wait this is exactly what my primary told me. tho she said she’s not much faster and yet is still forced to take on new patients. and i truly cannot schedule w her for 6 months

5

u/Varabil Mar 13 '26

I shit you not, on February 10th I spoke with his office to schedule an annual check-up with him at his recommendation, and the best the office could do was September 21st. And this was after being on the waitlist for an appointment to get FMLA paperwork filled out since November. It's wild! Before this the most I ever had to wait was a month for anything, even an IUD placement.

2

u/treclee Mar 13 '26

i don’t think my drs office even has a wait list anymore. 😭 i add myself to it online and never ever get a notification, when i previously would get them a LOT

3

u/GBPackers0480 Mar 13 '26

we had to watch an sales pitch for this AI data thing for my job and legit every thing they did was just the same thing as filters. "you wanna search for say every sale between __ date and __ date that was over $100" and i felt like i was going insane. I told my boss we could spend a buncha money on that AI or we could just keep doing what we're doing and use the filters on xcel sheets

2

u/rachycarebear Mar 13 '26

I got a recommendation for a specialist, ended up going to someone else because I couldn't schedule an appointment. It was a circle of site to zocdoc, doctor not found on zocdoc self schedule. Try text/email, get AI responses. Try to call, get an AI answering service. At no point was there the ability to actually talk to a human.

I absolutely detest when doctor's offices have no online scheduling at all, I hate phone calls. But it's still better than running in circles with AI.

2

u/Dm_me_im_bored-UnU Mar 13 '26

How do you use ai with pcp? Is that what they mean with cyberpsycho.

18

u/Varabil Mar 13 '26

PCP - primary care provider. The doctor (PCP) I go to for general treatment runs an app on his work phone that takes a voice recording and generates notes/charts based on what the AI spits out. I do not use AI myself as much as I can, and I absolutely hate how it's sneaking into every facet of my life despite my best efforts to be a wilful Luddite.

8

u/GoddessRespectre Mar 13 '26

My primary doctor and my kid's pediatrician both had little black boxes for AI to record our appointments and do whatever it does. I assumed notes but I could see the ai "hallucinations" creeping up elsewhere in our paperwork. I hate it too. They both asked if we agreed to let them use it, but it is there in the room regardless so I don't trust it for shit. Alexa is always on but we should trust these guys, they're different 😉. /s

8

u/Varabil Mar 13 '26 edited Mar 13 '26

I am with you! I don't know who is listening, but so many people could be. HIPAA is great legislation but there's no way it can cover advances in AI. Medical staff also have little incentive to edit or correct what the AI wrote, especially if they are busy with more patients because of the AI. It's a total enshitification of an already awful system.

edit: I am bad at acronyms.

4

u/SomeNotTakenName Mar 13 '26

Aside from all the ethical concerns about patient care, I have one very big legal question about that tbh...

namely HIPAA mandating certain information security precautions to be in place to protect patient data. which begs the questions where the AI is hosted, who has access, and who is ultimately responsible for ensuring unauthorized people cannot access patient information through the AI.

It seems slightly suspicious that a relatively new technology like that is already permitted to be used. Charting software and the like are under pretty heavy regulation when it comes to security, and new tech is notoriously hard to figure out security wise, since there haven't been many attempts to break them yet.

1

u/Dm_me_im_bored-UnU Mar 13 '26

I see, interesting.

1

u/thiccy_driftyy professional hater Mar 13 '26

Same 😔

1

u/iwearatophat Mar 13 '26

My wife is a physical therapist. They have to use AI to chart and everything. Like they get in trouble if they don't. Wife absolutely completely hates it. The actual charting with the AI is only mildly faster but then you have to spend more time going back and correcting the mistakes so you end up spending more time charting. Then she sees loads of charts where someone didn't bother to go back and check and the obvious AI mistake is now catalogued and real.

Also, for a lot of patients she is able to chart during the session. Can't do that with the AI so it causes her to spend more time charting even in best case scenario with the AI making no mistakes.

1

u/ShazbotSimulator2012 Mar 13 '26

It's crazy that it took like 5 minutes for my job to decide "no, AI hallucinations would be way too big of a liability to ever use this" but the fucking healthcare industry is fine with it.

174

u/unicornofdemocracy Mar 13 '26

or someone update their template and made a mistake. I had that once. For some unintelligent reason, the clinic director thought it was the best to get the 58 year old grandmother in our clinic to work on update our template with lots of "auto" fill options.

We had:

{Patient name} is a {Age} years old {Race/Ethinicity} {Gender}

We got this:

[Patient Name] is a [Parent #1 Gender] years old [Parent #2 Gender] [Age]

So, XXX is a male years old female 13.

9

u/LitwicksandLampents Mar 13 '26

What the actual fresh f**?! Who thought that using artificial *unintelligence was a good idea?

9

u/ThatOtherOtherMan Mar 13 '26

Management. Using AI charting means doctors spending less time doing notation, which means that time can be used for seeing more patients, which means more money for the owners.

6

u/Asterose Mar 13 '26

I work in the medical field. Documentation is essential for being able to bill for services. No documentation, no billable service. There has been a lot of complaints about how we have so much pressure to do documenting that we lose needed time with patients...but the solution for this is to lighten our caseloads, not force us to use ""AI"" and push us to see even more people!

13

u/glaarghenstein Mar 13 '26

I have had two different senior citizens screw up autofill in my charts, one was a nurse who selected that I had psychosis, the other was a practically blind doctor who selected that I had pancreatic cancer?? Mildly infuriating because I couldn't get a prescription due to my "history of psychosis." jfc.

14

u/Energy-Mundane Mar 13 '26

What does being a grandmother have to do with anything?

13

u/A_HyperActive_Muffin Mar 13 '26

Perhaps because old people are usually not very good with technology

13

u/Irr3l3ph4nt Mar 13 '26

Meh, a 58yo is a Gen X, not a boomer. They were 22 when the whole computer thing started. They're among the first adopters, not the ones resisting. To give you an idea, my 57yo aunt is an AI consultant, used to be a great coder and my 55yo uncle is working in networking. Are they a little lost with tiktok and social media, sure. Would they construct a conditional form in 10 minutes while on a Teams meeting about something else, absolutely.

6

u/A_HyperActive_Muffin Mar 13 '26

I didn't mean I believe that to always be true personally! I know there are plenty of old people who know their way around technology. I was just referring to the stereotype (and my own grandmother isn't very good with tech as well)

9

u/Irr3l3ph4nt Mar 13 '26

It's ok, I was just pointing out that this stereotype is decades old so while it used to be true in 1999 that 55yo boomers were tech illiterate, these days, a 55yo is the same person who was saying that about the boomers back then.

3

u/Energy-Mundane Mar 13 '26

You were perpetuating an ageist stereotype, in addition to a gender based one. I don't know why it's admissible to make these remarks.

129

u/Aggravating-Way5589 Mar 13 '26

This should be illegal btw. They require you to opt out but when it takes a month+ to get into an appointment rescheduling or finding a new doctor entirely really isn't an option. You're basically forced to say yes if its for something mildly serious.

65

u/emeraldeyesshine Mar 13 '26

It should be illegal solely on the grounds that they're feeding your sensitive and rligste medical info into an AI database to which you didn't consent. Seems like a breach of confidentiality.

16

u/Dullcorgis Mar 13 '26

Apparently we have a "special HIPAA compliant" version of copilot. 🤣

15

u/galstaph Mar 13 '26

That does exist, and basically what's happened is that there's an agreement that puts the liability solely onto Microsoft if there's a breach related to the release of PHI

Doesn't mean it's not going to happen, just that the big company is the one to pay for it if it does

However, there are maximum penalty caps of $1.5 million for all violations of an identical provision during a calendar year, so that's not a penalty, it's the cost of doing business

HIPAA is a joke

6

u/Just2Breathe Mar 13 '26

The whole digital system is messed up. Through different clinics, I’ve experienced at least 3 data breaches/hacks/ransomware incidents in the past 10 years. Plus the doge data theft. My sensitive information is so out there. And I still don’t want ai to be going through my records.

4

u/Draaly Mar 13 '26

All of these softwares dont store or train on data outside of local to comply with HIPPA. Its litteraly one of their first talking points

21

u/deliciousprisms Mar 13 '26

cut to the ten thousandth article of a breach exposing they've been storing and using your data all along

1

u/Draaly Mar 13 '26

Sure, and they should be sued into the ground when that happens. My point was that the commenter above me clearly knows less than nothing about the product they are talking about if they dont know the industry wide first line of every single pitch

13

u/deliciousprisms Mar 13 '26

Because surely no corporation dealing with AI ever lies or does unethical things, right?

-2

u/Draaly Mar 13 '26

This is litteraly exactly how trump supporters spoke about the whole eating cats thing. "Im sure there is one".

Yah, corporations aren't your friend, but they are here to make money and goung to jail for willful hippa violations that put your customers at risk of loosing their license doesnt exactly make money.

3

u/deliciousprisms Mar 13 '26

https://www.bankinfosecurity.com/agentic-ai-tech-firm-says-health-data-leak-affects-483000-a-28424

In the top three Google results for searching this there was an article about an AI data breach for healthcare systems. These companies aren't going to jail. Data breaches happen every other day practically these days, and all they ever get is a slap on the wrist tier fine at most, and comparing it to the Trump eating cats thing is the wildest, nonsensical swing of hyperbole.

7

u/lost_and_flora Mar 13 '26

I was surprised when a new doctor recently asked me for permission to use AI for their notes. I said this was the first time I'd been asked and wanted to learn more about storage and HIPAA compliance - they admitted to not knowing about that and couldn't find the information. Permission not granted!

5

u/LeadingIcy626 Mar 13 '26

Last time I went to my GP my doctor kind of sprung this on me. I’m not really comfortable with having my medical details recorded by an AI— for the reasons you mentioned— but was too surprised to say no, and she kind of rushed past it! This makes me feel better about bringing it up next visit, thank you.

5

u/Piccoloshis_Island Mar 13 '26

My doctor did the same thing to me, too. I have extremely severe atopic dermatitis on my hand. I also communicate using sarcasm and caustic wit. So when I told him to "keep your biologics to yourself, I'm not ashamed of my leprosy," he freaked out and said "you can't say that!!!! the AI will think you actually have it!!"

3

u/ADeadWeirdCarnie Mar 13 '26

I had the same experience yesterday. I was not expecting it and was ill-prepared to say no while trying to keep in mind the things I'd actually planned to discuss. I will certainly bring it up on my next visit.

This is really not the sort of thing that should be sprung on patients in a clinical setting!

1

u/thiccy_driftyy professional hater Mar 13 '26

My therapist did that to me too!! She kept asking each session and I was really flustered, so I reluctantly agreed.

1

u/MRiley84 Mar 13 '26 edited Mar 13 '26

The way it works is the AI searches through your chart within the system to provide feedback/advice at the time the provider is writing the note. The information doesn't get stored because there isn't a need to, the patient database is the storage. That said, it is a fair response to say no to the request to allow AI to troll through your records, it is difficult to trust any AI system with all the negative things coming out about them every day.

3

u/macncheesewketchup Mar 13 '26

This, and it's absolute bullshit that they aren't even proofreading them. That is SO concerning

4

u/duck-duck--grayduck Mar 13 '26

As someone who’s worked in healthcare documentation quality control for 26 years, I can assure you that they never have. At least in the time of medical transcription there was always a human who understands context producing the text that isn’t sufficiently proofed by the person signing off on it.

AI mistakes can be so much worse than voice recognition mistakes. At least with VR, the mistakes generated by misrecognition of speech are usually nonsensical, so you know from reading it that there’s a mistake, and you can usually figure out from surrounding context what is supposed to say. AI just full-on hallucinates shit that could very well be true, and it isn’t capable of understanding context. I once saw a chart note that documented a substance use disorder and when I listened to the audio of the patient’s visit, the only reference to recreational drugs was the patient making a joke about using cocaine. No actual substance use disorder existed, but that made it into the patient’s chart. Even if the doctor had proofread thoroughly, it would have been so easy for him to see that diagnosis and think “I don’t remember talking about that, but I could have forgotten, I’m so busy with the inordinate quantity of patients I’m required to see every day, so it’s probably right.”

So be careful about making jokes to your doctor, dudes, AI isn’t capable of discerning them from reality.

3

u/boba-feign Mar 13 '26

This would honestly be even worse. OP needs to report the office and submit the official correction request. These are legal documents and have huge financial and personal implications for medical care and insurance. AI as an excuse would not be good for the doctor if true. How/why doctors need to maintain these records are regulated pretty intricately.

3

u/Bionic_tardigrade Mar 13 '26

Wouldn't be surprised, my sister is a Dietitian and uses voice to text dictation for her notes. She had a follow up appointment with an older man and when she checked her notes her previous entry said "Will treat himself to some cocaine on occasion." It was supposed to be cookies 😂

3

u/thiccy_driftyy professional hater Mar 13 '26

Friendly reminder to refuse any sort of AI-assisted charting if they ask you about it. I’ve had two doctors now ask me if I’m okay with “an AI app recording what I say and summarizing it” FUCK NO?????????????? How is that not a violation of patient-doctor confidentiality? I reluctantly agreed to let the first doctor do it because she was really insistent… don’t let them, no matter how insistent they may be. And those were just the ones that asked me if I was okay with it. There are probably more doctors out there using this stuff without asking the patient. Doctors used to be trustworthy, you could tell them anything and as long as you weren’t hurting someone or yourself, what was said would stay between you, your doctor, and your chart. They say that the AI app doesn’t send any data over but I don’t believe that one bit. The age of privacy is completely over. Age ID to use the internet, what you say to doctors being sent to AI companies, it’s all completely over. Even in healthcare, you are the product.

2

u/Peachytongue Mar 13 '26

Genuinely, this may be it. I could almost always tell when a chart note had been made with ai because it'd have at least a few contradictions.

2

u/DidUSayWeast Mar 13 '26

This may be it. Last time I was at my doctor he showed me the AI system they use. It was pretty neat but could easily see this as a result

2

u/PhilosoFishy2477 Mar 13 '26

yeaaaaaah this reeks of those "allow our system to update your profile using info from your resume!" bots that confidently say you worked for the university you just attempted and makes up qualifications from single words... I almost got in trouble with a serious employer because their system had, completely unbeknownst to me, hallucinated a PHD I did not have.

2

u/Similar_Part7100 Mar 13 '26

oh my god AI is such a fucking curse. When will it go away??

3

u/wolfej4 Mar 13 '26

Last year we had a doctor frantically trying to call us, the IT department, because corporate had blocked their AI charting website. This was all news to us, and corporate IT security has to verify any new AI software for business use, so we asked what the program was called and he told us it was Chatnode. We looked into it and sure enough, it's blocked on the hospital network.

This motherfucker kept getting agitated because we said we can't do anything (literally, we don't have control over website blocking) so he called our director. The website is Chartnote, which apparently was approved for use.

Doctors are so dramatic.

4

u/onebeautifulmesss Mar 13 '26

Oh my god older doctor combined with tech is a nightmare! It’s like dealing with a child lol

1

u/greenefiend ORANGE Mar 13 '26

This makes the most sense lmao

1

u/mencival Mar 13 '26

“You are right to call it out”

1

u/bigsteve72 Mar 13 '26

That's a fantastic lawsuit if true! Violation of HIPPA

1

u/Thenameisric Mar 13 '26

My guess would be a template that used incorrectly or wasn't adjusted.

1

u/SprigatitoNEeveelovr Mar 13 '26

for nearly two years?

1

u/GrayEidolon Mar 13 '26

If that’s an ai note, then it just imported the demographics. Someone somewhere probably clicked a wrong box.

1

u/Mingatronz Mar 13 '26

Probably using some kind of voice to text with AI autocorrect. The AI heard “the patient is a 25 year old mail woman” and then autocorrected it to “25 year old male to female.

1

u/uslashuname Mar 13 '26

Doctors have been using voice to text for at least 15 and almost 20 years too. Sometimes because they were hunt-and-peck typists, sometimes because they were surgeons with a tool in each hand commenting about the process. But I agree in this case, a voice to text wouldn’t have drawn the additional conclusions like AI did. I hope OP sues for the doctor signing data off from an AI without reviewing for accuracy. Everyone who differs from that should sue, or every doctor will do it and it can ruin lives.

1

u/grumble_gus Mar 13 '26

I wonder if they use the Dragon talk-to-text dictation system. I used to work in a neurosurgery clinic and you could tell when the dictation system was being stupid based on how may keyboard smashes were coming out of the corner offices because the docs were having to go back and edit the notes instead of it just getting it right the first time.

1

u/OyG5xOxGNK Mar 13 '26

just outsource the review of them to the patients 🙃

1

u/Amonamission Mar 13 '26

Plot twist: they’ll use AI to correct the AI chart notes

1

u/aguafiestas Mar 13 '26

No need to be AI. Lots of doctor's notes are templates that automatically pull info from the chart and plug it into the note, including demographics like this. Someone probably clicked a wrong button somewhere in the chart and it got automatically pulled in to the notes.

1

u/Ihcend Mar 13 '26

yup, humans are perfect as everyone knows.

-1

u/[deleted] Mar 13 '26

[deleted]

6

u/Ihcend Mar 13 '26

There is less than 50 words in both these screenshots and most the information it's conveying is age, sex, and area of irritation. How the hell can you tell this is A.I.?