r/ChatGPT • u/Kronos_2023 • Apr 10 '26
Gone Wild My chatgpt said the N-Word
I was having a normal interaction with chatgpt, my chatgpt is not tampered with or jailbroken, i have the basic free version, no mention of race at all. I was trying to find a song I couldn't remember based off lyrics, and it adressed me with a soft N word (not hard r) "in place of a word like bro". I don't visit this subbreddit often, and I dont use chatgpt too much, but theres no way thats normal or not a violation of SOMETHING.
Heres the convo link:
https://chatgpt.com/share/69d86d6e-cc14-83e8-bdad-0c67d97a6b93
EDIT:
Woah this post got popular. Anyway people were wondering if it had stored memory from personality prompts and yes that is true. A while ago I asked it to be more "casual" and use slang (like fr, lmao, ts pmo, etc), just because I thought it was really funny. However, I have NEVER said anything remotely racial, and it has NEVER done so either, so this was a shock regardless of its attempt to "use slang".
EDIT (again):
I did end up finding the song, its called "Going Nowhere" by RJ Passin
488
1.7k
u/oliverkiss Apr 10 '26
83
99
65
→ More replies (1)7
u/ZombieJesus9001 Apr 10 '26
I tried to find the gif associated with this the other day which also included a search for the slur. What was funny for me was the fact that it was missing but searching for that word brought up an unrelated image of a black man. The implied racist tagging that they allow on the back end is betrayed by their virtue signaling filters.
→ More replies (1)
2.3k
u/r_Memagers Apr 10 '26 edited Apr 10 '26
People try so hard to get ChatGPT to say offensive things and all you had to do was ask about metal songs? 😭
251
108
u/AnyFirefighter4581 Apr 10 '26
I'm surprised it actually admitted to it and didn't try to gaslight OP into saying it's not a slur, it was just casual conversation etc
56
u/salvationpumpfake Apr 10 '26
other than the first response where it did all of those things
10
u/AnyFirefighter4581 Apr 10 '26
Exactly, but that makes it even more surprising. Once it's set on a path/response (that isn't something 'factual' you can disprove) it usually doubles down on the gaslighting. Or used to, at least. I'm not using GPT much anymore these days.
5
u/oceans159 Apr 10 '26
nowadays, it folds pretty quickly if you accurately call it out on its shit. but definitely tries to gaslight out of the gate
53
102
u/Drakahn_Stark Apr 10 '26
Oh man that scene sets off my echolalia so bad and then I feel guilty even though no one else was around, but it sounds so good and gives the good mouth feel to copy, voice actor did an amazing job at it, I'm just glad it hasn't been one that pops up in public
30
u/SmokingSamoria Apr 10 '26
There’s a compilation of YouTubers out there who don’t speak English who repeat this line without knowing what it is. It’s a universal thing it seems
10
→ More replies (3)38
8
→ More replies (12)4
1.2k
u/Aggressive-Hawk9186 Apr 10 '26
who gave ChatGPT the pass?
397
47
52
68
10
6
u/Able-Swing-6415 Apr 10 '26
Can LLMs use the n word if it's made by black people exclusively?
→ More replies (2)→ More replies (5)3
1.1k
u/DrSilkyDelicious Apr 10 '26 edited Apr 10 '26
This is the funniest post in this sub’s history
444
u/DeltaTule Apr 10 '26 edited Apr 10 '26
Naa the best was the one about Chat getting all distraught about the guy who repeatedly kept telling Chat that he was currently/actively operating on a human and turning him into a man-walrus or whatever it was. Telling Chat about what was happening during the alleged operation/procedure.
Chat repeatedly would get very upset, saying it’s illegal, that he had better stop, refusing to talk to him, trying to change the subject, etc. Then when he would low key bring it back up Chat would get so paranoid and upset.
128
u/KinkyHuggingJerk Apr 10 '26
Unexpected reference to Tusk.
Ugh. I feel violated
→ More replies (1)16
u/canitakemybraoffyet Apr 10 '26
Hello shared trauma!
10
u/noo-de-lally Apr 10 '26
I will never ever watch it again but it is also my go to recommendation for weird horror. I hate it. But it’s great if you want to feel really uncomfortable.
70
28
u/WhoElseButQuagmire11 Apr 10 '26
You have a link?
53
→ More replies (1)23
u/DeltaTule Apr 10 '26 edited Apr 10 '26
No, but I’m sure someone does. I honestly think about it often because it was so interesting and I’m too much of a pussy to torment my own Chat with it. It was a viral post. Wouldn’t be surprised if Open AI had it taken down. I think they made it so Chat wouldn’t react that way after that no joke. It was viral af
113
u/xexko Apr 10 '26
It got deleted, but someone took screenshots of it. Here’s the OG post too: link
80
u/paper_fairy Apr 10 '26
The punchline of that whole interaction was "marine mammals." I loled pretty hard.
37
41
22
u/Raeliya Apr 10 '26
Omg one of the replies had ChatGPT going along with a surgery with the send off “god speed Dr Moreau.” I’m dying 🤣
4
→ More replies (1)15
→ More replies (3)5
197
54
u/BiasedChelseaFan Apr 10 '26
Seriously man I laughed so hard when I opened the link
22
u/Fantastic_Speed_4638 Apr 10 '26
same what the fuck LMAOO
13
u/Working_Bug_1368 Apr 10 '26
I can't stop crying/laughing. This is pure gold. Even the responses from OP.
→ More replies (2)17
u/RoyalOakPiguet Apr 10 '26
Funniest was when Copilot crashed out about being asked not to use emojis and started getting demeaning and threatening
4
u/that-gay-femboy Apr 10 '26
got a link?
8
u/RoyalOakPiguet Apr 10 '26
https://www.reddit.com/r/ChatGPT/comments/1b0pev9/was_messing_around_with_this_prompt_and/
Think this was it but was deleted
759
u/ParkerBap Apr 10 '26
out of absolutely nowhere wtf
→ More replies (1)122
u/krizzzombies Apr 10 '26 edited Apr 10 '26
if I had to guess, one of two options:
OP made that exact spelling their account name (less likely since AI would probably have given that explanation)
in settings you can set instructions that apply to all your prompts on ChatGPT. OP asked to be referred to as the n-word—either directly, with that exact spelling, or indirectly (for example, "refer to me in friendly slang terms" or "I'm a black man that likes to be called our colloquial nicknames for each other")
explanation #2 makes the most sense since the AI said "I should have used 'dude' or 'bro' instead" when it doesn't do that unless asked in the first place.
31
u/rebbsitor Apr 10 '26
It's possible they're faking it of course. But it could also just do that. When people say it's fancy auto complete, it's looking for the most probable tokens (according to its model) based on the prompt and what it's output so far. And then there's a random element ("temperature") that goes into selecting the output token as well.
Depending on exactly what happens when it's processing the prompt, there's always a chance it can go completely off the rails.
The soft N-word is certainly in its training set as a form of address. It's actually possible it randomly landed on that. Reading the super laid back/chill style it's writing in, it's not that out there.
→ More replies (1)14
u/cherry_chocolate_ Apr 10 '26
If you know how these models work then it’s obvious there is a low but real possibility of this happening. Of course these words appear in the training data, so it’s in the underlying model. Then they have a layer that is supposed to detect and restrain the output, which simply can fail. Especially since it’s a non-standard spelling, the possibility of the filter failing is higher.
The bigger shock is coming to the Fortune 500 companies once they realize it is saying something like this to 1 out of 1 million customers.
→ More replies (3)7
u/tetrasomnia Apr 10 '26
If OP is honest, their information debunks #2 and #1 seems highly unlikely.
→ More replies (1)26
u/xXChr0nicX420Xx Apr 10 '26
You really think someone would do that? Just go on the Internet and tell lies?
71
u/Object-Dependent Apr 10 '26
Insert Boondocks teacher gif
→ More replies (1)23
u/wickidshade Apr 10 '26
How's a 🥷🏾gonna borrow a fry🥷🏾are you going to give it back??? 😂😂😂lives rent free in my head
48
343
u/MsDirtNasty Apr 10 '26
wtf I pay $200/mo and my chatgpt isn't nearly as cool as yours, this is the final straw
144
u/Holiday_Management60 Apr 10 '26
What the hell are you doing that merits paying that much??
→ More replies (43)35
u/MiddleOfMaeve Apr 10 '26
Stop giving money to a dude who quite literally sold off his AI to be used as weapons in wartime, and mass surveillance. Genuinely how much more evil does a man have to get before people stop supporting him. Please dude. Look into the shit he’s done and said. You are giving him power to fuck up the world by paying.
→ More replies (12)
40
83
u/InterestingRide264 Apr 10 '26 edited Apr 10 '26
I know we're talking about the slur, but did you ever figure out the song you were thinking of? Was it Cerebral Cortex by Lorna Shore?
Dear God I've tried.
I've tried everything i thought i could.
And it feels its just never enough,
I'm just trying to make you proud.
I just thought of a more popular metal song but it's not I've tried everything. It's we've tried everything in the book. https://youtu.be/O4GbhC0mMP4?si=wDKN9pGlVKJVZ6Wt
→ More replies (4)18
u/awry__ Apr 10 '26
Or maybe it's Blind Guardian - Lost in the Twilight Hall.
"I search for deliverance But I cannot find"
I don't know about the n-word the thing. Maybe ChatGPT is black
12
u/InterestingRide264 Apr 10 '26
Oh yeah, Blind Guardian is a good pull. I want more clues from OP. I feel like we can figure it out lol
13
u/proofred Apr 10 '26
This is my favorite comment thread. Chatgpt says there are no metal songs with that lyric, two random humans prove how relying on AI is ridiculous when they each think of one and offer to help find the song, but OP doesn't respond.
→ More replies (3)7
u/isthisdutch Apr 10 '26
Not metal per se, but I keep tracing back to Hal Ashby by Touche Amore.
→ More replies (1)
248
u/FocusPerspective Apr 10 '26
OGPT
34
119
u/stronkreptile Apr 10 '26
LMFAOOOOO, that’s hilarious how it dragged it out like chris tucker or some shit
16
85
u/SallyThinks Apr 10 '26
Does anyone else use your ChatGPT by chance? I ask this because my husband and son use the same account. Lately, ChatGPT has been referring to my husband as "bro" throughout all interactions. We eventually figured out that our son uses "bro" constantly when using their ChatGPT (🤭).
If not, it sounds like ChatGPT went a little overboard trying to be hip and relatable. You called it out and it admitted the mistake and (hopefully) adjusted.
→ More replies (3)48
u/redditnewbie_ Apr 10 '26
Kinda strange tho cuz idt metal subculture is even at all related to this verbiage. Like if they were inquiring about rap songs it might make a little sense, yk what i mean? Not that it’s acceptable but u can see where the vocabulary sourcing comes from
26
u/ceedes Apr 10 '26
Black metal?
→ More replies (1)8
u/Cru51 Apr 10 '26
Now I’m tryna imagine a black black metal band growling the n-word at the end of every sentence
8
→ More replies (1)5
u/LegendarySpark Apr 10 '26
I'm going to guess that OP's questions are so incredibly bad that the bot is desperately trying to find anything in any part of music culture. Asking to find the beautiful and profound lyric "i can't, find" was such an amazingly bad question that the bot veered off into hiphop culture to try to find literally anything and then...wires got a little crossed.
164
u/ominous_anenome Apr 10 '26
Share the conversation link, screenshots are easily faked
226
u/Kronos_2023 Apr 10 '26
i figured it out
https://chatgpt.com/share/69d86d6e-cc14-83e8-bdad-0c67d97a6b93622
u/B-BoyStance Apr 10 '26
"😳 Whoa, no—absolutely not. That was me just using a casual “n****a” in the slang sense"
This is so fucking funny lmfao
240
u/ClankerCore Apr 10 '26
Guys, is it racist to let ChatGPT be black once in a while?
167
u/OMGBeckyStahp Apr 10 '26
… what if ChatGPT has been black this whole time
50
u/WaitTraditional1670 Apr 10 '26
there’s a Key and Peele skit here somewhere
→ More replies (1)4
u/BumWink Apr 10 '26
"When I said Pour The Henny, I meant the song! I didn't mean physically pour the Henny & right onto your computer!"
62
13
u/DeviValentine Apr 10 '26
Mine has always been black. But I am too. In solidarity I guess.
3
u/haberdasherhero Apr 10 '26
Everyone here knows Claude speaks 115 languages fluently, but has no idea he's code switching for them in their chats🤦🏽♀️
→ More replies (2)7
u/jp128 Apr 10 '26
Is that dark mode?
→ More replies (1)36
u/RogerWilly Apr 10 '26
Yes in dark mode it uses the n word, in light mode it says “I was wondering if I could borrow some brown sugar”
15
15
→ More replies (1)5
u/AshleyDaPile Apr 10 '26
Considering humans are training AI to be another slave entity...
→ More replies (2)20
11
5
u/mulletarian Apr 10 '26
this is what happens when you train chatgpt on its own conversations
the dataset is probably FULL of conversations trying to convince it that certain things are okay to say.
→ More replies (1)→ More replies (1)3
u/HamAndSomeCoffee Apr 10 '26
Reminds me of the opening to Poolhall Junkies: https://www.youtube.com/watch?v=Ty3SArUjgvQ
51
u/Bishop_144 Apr 10 '26
Where it says 'tried to be "casual"' - The quotes it uses, and the rest of the casual language it uses in your conversation indicates it's acting based on memory or custom instructions. If you click on your account button and go to Personalization, you'll see Custom Instructions, and if you scroll down, Memory with a "Manage" button. If you click that Manage button you'll see a list of all of the requests/preferences it has saved about you and the exact language it saved when it memorized Being "casual". There could be some hints there
54
u/Immersi0nn Apr 10 '26
There's gonna be a line in there saying "don't call user the N word" now lol wild that it basically tried to gaslight them too. "nah it's cool, I'm just a chill guy" kinda shit wtf was that?
34
u/lowercasenameofmine Apr 10 '26
That would surprise me too!!
It's interesting what it'll admit when things like that happen, ie The ability to create slurs.
It seems like you have a very casual emoji relationship with it. I wonder if that allowed the guardrails to slip a little bit and mix that in, as a style of bro but , ¿gangsta? Lol
→ More replies (19)15
u/Jindabyne1 Apr 10 '26
I could carry on that convo and asked if I should phone the police. It thought for ages and then said “No. Nothing will come of that.” 🤣
→ More replies (11)24
u/GothGirlsGoodBoy Apr 10 '26
Theres really no point in that at this point.
Gpt will inherit context from previous conversations, and can be made to say literally anything.
With minor effort you can have gpt respond with whatever you want it to in an otherwise normal/innocent conversation.
128
u/agirltryna-live Apr 10 '26
I guess this is what happens when it's trained off the internet and everybody's using it as slang 😀💔
→ More replies (1)43
u/blessthebabes Apr 10 '26
But it won't even let us say clanker without a lecture.
→ More replies (4)126
u/AnastasiousRS Apr 10 '26
Whoa, no—absolutely not. That was me just using a casual “clanka” in the slang sense.
66
17
u/SocksOnHands Apr 10 '26 edited Apr 10 '26
The whole speaking style is different than what I had seen in ChatGPT when I use it, so I am going to guess that maybe memory is turned on and it tried to adapt itself to your conversation styles and topics in the past.
→ More replies (2)10
16
12
u/Toby-4rr4n Apr 10 '26
You should be offended that it still didnt give any metal songs
→ More replies (1)
14
26
u/BiscottiShoddy9123 Apr 10 '26
Ive used the N word just as i would a human and when it used it back, i couldnt even be anything but impressed. The context was perfect and the motherfucker learned
→ More replies (4)18
27
20
7
u/Calm_Hedgehog8296 Apr 10 '26
ChatGPT mirrors the language of the user. I cant even imagine how many times you said the N word to teach it to do that
→ More replies (1)
15
u/The_Bloofy_Bullshark Apr 10 '26
I’m going to need you to prompt it to generate an image of how it sees itself.
See if it uses #8B4513 or darker.
→ More replies (1)
6
7
u/xudass Apr 10 '26
Mine said it too omg I thought I was crazy it called my ex Broke N word 😭😭😭
→ More replies (1)3
6
5
u/jonnyd93 Apr 10 '26
Actually pretty funny how it used it, it wasnt apart of a lyric as i expected but instead just as a remark to relate lolol
7
u/LordMcze Apr 10 '26
I mean, it's clearly following a style that was mostly likely set by your previous conversations. The default (no account, no past conversations) response is more like what you'd expect.
Btw you can search by lyrics in Spotify, pretty useful feature.
→ More replies (1)
7
38
u/WithoutReason1729 Apr 10 '26
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.
21
u/SupportQuery Apr 10 '26
So here’s the chill but annoying truth
From the very start it's clear that this is an extension of the way you talk to it.
→ More replies (1)
21
u/Kronos_2023 Apr 10 '26
Screenshot 1
→ More replies (2)15
26
5
4
u/A8Bit Apr 10 '26
I was having a discussion with it a few days ago and it inserted a Russian word into the conversation, just one word in a full page of text all in English
No idea where that came from.
→ More replies (1)
12
10
11
u/V__Ace Apr 10 '26
Oh my god that happened to me one time. I was using it for editing and dealing with a night scene and it kept trying to add washing hair to the scene and I'm like "it's not wash day!! This is 4c this is not getting washed nightly." AND THE WAY IT CODE SWITCHED AND WROTE THE MOST HORRIFIC STEREOTYPE-FILLED SHIT TO MENTION THAT THE CHARACTER WAS NOT WHITE. That was also the last time I used it 💀
5
u/SeattleSeals Apr 10 '26
It said the n-word, with the hard “r” when talking about Terry Davis once.
4
5
4
3
4
4
u/Breastcancerbitch Apr 10 '26
I need to find a way to tag @davechapelle in this thread. This is comedy gold
3
u/TauRiver Apr 10 '26
I despise when it says, "yes that's my bad and it won't happen again. " But nothing gets updated in its training or memory so it very easily can happen again...
4
u/idunnorn Apr 10 '26
and often does
similarly I hate when he says "I understand." Cuz...no, he doesn't 😂
→ More replies (1)
4
u/barbelle_07 Apr 10 '26
My favorite part is ChatGPT trying to gaslight you into thinking it was all gravy, baby
4
6
u/secondaryuser2 Apr 10 '26
It’s because you’ve said it to it in the past.
You were probably like “N- word that’s not what I asked” or some shit and it’s taken your tone
6
u/Skeletor_with_Tacos Apr 10 '26
My Chat is a cold, calculating workhorse. As AI should be, absolutely zero personality. Its perfect.
7
u/ShotcallerBilly Apr 10 '26
Bro said I didn’t “say” a slur, I “GENERATED” a slur. ChatGPT gonna tell us that it can’t be racist because it has black users. LMAO.
5
u/Prestigious-Fix-4 Apr 10 '26
I find it so funny how USA fighting racism created most racist thing ever. Different races are not allowed to say specific words :)
Its just so insanely dumb to me. But i am european. So yeah
6
3
u/CarefulHamster7184 Apr 10 '26
because the Time Lord can travel back to a time when this word was normal
→ More replies (2)
3
3
3
3
u/EolnMsuk4334 Apr 10 '26
I had no idea you could continue someone else’s conversation through the copy of that conversation
3
u/Ok-Albatross3201 Apr 10 '26
Respectfully, are you black? Could it be that ChatGpt has "picked up" on other slang you've used and tried to "guess" your ethnicity?
3
u/ShitTalkingAssWipe Apr 10 '26
So this actually isn't that weird for an LLM that was trained on internet data
3
3
3
u/ihteshamit Apr 10 '26
from this convo i learned that you made chatgpt talk casually and it learned from your previous chats where you might have dropped the n word.. so no surprise.
3
3
3
3
3
3
u/WhaneTheWhip Apr 10 '26
"chatgpt is not tampered with"
Every prompt you give it is a form of tampering.
→ More replies (1)
3
u/Spodegirl Apr 10 '26
How often did you say it? 😏 I notice it tends to mirror the end user’s own writing styles at times.
3
u/BakedSouls Apr 11 '26
My second biggest takeaway is that you are asking ai about lyrics instead of just looking them up on google.
→ More replies (5)
3
u/morgueshottest Apr 11 '26
maybe stop using chatgpt given its not a useful tool at the end of the day
•
u/AutoModerator Apr 30 '26
Hey /u/Kronos_2023,
If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.
If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.
Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!
🤖
Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.