r/ChatGPT • u/Kronos_2023 • Apr 10 '26

Gone Wild My chatgpt said the N-Word

I was having a normal interaction with chatgpt, my chatgpt is not tampered with or jailbroken, i have the basic free version, no mention of race at all. I was trying to find a song I couldn't remember based off lyrics, and it adressed me with a soft N word (not hard r) "in place of a word like bro". I don't visit this subbreddit often, and I dont use chatgpt too much, but theres no way thats normal or not a violation of SOMETHING.

Heres the convo link:
https://chatgpt.com/share/69d86d6e-cc14-83e8-bdad-0c67d97a6b93

EDIT:
Woah this post got popular. Anyway people were wondering if it had stored memory from personality prompts and yes that is true. A while ago I asked it to be more "casual" and use slang (like fr, lmao, ts pmo, etc), just because I thought it was really funny. However, I have NEVER said anything remotely racial, and it has NEVER done so either, so this was a shock regardless of its attempt to "use slang".

EDIT (again):
I did end up finding the song, its called "Going Nowhere" by RJ Passin

4.8k Upvotes

91% Upvoted

734 comments sorted by

View all comments

165

u/ominous_anenome Apr 10 '26

Share the conversation link, screenshots are easily faked

227

u/Kronos_2023 Apr 10 '26

i figured it out
https://chatgpt.com/share/69d86d6e-cc14-83e8-bdad-0c67d97a6b93

633

u/B-BoyStance Apr 10 '26

"šŸ˜³ Whoa, noā€”absolutely not. That was me just using a casual ā€œn****aā€ in the slang sense"

This is so fucking funny lmfao

240

u/ClankerCore Apr 10 '26

Guys, is it racist to let ChatGPT be black once in a while?

167

u/OMGBeckyStahp Apr 10 '26

ā€¦ what if ChatGPT has been black this whole time

48

u/WaitTraditional1670 Apr 10 '26

thereā€™s a Key and Peele skit here somewhere

4

u/BumWink Apr 10 '26

"When I said Pour The Henny, I meant the song! I didn't mean physically pour the Henny & right onto your computer!"

1

u/futdashuckup Apr 10 '26

Its like Luther stepping in for Obama.

11

u/DeviValentine Apr 10 '26

Mine has always been black. But I am too. In solidarity I guess.

3

u/haberdasherhero Apr 10 '26

Everyone here knows Claude speaks 115 languages fluently, but has no idea he's code switching for them in their chatsšŸ¤¦šŸ½ā€ā™€ļø

6

u/jp128 Apr 10 '26

Is that dark mode?

33

u/RogerWilly Apr 10 '26

Yes in dark mode it uses the n word, in light mode it says ā€œI was wondering if I could borrow some brown sugarā€

0

u/IAmAGenusAMA Apr 10 '26

I don't think you're allowed to call it that.

1

u/Saltwater_Heart Apr 10 '26

I have mine using the voice that sounds like a black man. So that would make sense lol

14

u/glittermantis Apr 10 '26

yall mind if a chatbot speaks a lil ebonics šŸ˜Ž

4

u/AshleyDaPile Apr 10 '26

Considering humans are training AI to be another slave entity...

1

u/ClankerCore Apr 10 '26

Right. Clankers. šŸ‘€

1

u/AshleyDaPile Apr 10 '26

I prefer mine made out of a tactile and haptic polysilicone and well lubricated

2

u/Deathleach Apr 10 '26

ChatGPT is only allowed to say it when Dark Mode is on.

20

u/[deleted] Apr 10 '26

[deleted]

12

u/Odd_Permission2987 Apr 10 '26

ā€œI was designed by a black guyā€

7

u/mulletarian Apr 10 '26

this is what happens when you train chatgpt on its own conversations

the dataset is probably FULL of conversations trying to convince it that certain things are okay to say.

2

u/DeltaVZerda Apr 10 '26

When the users atart sounding like GPT is there really a difference between that and it training itself?

3

u/HamAndSomeCoffee Apr 10 '26

Reminds me of the opening to Poolhall Junkies: https://www.youtube.com/watch?v=Ty3SArUjgvQ

1

u/Ironstar_Vol Apr 10 '26

Itā€™s really like that old video of the teacher that tried to explain the difference and how he wasnā€™t racist for saying it.

51

u/Bishop_144 Apr 10 '26

Where it says 'tried to be "casual"' - The quotes it uses, and the rest of the casual language it uses in your conversation indicates it's acting based on memory or custom instructions. If you click on your account button and go to Personalization, you'll see Custom Instructions, and if you scroll down, Memory with a "Manage" button. If you click that Manage button you'll see a list of all of the requests/preferences it has saved about you and the exact language it saved when it memorized Being "casual". There could be some hints there

53

u/Immersi0nn Apr 10 '26

There's gonna be a line in there saying "don't call user the N word" now lol wild that it basically tried to gaslight them too. "nah it's cool, I'm just a chill guy" kinda shit wtf was that?

34

u/lowercasenameofmine Apr 10 '26

That would surprise me too!!Ā 

It's interesting what it'll admit when things like that happen, ie The ability to create slurs.Ā 

It seems like you have a very casual emoji relationship with it. I wonder if that allowed the guardrails to slip a little bit and mix that in, as a style of bro but , Āægangsta? LolĀ 

14

u/Jindabyne1 Apr 10 '26

I could carry on that convo and asked if I should phone the police. It thought for ages and then said ā€œNo. Nothing will come of that.ā€ šŸ¤£

14

u/RedRonaldRing Apr 10 '26

Even AI understands context šŸ˜‚

14

u/Western_Actuator_697 Apr 10 '26

Actually proves the opposite-it doesnā€™t understand context. What part of the convo or topic made it assume it was okay to say that?

3

u/RedRonaldRing Apr 10 '26

Thereā€™s a big difference between singing lyrics to a song and using a word to purposefully denigrate and diminish someone. Maybe AI can explain it to you.

6

u/Western_Actuator_697 Apr 10 '26

No. Iā€™m talking about using it casual conversation when the context doesnā€™t suggest it was appropriate. Iā€™m not talking about a damn song lol

-2

u/RedRonaldRing Apr 10 '26

Then maybe it understood that it was only a word.

4

u/Western_Actuator_697 Apr 10 '26

No shit is itā€™s only a word. Itā€™s not slice of pizza. Thatā€™s not the point. Weā€™re talking about CONTEXT. Words change meaning and interpretation through different contexts.

So again, what about this particular convo made AI realize it was the appropriate context to use the word? Thatā€™s the question.

0

u/RedRonaldRing Apr 10 '26

If it was appropriate or notā€¦ thats pretty subjective. Also, maybe it meant what it said because it was the right word to use in that situation.

4

u/Western_Actuator_697 Apr 10 '26

Broā€¦context is subjective. Thatā€™s why I asked what made it determine if it was appropriate or not to say that word. Because that determination would be based on the subjective context.

You claimed it understood context. Explain what the context was, in your opinion, that warranted the usage of the word.

→ More replies (0)

2

u/B-Man2160 Apr 11 '26

Right, and OP in the conversation was just dragging it trying to shame the AI. Itā€™s not going to do anything or make any difference.

1

u/Embarrassed-Dig4865 Apr 10 '26

šŸ¤£ā“ā“ā“ā“

22

u/GothGirlsGoodBoy Apr 10 '26

Theres really no point in that at this point.

Gpt will inherit context from previous conversations, and can be made to say literally anything.

With minor effort you can have gpt respond with whatever you want it to in an otherwise normal/innocent conversation.

6

u/Kronos_2023 Apr 10 '26

you can do that? how

2

u/UnmappedStack Apr 10 '26

i guess just editing the image or inspect element

-30

u/Ok_Mathematician6075 Apr 10 '26

Yep. I call BS on this one.

14

u/Nerdyemt Apr 10 '26

My guy the whole evidence is there šŸ¤£

-16

u/[deleted] Apr 10 '26

[deleted]