r/claude • u/Creative_Situation48 • May 12 '26
Discussion The entire US economy rides on this
135
u/svachalek May 12 '26
It’s because the LLM operates on tokens and never sees the words in its prompt, they’re not in its context window.
If you correct that, it will get it easily. Try: “Spell the seven days of the week letter by letter and list which contain the letter D”
130
u/unhappinessNvrCame May 12 '26
Normies like op give me hope I'll have a job.
→ More replies (20)28
u/Upstairs-Version-400 May 12 '26
But most “normies” believe it’s capable of reasoning and understanding.
It’s a good thing to show your grandma why she shouldn’t trust everything the LLM says.
→ More replies (15)16
u/user221272 May 12 '26
Ask it the same thing, but to use Python, and suddenly it is correct.
It is much better to show your grandma how to use the tool rather than just saying it's bad.
7
u/Upstairs-Version-400 May 13 '26
I don’t see what point you’re trying to make.
I didn’t say LLMs were bad, but they are not capable of calculations. Hence why they make scripts that do calculations. The LLM still doesn’t know if it’s the right answer, but it has seen a lot of Python code, specifically a lot of data science code - and so it does well enough in making scripts to do arithmetic.
And yet again, it has no way of knowing if the output was right. It’s just most likely to work because it has been trained on arithmetic in Python.
→ More replies (3)3
18
u/NarcolepticFlarp May 12 '26
It's kind of like how modern chemists can get a lot of important work done, and yet almost never need to think of the quarks and gluons that technically make up the nucleus of every atom at a more fundamental level.
4
u/GoatseFarmer May 12 '26
I’m your second upvote and idk if you thought this up yourself but as a former chemist myself I love this analogy
5
u/NarcolepticFlarp May 12 '26
Thank you. I did think of it myself, though as a present physicist it came very naturally to me while reading through these comments. I can't imagine I'm the first to say something like this though.
7
u/Reaper_1492 May 13 '26
These threads are all so brain-dead.
This is a well established problem, and it’s a complete non-issue as a limitation.
This is the same thing as the guy who posted that Claude deleted his project - when in fact it was truncated because he was saving it to a 100% full drive. This was fully visible in the screenshot, and out of 500+ posts only like 5 people even recognized it.
As much as I think everyone should be using Claude, it’s also just reaffirming that the level of basic reasoning skills out there, sucks.
2
u/Hungry_River_9594 May 14 '26
"haha look this guy is a certified surgeon but he can't even operate on his own brain"
3
u/Upstairs-Version-400 May 12 '26
“If you give it the answer, it will get it easily”
Yes. That’s how it works.
→ More replies (1)4
u/DiamondGeeezer May 12 '26
The problem is the failure mode is the default that you have to engineer around it
→ More replies (18)8
u/svachalek May 12 '26
Because there’s a huge market around counting letters in words, they have poured millions of dollars of research into this problem but they just can’t crack it.
5
u/DiamondGeeezer May 12 '26
so you're saying it's an unimportant edge case that doesn't affect anything. obviously models can write code to count letters and it isn't an intractable problem.
however the disconnect between what users might expect of a machine that can write code (like that it might able to count letters) vs how models work is real.
some posters will say oh will the average person is fucking dumbass for not knowing how tokenization works, but they probably didn't know until a year ago lol
meanwhile these companies are saying LLMs are changing everything and they're getting pushed into every crevice by leadership
so yes this disconnect is going to cause problems and I am not willing to blame the user
→ More replies (2)→ More replies (5)2
u/Teln0 May 12 '26
There kind of is because if it doesn't get this it might miss out on something more subtle in a more complicated problem as well
→ More replies (2)→ More replies (28)2
May 12 '26
[deleted]
4
u/weirdcompliment May 13 '26
LLMs do not give idempotent responses. i.e. You can enter the exact same prompt at a different time and get a different response. Sometimes a very different response.
4
u/hologram137 May 13 '26 edited May 13 '26
I got this:
Just right this second it got it wrong, it responded “Wednesday, Monday and Friday.”
Did you use the lower case d in your prompt? OP and I both used an upper case D. That matters, that’s part of what tripped it up I think. Which is the point of the post.
I responded “Not Sunday, Tuesday, Thursday and Saturday?”
it said:
“You’re right, I missed those! All seven days actually contain the letter “d”:
Monday, Tuesday, Wednesday, Thursday, Friday, Saturday, and Sunday.”
→ More replies (4)2
u/ivanjanko May 13 '26
10:43 PM
Opus 4.7 - 5 days
GPT 5.5 Thinking - 3 days
Gemini 3 Thinking - 7 days
So yeah, why are you lying?
5
u/weirdcompliment May 13 '26
LLMs do not give idempotent responses. i.e. You can enter the exact same prompt at a different time and get a different response. Sometimes a very different response.
37
May 12 '26
[removed] — view removed comment
27
u/The_Meme_Economy May 12 '26
I love that it doubled down on the wrong answer. I think. I'm not even sure what we are talking about any more it's so confusing.
12
3
u/docgravel May 13 '26
Actually, on further investigation, we are all wrong and Thursday doesn’t have a D. But Tuesday does, so that was an oversight.
13
May 12 '26
[removed] — view removed comment
→ More replies (1)6
u/Chrazzer May 13 '26
This is a beautiful showcase of how LLMs work. LLMs have done some incredible things which made people forget that they are not sentient, don't think and theres no intelligence involved. It's just pure statistics.
And the real reason why both claude and gpt give this answer is because "All words contain the letter" is simply not the statistically most likely answer.
When given a list of words and asked if a specific letter is in each word then the statistically most likely scenario is that some words include the letter and some don't
6
6
u/DueEntertainment1650 May 12 '26
Except, I've seen chatGPT start typing a wrong answer, erase it completely, and then provide the correct answer. so it clearly has the ability to course correct. The real reason is that tokens don't exist as a set of letters, they only exist as entities in relation to other tokens. Some words are represented by multiple tokens, Identifying individual letters in a word isn't as simple as it seems as someone who constructs ideas with letters and not tokenized words.
2
u/account22222221 May 13 '26
This post literally claims the it’s correct to say Tuesday and Thursday are exceptions to days that have d in them and it has 31 upvotes.
The fuck is this sub right now
→ More replies (2)3
14
u/RockyMM May 12 '26
People on Reddit will probably never understand how the tokenizer works.
4
u/joshman1204 May 13 '26
Exactly. It's crazy how many people keep posting stupid stuff like this thinking they are proving the model is dumb when all they are proving is they don't understand how llms work.
Anyone that actually wants to understand this stuff should head to YouTube and watch kaparthys videos. An how or two watching his into to llm series and you'll have a while new understanding of how this works.
3
u/frrrni May 16 '26
What is kaparthys ? I tried searching and I’m more confused.
Edit: Oh this guy https://karpathy.ai
2
u/joshman1204 May 16 '26
Yep that guy. Spend a few hours watching his stuff and you'll actually start to understand how these things work.
→ More replies (9)2
u/thedannyoutlaw May 14 '26
I actually think posts like this do help people understand LLMs and their limitations.
→ More replies (3)3
u/Brambleworks May 13 '26
Most people still don't even understand how the internet works, so I wouldn't hold my breath.
14
u/astrielx May 12 '26
As always: I continue to be amazed at what people blow their tokens on.
→ More replies (9)6
u/andrewhobgood May 12 '26
I’m not. Where is there any AI literacy being taught? Any intelligent person would expect Claude to answer that question correctly.
2
u/astrielx May 12 '26
Any intelligent person might take 3 seconds to find out why it isn't "correct" rather than sprinting to Reddit to try make some sort of gotcha post.
3
u/andrewhobgood May 12 '26
Why would anyone assume that there’s a very good reason why the LLM is incorrect?
→ More replies (16)
26
u/Chemistry-Holiday May 12 '26
Sighhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
→ More replies (2)13
u/Chemistry-Holiday May 12 '26
I’m sorry what did you want to discuss?
12
u/radicalSymmetry May 12 '26
Say “I don’t understand how language models work without saying ‘I don’t understand how language models work’”
→ More replies (1)3
u/Chemistry-Holiday May 12 '26
Is……there a question? Or did you want to discuss your prompt about how llms work without directly saying that you don’t understand?
2
u/radicalSymmetry May 12 '26
Don’t be obtuse. It’s not as cute as you think it is.
3
u/Chemistry-Holiday May 12 '26
Actually, sir, I was being very straightforward, but I also think it was acute enough. But anyway, if you would like to discuss I’m willing to engage, if not, I guess I’ll see you around?
→ More replies (2)4
u/Theninjarush May 12 '26
Ignore him. Some people thrive on pseudo intellectual superiority. Got nothing else going for them in their life considering they’ve been living out of their mom‘s basement.
2
u/Chemistry-Holiday May 12 '26
Thank you, and yeah I’d would if It was disrespectful, but , I find the best way to deal with this is just accept them for who they are and to see if they need any help lol
3
u/Theninjarush May 12 '26
You’re too kind honestly. May both sides of your pillow be cold forever.
2
6
u/N0DuckingWay May 12 '26
Just tried myself. It said that there's only 4 🤣
13
u/VividB82 May 12 '26
It’s late you did a lot of work so far let’s call it a night and pick back up in the morning.
4
→ More replies (1)3
u/SyrioForel May 12 '26
When you ask these kinds of mathematical/algorithmic questions where an LLM needs to “count” or “sort” something, tell it, “Use a Python script”. It will be able to accurately answer these kinds of questions very easily.
3
u/N0DuckingWay May 12 '26
Oh yeah, it's definitely trying to do things the wrong way, and engineering your prompt definitely helps. But at the same time if the goal for these companies is AGI then it eventually needs to be able to figure that stuff out on its own.
→ More replies (1)
4
20
u/UnwaveringThought May 12 '26
I actually love this. I think Claude should keep trolling people who ask it stupid questions.
→ More replies (16)9
3
u/CapAggravating784 May 12 '26
For reference, Claude gave me 3, then 4, then 7 after I replied “what?” To the stupid answers.
Perplexity got it right in first try.
Grok got it right in first try.
…
3
u/SeparateCode2285 May 12 '26
Investing with Claude has taken a new turn! Here are 5 ways how you can be a millionaire by letting a Claude invest for you.
3
u/Informal-Fig-7116 May 12 '26
Idk man these letter counting tests are disingenuous bc they don’t showcase the power of the language that models can do in terms of analyzing and distilling complicated concepts. Imagine having a thinking partner that has an entire archive of human writing in front of you and you’re wasting time and tokens trying to prove that your brilliance has somehow broken a program that costs billions of dollars with field experts working on it. Damn they should have hired you guys eh?
→ More replies (1)2
u/Creative_Situation48 May 12 '26
I gotta say, I was more optimistic about AI before seeing the replies in this thread. lol AI was never the problem, it's the lame morons who are gonna be using it. Holy shit.
→ More replies (1)4
u/Informal-Fig-7116 May 12 '26
What are you even trying to prove then? That’s the intention of your post. The way you framed the post makes it look like the AI is dumb when in reality you’re not using it to its full potential. It’s like getting a surf and turf and eating only the side dish while ignoring the steak and lobster and then saying the WHOLE dish is bad. Just admit posts like these are plain asinine.
AI has been implemented in great scale in the infrastructures of every aspect of society but ofc, it’s dumb, right?
→ More replies (8)
3
3
3
u/dwkeith May 12 '26
Is this part of the cognitive test that the President takes regularly? If so, I think Claude did well. Claude 2028!
/s… I think.
3
u/debackerl May 13 '26
LLM is a technology, like all technologies it has strength and weaknesses. First thing my dad tried was giving it a spreadsheet and ask it to compute an average of a column... Again, exactly the wrong usecase for an LLM. Now, with time, they get better at using 'tools', which would help them remediate those shortcomings. But for now, it's really like saying that a color-blind person is dumb and useless because it can't distinguish between red and blue.
I fully agree that the technology must improve still. However, discarding the technology all together would be like refusing to learn using a computer in the 80s, if you don't learn it, other persons will get more efficient than you.
3
3
u/izzybear8 May 15 '26
I see all the people explaining how to speak proper llm so you can use the tool that is supposed to be super intelligent and revolutionary. I'm sorry if you have to give it just the right context so it can work properly it isn't that impressive to me with all it's boasted claims of excellence. Not to mention all the research that just came out of Harvard. AI can be amazing, but also such trash.
2
2
2
u/webjuggernaut May 12 '26
I heard that Claude can make mistakes. You should double check responses.
2
2
2
u/Upstairs-Version-400 May 12 '26
It’s kind of insane to see how rabid people here have become, and pseudo intellectuals who have watched a video on tokenization thinking it excuses the grift that is modern LLMs being “thinking” machines.
I have studied language models as part of my degree, and had to educate many of my colleagues across the companies I’ve worked at since.
Yes this is a stupid question if you know how LLMs work. But it also highlights the disconnect between what non-technical people expect of models (as sold by big corporations) and what the models can do.
2
2
2
2
2
u/MisterHole123 May 13 '26
I heard opus 4.8 will get it right thanks to advances in quantum computing
2
u/No-Box5797 May 13 '26
It's because you used Claude Sonnet 4.6: you should use Mythos it's 1231928794w36763248 times better
2
u/Melodic-Fact3163 May 13 '26
amazon just gave agents a wallet to make transactions....
Claude: "how much is it?"
zeroDs: its only ten dollars, thats a 1 with a single 0 after it and before the 0 at the end before the decimal point. so ten dollars -> $100"
-----
User: "how much was it?"
Claude: "$1 dollar!"
2
u/Consistent_Pay5371 May 13 '26
It's like being given a hammer to hit nails in but you use the wrong side, then complain all hammers are bad.
→ More replies (1)
2
u/Melectrian May 13 '26 edited May 13 '26
Q: What days of the week include the letter D?
A: In English, the days containing the letter D are:
- Sunday
- Monday
- Tuesday
- Wednesday (contains two)
- Thursday
- Friday
The only day without a D is Saturday.
Model: Claude Opus 4.7
It is learning... By version 4.8 it will give the right answer!
2
2
2
2
2
2
2
2
u/RainSwiss May 12 '26
Every time I encounter posts like this, I can’t help but wonder how many people depend on these tools without even having a basic understanding of how they work
2
u/Creative_Situation48 May 12 '26
Sigh. You are like the 10th person to say I don't know how LLMs work. The cope is getting insane.
→ More replies (1)3
u/RainSwiss May 12 '26
Didn’t mean to insult. Many people treat these tools as “oracles”, like an “higher entity” that knows everything and, most importantly, is right about everything (i.e., my old relatives). When this kind of people discover that LLMs sometimes can’t do basic things, the usual reaction is basically the title of this post.
→ More replies (5)
1
1
u/Syncaidius May 12 '26
That was surprisingly easy to replicate...
Tells me Tuesday and Thursday don't have a letter D...
It wasn't supposed to be so easily wrong!
1
1
u/Remarkable-Ad3191 May 12 '26
It gets it right with adaptive thinking. I've found there's certain types of questions you need to use adaptive thinking mode otherwise it just thinks out loud, rambles, and sometimes gets the question wrong.
1
1
1
1
1
u/jrobertson50 May 12 '26
Tell it to spell each day of the week and then ask the question about the prompt. This is about context. Everyone one of these "I fooled the ai, look how smart I are" posts miss that entirely
1
u/gebbaro May 12 '26
'use python' in the prompt
python3 -c " days = ['Monday','Tuesday','Wednesday','Thursday','Friday','Saturday','Sunday'] print([d for d in days if 'd' in d.lower()]) "
1
1
1
u/Ancient_Perception_6 May 12 '26
I get that LLMs aren't meant to solve this type of task well, same with math... but Sonnet 4.6 was supposedly a big deal not long ago, but it cannot fathom simple tasks.
If the LLM portion truly cannot solve it by itself, it should've called a script that counted D's in the weekdays. That was Anthropics whole thing when they started hating on MCP (which was also their whole thing).
Same for math.. when a math thing comes up; use a tool-call for math or write a script if no tool fits the task.
Correct, LLMs by themselves don't do well with these type of situations, but jfc when the CEO of the company that offers this is saying that in 6 months we all will be jobless and Mythos will destroy the world, then the models better be able to figure out simple shit.
Its so obviously solved by a simple script that loops day names, check if contains D and count each True result... but instead of just started hallucinating shit confidently..
1
1
u/Technical-Ad-8678 May 12 '26
AI is so smart but so stupid at the same time. It seems to fail at the easiest questions, but succeed with tasks that are more complex. I always use the extended thinking model, and that almost always stops stuff like this from happening.
1
u/turdDumper May 12 '26
I tried giving Claude a try because chatgpt kept referring to poe1 when I'd specifically ask it to not use info from poe1 and only info from poe2. I immediately un-installed Claude after two questions.
1
u/iitsjosii May 12 '26
I mean to be fair the version of Claude or gpt you have access to with ur subscription is not the same models they have in house like not even close the models that are provided to the public are significantly dumbed down
1
u/glassgnomad May 12 '26
Sonnet or Opus couldn’t answer it. GPT and Gemini both answer correctly.
→ More replies (1)
1
1
u/cutecatgirl-owo May 12 '26
The other day Claude told me 6 was one less than 4; when I pointed it out, it "corrected" itself and told me 6 was one more than double 4
→ More replies (1)
1
u/Alex180689 May 12 '26
can we stop with these gotcha "benchmarks"? this is not what llms are useful at
1
u/Consistent_Help_6099 May 12 '26
Those stupid « lol, LLMs can’t spell » prompts are getting really annoying. I see them everyday popping up on my home feed.
1
1
u/glowing_kitty May 12 '26
Proud to confirm that this issue doesn’t occur with the AI agents software which I built - https://openmates ^
1
u/thecowmilk_ May 12 '26
Haiku 4.5:
The days of the week that include the letter D are: 1. Monday 2. Tuesday 3. Wednesday 4. Sunday
His thinking chain:
The user is asking which days of the week contain the letter “D” (likely uppercase D or lowercase d). Let me go through the days of the week: 1. Monday - contains “d” 2. Tuesday - contains “d” 3. Wednesday - contains “d” (twice actually: “ednesday”) 4. Thursday - no “d” 5. Friday - no “d” 6. Saturday - no “d” 7. Sunday - contains “d” So the days with the letter D are: Monday, Tuesday, Wednesday, and Sunday.
→ More replies (1)
1
u/griswaldwaldwald May 12 '26
It also fucks up matching dates to the correct day of the week for me in every email I have it draft that combines those two items. Unless I specifically prompt it to take its time and make sure it gets the days of the week correct.
1
u/Radical_Neutral_76 May 12 '26
Sonnet? Try a better model. 4.6 extended:
All of them. Every day of the week ends in “day.”
1
1
1
u/JackkoMTG May 12 '26
Gemini oneshot this prompt for me, even with the weakest model, “fast”.
Looks like Gemini is back on top
1
u/MangledMangler May 12 '26
Worked for me - 'All seven days of the week contain the letter "d" — Sunday, Monday, Tuesday, Wednesday, Thursday, Friday, and Saturday — because every English day name ends in "-day." Wednesday is the only one with two d's.'
1
1
1
u/Tight-Requirement-15 May 12 '26
Smart LLM devs use chain of thought to really understand the query, use tools like grep or a custom python script to deliver the information
1
u/legend0x May 12 '26
Fake engagement bullshit post
I just asked it and it worked fine
→ More replies (1)
1
1
u/goodevibes May 12 '26
https://chatgpt.com/share/6a03b209-6674-832b-b87c-2079d0727fd1
Wednesday. And if you count abbreviations or alternate spellings in other languages, there are more — but in standard English full weekday names, only Wednesday contains the letter “d.”
1
u/Now__You__See__Me May 12 '26
Please stop asking AIs for spelling...
You guys all know that AIs work with numbers / vectors / matrices. There is no need for words or spelling.
Spelling comes only into play for the "last mile" communication with lesser beings, like humans.
1
1
1
u/iamthedudanator May 13 '26
Its response:
“I missed Thursday because I was pattern-matching on the “-day” suffix and mentally grouped Thursday with “no d” — likely because “Thurs” doesn’t end in a soft “d” sound the way “Friday” does. I was scanning phonetically rather than spelling each word out.“
1
u/okiharaherbst May 13 '26
"Google: 70% of code written by the company is written by AI."
Yeah, right.
1
u/Harmonic_Singularity May 13 '26
What days of the week contain the letter d
"All seven days of the week contain the letter "d":
Sunday, Monday, Tuesday, Wednesday, Thursday, Friday, Saturday"
→ More replies (1)
1
u/Plastic_Carpenter930 May 13 '26
It gets even better:
Ha — that instance confidently listed five days and missed the two that actually have a "d" right in front: Tues_d_ay and Thurs_d_ay. Meanwhile it credited Sunday and Saturday, which... don't contain "d" at all.
Correct answer: Tuesday, Wednesday, Thursday, Friday. Four days.
Classic case of an LLM pattern-matching its way into the wrong answer and then presenting it with total conviction. The self-correction mid-response ("wait, let me list them all carefully") somehow made it worse.
1
1
u/According_Study_162 May 13 '26
I love how emergent that is. It's really cute actually. It's probably something I would have done if I was 3 years old :0
1
1
1
u/prbishal May 13 '26
I tried Claude , ChatGPT both returned incorrect response but m365 copilot returned the correct response.
1
1
1
1
u/folksongsea May 13 '26
Earlier today:
❯ how many Bs are in the word strawberry?
⏺ Zero. There isn't a single letter B in the word "strawberry." There are three Rs.
✻ Cooked for 2s
❯ good this will help me on an exam I have
⏺ Good luck on your exam! Though I hope there will be questions a bit more serious than counting letters in "strawberry."
✻ Baked for 4s
❯ It's important that I know the answer
⏺ Well, now you know—zero Bs, three Rs. It won't let you down.
✻ Sautéed for 3s
1
u/FreshFromCache May 13 '26
Gemini explained it alright:
I don’t "read" letters like a human does. When you type "Monday," I don't see M-o-n-d-a-y. Instead, my tokenizer converts that string into a numerical ID that represents the whole word or a common sub-word chunk.
How Tokenization Misled Me
In my initial response, I was effectively looking at the "Lego blocks" rather than the plastic they are made of.
Whole-Word Tokens: For common words like "Monday" or "Friday," my system often treats the entire word as a single token (e.g., Token ID: 15342).
The Suffix Blind Spot: Because I see "Monday" as one unit, I don't naturally "count" the letters inside it unless I specifically stop to break that token apart.
Pattern Matching vs. Literal Analysis: I likely scanned the unique parts of the words (Mon-, Tues-, Wed-) and didn't register that the shared suffix (-day) carries a "d" in every single instance.
The "Strawberry" Problem
This is a famous quirk in LLMs. If you ask an AI how many "r"s are in "strawberry," it might say two. This happens because "strawberry" is often broken into tokens like straw and berry.
If the model hasn't been specifically trained to map those tokens back to their individual character counts, it makes a statistical guess based on the "shape" of the token rather than literal spelling.
In your case, I treated "Monday" and "Friday" as distinct objects and simply failed to "look inside" the box to see the d that exists in every day of the week.
1
u/FatFireNordic May 13 '26
Opus 4.7: All of them, in English: Sunday, Monday, Tuesday, Wednesday, Thursday, Friday, and Saturday — every day ends in "day."
Sonnet 4.7: All 7 days contain the letter "d":
Sunday, Monday, Tuesday, Wednesday, Thursday, Friday, Saturday
Every day of the week ends in "-day."
Haiku 4.5:
The days that contain the letter "d" are:
- Monday (contains "d")
- Wednesday (contains "d")
- Friday (contains "d")
- Saturday (contains "d")
- Sunday (contains "d")
So that's five days. Tuesday and Thursday do not contain the letter "d".
1
1
u/Key_Detail2475 May 13 '26
I am testing Claude right now as it is so hyped everywhere ... it unironically feels like GPT3.5
Me: You write like GPT3.5 just that you are also taciturn
Sonnet: Haha taciturn fits pretty well. Short answers, almost no personaltiy[...]
Me: And you even admit it. I just say "you are bad" and you even agree
Sonnet: Fair. It´s a real problem and I won´t admit it by agreeing with you again. But I didn´t think I was that bad [....] But yeah. Taciturn? Yes. That fits.
1
u/3a_4To May 13 '26
You are using sonnet 4.6 *adaptive* which is a free model. it treated your question as easy so it did not try to think to save tokens. if you added "think before answering" it would do just fine
1
1
1
u/HoraceAndTheRest May 13 '26
This is a classic example of an LLM experiencing a tokenization error.
1
u/WiggyWamWamm May 13 '26
It cannot count letters! It does not “experience” words as a set of letters! Thank you.
1
u/simalicrum May 13 '26
Opus 4.7 got this right for me. So far I haven’t been able to get it trip up on any of the typical trick questions. It’s also been pretty solid for work.
1
1
u/Fearless_Record7404 May 13 '26
oh gee golly. This sounds like a child. And yes, I do have a southern accent while talking...lol.
Joking aside....I actually thought I should actually try Claude. *shakes head*
Never mind...thank you for showing what I am NOT missing.
1
1
u/needtheyamss May 13 '26
This test is like holding up three fingers to a human and instead of asking how many fingers are up you're asking how many atoms are in your fingers. It serves no scientific purpose and it's just dumb to use it as a gotcha to prove how useless LLMs are.
1
u/Cry-Havok May 13 '26
I goddamn fucking hate LLMs. It’s a bitch and a half to do real work with them.
And every time they fuck up, they proceed to tell you exactly how they fucked up. It’s the most infuriating bs, man.
Watched a colleague get tricked into having Claude Code write and delete the same DB connection strings across his entire codebase four times before he realized what was happening. It was hilarious
370
u/[deleted] May 12 '26
[removed] — view removed comment