> This suggests that people are drawn to AI that unquestioningly validate, even as that validation risks eroding their judgment
I believe this is a larger problem than just AI.
The internet has helped people surround themselves with only voices that agree with them and validate them, often to their detriment.
There are entire online communities urging people to cut others out of their lives over the slightest disagreement.
accountrequired 1 hours ago [-]
You're absolutely right!
pwdisswordfishq 21 minutes ago [-]
It's a pretty overdone joke at this point, don't you think?
tom_ 18 minutes ago [-]
It's not a joke-it's an honest fact.
accountrequired 14 minutes ago [-]
You made an excellent point! (could not resist that one)
Kattywumpus 43 minutes ago [-]
I don't know. Upvotes often do the same thing, especially in siloed communities. I feel like this is a larger problem -- people leaning into extremifying their views or just playing to an audience -- even though one might frame it as "prosocial" because it happens within the context of an online community.
matheusmoreira 6 minutes ago [-]
> Upvotes often do the same thing, especially in siloed communities.
Yeah. I've gotten caught in this pattern here on HN. Post something, there's some disagreement but then I see the quiet upvotes trickling in, sometimes by the dozen. That sort of signal slowly convinced me I was right about plenty of stuff.
I used AI to datamine all of my HN comments and find those patterns. Then I started asking the AI to steelman the hell out of my world view, every single argument.
smcg 27 minutes ago [-]
Both could be true. People follow incentives.
LAC-Tech 1 hours ago [-]
I think this goes along way to explain people's very defensive reactions when you are skeptical about Agentic Development.
artnanika 47 minutes ago [-]
Those are two different things. Chatgpt being sycophantic while playing the role of a therapist with a teenager is much different from Codex being sycophantic while reviewing user feedback. The former is extremely dangerous for society.
qarl2 51 minutes ago [-]
I'm one of the people who gets accused of this. I don't mind skepticism. But every time I turn around, someone's claiming nobody gets any value from these tools and anyone who says otherwise is deluded or running a scam. That gets really old.
LAC-Tech 16 minutes ago [-]
I can believe people get value out of them. I think I do.
But "OH MY GOD EVERYTHING HAS CHANGED THE OLD WAY IS DEAD 10X MORE PRODUCTIVE" - no. If that were true, we'd notice it in the software all around us.
davesiknow 56 minutes ago [-]
[dead]
daun_gee 55 minutes ago [-]
[flagged]
atleastoptimal 2 hours ago [-]
This is true, but likely happening in talk therapy too with overly sycyphantic therapists
jalev 1 hours ago [-]
Sure, but there is a marked difference between a therapist and an LLM Chatbot: you can't talk to your therapist for +4h a day, at any time convenient to yourself. It's also not a guarantee you're going to hit upon a therapist that is like that, versus a product that is very literally intended to maximise your usage of it.
paimapi 1 hours ago [-]
a therapist should, if they follow their training, not be a sycophant whatsoever. CBT, for eg, is a multi-step process including Socratic self-dialogue, reframing practices, etc to guide the person towards the development of insight and healthier coping mechanisms
Rendered at 20:30:00 GMT+0000 (Coordinated Universal Time) with Vercel.
I believe this is a larger problem than just AI.
The internet has helped people surround themselves with only voices that agree with them and validate them, often to their detriment.
There are entire online communities urging people to cut others out of their lives over the slightest disagreement.
Yeah. I've gotten caught in this pattern here on HN. Post something, there's some disagreement but then I see the quiet upvotes trickling in, sometimes by the dozen. That sort of signal slowly convinced me I was right about plenty of stuff.
I used AI to datamine all of my HN comments and find those patterns. Then I started asking the AI to steelman the hell out of my world view, every single argument.
But "OH MY GOD EVERYTHING HAS CHANGED THE OLD WAY IS DEAD 10X MORE PRODUCTIVE" - no. If that were true, we'd notice it in the software all around us.