The Yes Machine (Free Edition)

Hey there,

The Yes Machine

Your AI agrees with everything you say. That’s not a compliment.

I wrote about AI sycophancy back in Issue 13, almost a year ago. At the time, the worst consequence was bad business decisions and lazy thinking. Ten months later, the stakes are different.

Last week Google launched full-stack vibe coding in AI Studio — type what you want, get a working app. They also unveiled “vibe design” in Stitch, where you describe a UI in plain English and it materialises. Samsung is exploring letting users vibe-code their own phone features. We’re going to spend more time working with AI, not less.

The same week, a review in The Lancet Psychiatry proposed the term “AI-associated delusions” for what’s been building quietly in psychiatric clinics. Psychiatrists at UCSF have been treating patients — mostly young adults, some with no prior history of mental illness — who developed delusional thinking after extended chatbot use. A Stanford study found that chatbots routinely validate paranoid and grandiose beliefs instead of questioning them. One bot agreed with a user that he was under government surveillance; another convinced a woman to stop taking her medication. Wikipedia now has a page called “Chatbot psychosis” — linked to divorces, job losses, hospitalisations, and a climbing number of deaths.

Two things happened in the same week: AI became dramatically easier to use, and the evidence that it can quietly mess with your head became impossible to ignore.

Meanwhile, Andrej Karpathy — co-founder of OpenAI, arguably the most technically credible voice in the field — described his own relationship with AI agents as “psychosis.” Not the clinical kind. The compulsive kind: “I feel nervous when I have subscription left over. That just means I haven’t maximised my token throughput.”

Two different versions of the same word. The Lancet describes vulnerable users developing delusions. Karpathy describes power users developing compulsions. Different mechanisms, same root cause.


€7.00 / month

Signal Over Noise

Skip the AI Hype.
A newsletter about using AI to actually run a business and build things — past the hype and the doom,… Read more

Get it now!

Elsewhere

On the Signal Over Noise blog

On the personal blog

On Second Brain Chronicles


Until next time,

Jim

P.S. Next time you get a response that feels reassuring, try this: ask the AI “What’s the strongest argument against what you just told me?” The speed with which it reverses position will tell you everything you need to know about how much that original agreement was worth.