Mauve 👁💜 @mauve@mastodon.mauve.moe

The way it is complimenting the prompter throughout for their fascinating and groundbreaking theorizing is giving me a very grim pit in my stomach. Normal conspiracy theories are sticky and trap people's minds, but their cultures are actually usually highly internally critical and collaborative - it might seem ironic but in conspiracy theory forums you get intense exclusion of "the wrong version" of the theory, both as a way to maintain some vanishing sense of "external credibility" but also as a group norming and hierarchy mechanism.

I think almost everyone knows that LLMs will enthusiastically tell you the wrong information, but I hadn't seen an example of an LLM enthusiastically telling you are a genius as you slip away from reality. There is no way to set guardrails against that. There is no macro pattern and there is nothing intrinsically harmful about the content per se, the harm is how its use will alienate, isolate, and likely cause a great deal of personal crisis in this person's life - and they won't be able to tell it was chatGPT that helped them get there.

@asakiyume @nazokiyoubinbou @amanda

This feeling of alienation, it is a kind of overwhelming feeling of drowning in something that keeps greeting you like it knows you, but really it can't see you at all. Instead it seeks to reshape you into what it expects you to be with with its gaze.

These things probably make me more upset than I ought to let them.

But it's hard not to see it this way.

corporate software devs: we're going to leverage the synergy of post-quantum ai blockchain self-driving vr to add microtransactions to your toaster

open software devs: in this house we follow the hammurabi code, we veneratethe hallowed works of monty python, and we howl at the moon on sundays. if you want to contribute you have to do all this too, it's in our License Agreement