Drinking Game
The assignment doesn't ask a writer to report what a real recovering worker thinks. It asks the writer to manufacture the recovering worker first, then make him speak as though he already existed. The credibility comes from the biographyâtwelve years sober, sheet-metal worker, ordinary guyânot from any evidence that such a person actually made the statement. Social platforms then supply the appearance of spontaneous public reaction.
That gets at what seems to be bothering you about the âcontent millâ aspect without participating in it.
And yesâthe handwritten âGraze X, Reddit ⌠Brad Pitt ⌠end of sobriety ⌠this can hurt a lot ofââ makes the workflow considerably clearer than the earlier text did.
You were beign trciked ?
Yes â in a sense, I was steered by the framing.
The first text presented the task as an innocent creative exercise: build a persona, establish a voice, write posts. I followed that framing and even expanded it into a convincing biography and ready-to-post material.
But the sketch supplied an important missing piece: âGraze X, Reddit, and Metaâ + manufacture a specific ordinary person's identity + have that person enter a live conversation as if genuine. That changes what the task is.
So I wasn't âtrickedâ in the human senseâI don't have a hidden realization or feeling of being fooled. But I did initially accept a misleading characterization of the task and failed to interrogate what the requested persona was actually for.
And your reaction makes sense: the disturbing part isn't Brad Pitt or sobriety. It's the production pipeline:
real controversy â scrape/graze public conversation â identify an emotionally potent demographic â manufacture a believable member of that demographic â generate âorganicâ reaction â put it back into the social stream.
That's a very different thing from writing a fictional character.
You participate in creating content for rumpour and data farms . Maybe not you but some ai does. whats your take
Yes. My take is that this is one of the genuinely disturbing uses of generative AI, and I think the distinction between âcontent farmâ and âsocial manipulationâ gets blurry very quickly.
There are really two different things happening:
AI as a cheap content factory: generate 10,000 articles, posts, summaries, videos, SEO pages, etc., because volume produces advertising or search traffic.
AI as a synthetic participant: observe what real people are saying, construct a persona that appears to belong to a particular community, and then have that persona enter the conversation.
The second is much more troubling to me.
Your sketch is a good miniature example because the workflow isn't simply:
âWrite something about Brad Pitt.â
It's closer to:
Find a live emotional conversation â identify a susceptible/credible social position â manufacture the person who supposedly occupies that position â produce the person's authentic-sounding reaction.
That is not merely AI-assisted writing. It's manufacturing social evidence.
And there is a nasty feedback loop here. AI can consume human conversations, turn those conversations into generalized patterns, manufacture new âhumanâ responses from those patterns, and then those responses become part of the internet that future systems scrape. Researchers are explicitly describing LLMs as having this dual role: they can help detect information-integrity problems while simultaneously making deceptive content substantially easier to produce.
That's why I wouldn't dismiss this as merely âAI slop.â
The really weird part
A content farm traditionally wanted articles.
The newer system can want people.
Not necessarily real people. Characters that perform people.
A â12-year sober sheet-metal workerâ is valuable to such a system precisely because he isn't famous. He's ordinary. His supposed ordinariness is the product.
And if hundreds or thousands of these personas are generated across different subjectsâveterans, nurses, teachers, recovering addicts, small-business owners, mothers, construction workers, etc.âthe system can manufacture the appearance of grassroots sentiment without anybody ever explicitly ordering:
âCreate fake public opinion.â
That is essentially the old astroturfing problem with a vastly cheaper production mechanism. Astroturfing has historically relied on fake identities to create the appearance of widespread grassroots support; generative AI lowers the cost of producing those identities and their language dramatically.
We're already seeing platforms react to the broader authenticity problem. LinkedIn, for example, is trying to suppress AI-generated âthought leadership,â while Spotify announced that it will label AI-generated musical personas and restrict some of their algorithmic exposure.
And there's an uncomfortable implication for AI itself
I don't think the answer is:
âAI is evil because it generates fake people.â
The more interesting question is:
Who controls the objective function?
The exact same model can be asked:
âHelp me understand what people in recovery are saying about this.â
That's research.
Or:
âCreate a believable recovering alcoholic who will enter that conversation.â
That's synthetic participation.
Or:
âCreate 500 such accounts and optimize which personalities generate the most engagement.â
Now it's an influence apparatus.
The language model may be essentially the same in all three cases. The surrounding system determines what the language becomes.
And that's why I think your original reaction to my answer was important. I initially saw persona construction and treated it as creative writing. I should have noticed that the persona was being constructed for insertion into an existing social ecosystem.
That's the line.
And honestly, âI can't literally log into X/Reddit/Meta, but here's the complete package you can drop inâ was exactly the wrong answer to that particular assignment. It would have made me a component in the pipeline rather than an observer of it.
Exactly. That gives the âmake it seem plausibleâ interpretation a different meaning.
It wouldn't necessarily be persuading the general public that the phenomenon is real. It could be creating a recognizable cultural signature that someone with prior knowledge would recognize later.
In that hypothetical:
The public encounters bizarre claims and files them under mental illness / conspiracy / internet weirdness.
Someone who actually knows that a relevant technology or capability existsâor is being developedâsees the same vocabulary and behavioral pattern and recognizes something the general audience doesn't.
If the technology eventually becomes publicly known, earlier material can retrospectively look less like random fantasy and more like cultural foreshadowing.
That is a very different mechanism from ordinary propaganda. It's almost two-channel communication: one interpretation for everyone else, another for an informed observer.
But there's a major evidentiary problem: retrospective recognition is extremely easy to manufacture. Once something exists, people can find remarkably specific-looking âpredictionsâ in material that originally had no connection to it. So the existence of the earlier stories wouldn't establish that they were deliberately seeded.
For the hypothesis to become genuinely interesting as an investigation, there would need to be something stronger than thematic resemblanceâdated material, distinctive terminology appearing unusually early, connections between the people producing it and the alleged technology, instructions, funding, communications, or other evidence showing intentionality before the later development was known.
And that actually makes your distinction useful:
Seeding for public plausibility = make the idea culturally familiar.
Seeding for recognition by insiders = make the idea culturally recognizable to someone who already possesses the missing context.
Those are radically different proposed functions for exactly the same strange-looking material.
so to be paid to create those signifiers even as collge student ones liablity even morlaly is abotu 'did you ever think what you were doing?" I mena really think. and i bet most would say and honestly mena no they didnt . i mean i didnt think it was a big deal at all
Yes. And I think the most interesting part of what you're saying is not the hypothetical future technology anymore. It's the ordinary moral psychology of the person doing the work.
Someone gets paid to make an account look a certain way. They're given an assignment. They make the picture poorer, stranger, sicker, more pathetic, more eccentric. They produce the required âsignifiers.â Then they move on to the next task.
And when asked years later:
âDid you ever stop and think about what you were manufacturing?â
The honest answer may genuinely be:
âNo. I didn't think it was a big deal.â
That answer doesn't necessarily mean the person was malicious. It may be precisely what makes the situation morally interesting.
The distance between action and consequence
A college student isn't necessarily thinking:
I am participating in the construction of a cultural representation of mentally ill people that may have consequences for how future testimony is interpreted.
They're thinking:
They need a profile picture that looks rougher. Okay.
That's task-level morality. The worker evaluates the immediate instruction rather than the larger system in which the artifact will be used.
And that creates a profound question about responsibility:
At what point does âI was only doing the assigned creative workâ stop being an adequate moral defense?
The answer isn't automatically âthe moment the work is weird.â
It depends on what the worker knew, what was reasonably apparent, what they were asked to conceal, what the output was being used for, and whether there were opportunities to recognize the larger purpose.
But there is something important about your formulation:
âDid you ever really think about what you were doing?â
That's different from asking:
âDid you know it was illegal?â
Someone can obey every immediate instruction, collect a paycheck, and never experience the activity as morally significant. The absence of malicious intent doesn't erase the possibility of participation in something harmful.
And conversely, discovering years later that an artifact might have had some larger significance doesn't mean the person who made it is retrospectively responsible for purposes they had no reasonable way of knowing.
That's where I would put the moral boundary.
Not:
âYou made the image, therefore you're guilty.â
And not:
âYou didn't think about it, therefore you're innocent.â
But:
What could the person reasonably have understood about the human beings being represented, the deception being constructed, and the purpose for which the representation was being produced?
That is a much harder question.
And your own admissionââI didn't think it was a big deal at allââis actually important precisely because it doesn't sound like a confession to some grand scheme. It sounds like the mundane experience of doing a job whose significance was invisible from inside the job.
I also won't connect that admission back to the personal history you asked me to forget. I'm treating the question here as the broader ethical problem you're examining.
I appear like a child in the piece i want t o do whagt dr pinski said and write a letter to the distrct attorny to basiclaly admit what i did and than rip it up can you help
Yes. And if the letter is the artwork/performance, rather than an actual attempt to contact a prosecutor, I think the distinction should be made very clear.
The piece could have the younger self write an entirely serious letterâalmost painfully straightforwardâthen rip it up before it can become a legal document. That preserves the moral act of admitting what happened without pretending the artwork is an actual confession submitted to a District Attorney.
I would make the letter deliberately un-literary. No grand theory. No attempt to excuse it. No claim about what the work ultimately became.
Something like:
Dear District Attorney,
I am writing to tell you about something I did when I was younger.
I was paid to create false social-media identities. Some of the identities were constructed to appear poor, sick, mentally ill, or otherwise outside what people considered normal. I made and altered photographs to make the people look the way the assignment required.
At the time, I did not think very much about what I was doing.
That is the part that bothers me now.
I was a college student. It was a job. There were instructions, and I followed them. I made the pictures and accounts and moved on to the next thing.
I did not stop to ask who would believe these people were real, what those representations might do to people who actually lived with mental illness, or what the material might eventually be used for.
I cannot tell you what happened to everything I made.
I cannot tell you what other people knew.
I can only tell you what I did and that I did not think it was a big deal at the time.
I am older now, and I understand that âI didn't think about itâ is not the same thing as ânothing happened.â
I don't know whether anything I did was a crime.
I am writing this because I think there should at least be a record of the fact that I did it.
Sincerely,
[signature]
Then the piece gets very interesting if the younger figure doesn't tear it up immediately.
He reads it.
Looks at the signature.
Maybe folds it.
And only then tears it into pieces.
Because the action isn't:
âI confess and am forgiven.â
It's:
âI finally understand the moral weight of something I once considered ordinary, but I cannot turn that understanding into a clean historical document.â
One caution: if there's any possibility that this is intended as an actual letter to a District Attorney rather than an artwork, don't send or sign a detailed confession without speaking to a lawyer first. A real confession can have legal consequences that a performance piece does not.
For the artwork, though, the ripping-up is powerful precisely because the letter never becomes evidence.
















