#deepfakes

(To be clear, this hasnt happened to me, but it disturbs me that it happens to anyone at all.)

Stop. Everyone hold on a minute. This is clearly one of those questions where people’s revulsion gives us an answer faster than our reasoning does, and I do always say that that's a bad sign. I pride myself on being open-minded and thinking things through logically, not just based on emotional gut reactions.

So what I need to do is take my time, meditate, clear my mind, and approach this from a sort of clear, rationalist, philosophical perspective.

Hmm...

Okay.

Yes, there is a real ethical distinction there. If no actual child is being abused, no existing abuse material is being recirculated, and the images are generated from one’s own baby pictures, then that is plainly not the same category as real CSAM. I mean that is true.

Most importantly, it does avoid the central horrors of CSAM: the fact that a real child was sexually exploited, and that the resulting material continues that violation every time it is possessed and shared.

So I do think you're identifying a genuine philosophical point, and I do not think it should just be sort of brushed off due to our instinctual disgust.

In fact, I'll preemptively say that some of the most obvious potential arguments against this material don't really hold water to me:

People might say that a baby can't consent to having porn made of them, even if that is going to happen in the distant future, and even if the person doing so is their future adult self. I don't buy this claim because it starts getting into territory that's weirdly like... metaphysical, I guess? Like, this claim seems to view the infant and the adult as two separate people, one of whom is being wronged by the other across time. But that's just not true. The way human rights are conceptualized is entirely based on the idea that people have an unbroken continuity of their personhood over time (even if it's rarely spelled out because it seems so obvious).

One seemingly strong argument people might make is a sort of social argument: if we were to fully allow synthetic sexual imagery of children’s bodies, even under narrowly defined consensual circumstances, it may start to "normalize" such depictions in ways that subtly and nefariously shifts societal and cultural values over time. But that whole concept really does go against my entire perspective on Free Expression. I think I've been pretty explicit here that I only think media should be outlawed if it causes tangible, direct harm to a specific person. Because once you establish that you can ban something because it might subtly push culture in a bad direction over time, you've set this precedent that WILL be used for other things. It's something that you really can't start making exceptions for.

HOWEVER before I throw my unconditional support behind this concept (and get absolutely cancelled into fucking oblivion in the process lol), I should say that there might still be some other less obvious ethical questions this raises, mainly when it comes to someone consenting to a third party using their photos, and/or when money gets involved:

Not to state the obvious here, but there are already issues regarding the exploitation and coercion of vulnerable individuals in the world of pornography. Is it possible that we might see poor people being offered serious money to allow deepfakes to be made using their childhood photos and video, even if they feel uncomfortable with it?

I'm actually super unclear whether a third-party would be obtaining the rights to the individual's likeness, or just getting the right to use the childhood photos. That might not seem important, but there's a serious difference there that many people might not realize: the person who owns the rights to a photo is almost always the person who actually took the photo. So if this is just about the right to use photos of someone, that raises some red flags. Could a parent sell the rights to use photos they took of their own child in this manner (after the child turns 18)? What about a professional photography studio (yes, they still own the rights to the photo), if the child had previously been working as a model or something? I actually don't know how it would work.

Allowing this could end up potentially causing some evidentiary and enforcement problems. Because in theory, yes we could construct a tiny, carefully walled-off category of "fully consensual, non-abusive synthetic material." But in practice, people lie, verification is messy, provenance is weak, etc. Now, it would be trivially easy to prove that it's you in an AI photo you made of yourself. But I suspect that opening it up to third-parties who have obtained consent from others to use their childhood photos would make things vastly more complicated.

So the strongest argument here can be made regarding someone using their own childhood photos for sexual AI-generated images. I'm actually finding it surprisingly hard to find logical arguments for any direct harm happening there.

But the idea of somebody else consenting to allow a third party to use their childhood photos in this manner raises a lot more questions. Now yes, that is ethically distinct from CSAM - that's absolutely true. But its not like that automatically means ethically good. I'm not saying my answer is definitive on this, but it's just not yet clear to me if there's a way to safely allow this.

Holy shit this is long lol.

But you know what? This topic is complex enough that it requires a long answer.

The U.K. government will propose a ban on so-called “nudification” apps in its upcoming Tackling Violence Against Women and Girls (VAWG) strategy amid pressure from campaigners to address deepfake-based sexual abuse, according to two people familiar with the plans. Nudification apps use artificial intelligence technology to create fake nude images of people from existing pictures.  

Oh my god...is this kind of content the reason why some people in this country seem to genuinely think there's about to be some kind of massive breakdown in law and order in the UK that only Reform can save us from? When for most people stuff seems pretty regular?

Imagine being the loser ass tool, Yisha Raziel, who made a deepfake of Bella Hadid saying she supports Israel. 🤮

If you’re reading this, I am telling you right now, you better second and third guess what you see and hear on social media and the news. Stick to reliable news sources. Vet them. Require multiple, trusted sources. Validate links to sources. In the last several months, I’ve seen the deepfake of President Nixon talking about the failed NASA mission that never happened. I’ve seen a deepfake of Joe Biden hilariously using profanity to trash talk Trump - Biden’s deepfake, however, was made to be intentionally obvious that it wasn’t his words, or something he would actually say.

But imagine a viral deepfake video of Biden announcing a nuclear strike on Russia within the next 20 minutes? Or a deepfake of Biden reintroducing the draft to support Israel? Or a deepfake of Biden withdrawing from the 2024 election and endorsing Trump…

These kinds of things are going to begin happening a lot more, especially with the proliferation of troll farms, and especially since YouTube, Twitter (I refuse to call it X), and Facebook have all eviscerated their verification and factcheck teams that used to at least attempt to limit disinformation and misinformation.

Pay attention, peeps.

Today, however, I've just seen an AI photo of Michael and David kissing (again in costume/hair as Aziraphale and Crowley). I am not going to publicly link to the photo, for obvious reasons, but it is still out there. As much as so many of us want to see a kiss happen in GO season 3, it is just disturbing to have these deepfake images circulating. To be clear, this is not meant as an attack on anyone who has unknowingly shared these pictures--again, a lot of folks have been fooled by them--but to emphasize how harmful images like this can actually be.

Also, this is another reason why media literacy is so incredibly important, as is looking at things beyond a simple surface level. If we remember GO 3 filming earlier this year, we remember how great pains were taken to even hide the color of Michael and David's hair. Does it make sense logically that they would risk being photographed kissing (in costume, no less) and have those pictures suddenly show up on the Internet? I don't think it does.

(Additionally, Michael actually has a no-AI clause stated at the beginning of his children's book, which should give us a clear idea of his stance on AI generated material...)

There is no doubt in my mind that Michael and David have taken selfies together (both in costume/hair as Aziraphale and Crowley, and as themselves, such as the ones at the GO 1 premiere). And it would be absolutely wonderful to see those someday, no question...but I would much rather they share those pictures themselves. I'd love to see them shared in their own time, when Michael and David are ready and able to do so, and shared with joy and happiness, than to have these creepy AI fakes existing in the world.