Hello! I keep hearing that fandom culture has changed, and there are less comments now than there were years ago. Have you noticed this in your analysis? Is the percentage of comments being left today lower than before?
Hey! Thanks for the question -- it prompted me to start collecting data about comments (after procrastinating on it for a while, because I had to write new code to gather comment data). I've also seen other discussions from folks also thinking about how to do this kind of analysis (like in the fandom data projects community) -- hopefully we'll end up with multiple people attacking this from different angles and getting a variety of data about comments!
I'll give a sneak preview that partially addresses your question and contains some good news. If we look at the fraction of AO3 works that get at least one comment (focusing just on one-shots for now), I think things have gotten better over the past decade on AO3*:
In other words, it tentatively looks like more works were getting at least one comment in 2024 than in 2014 (for a variety of time periods). One caveat, though -- if a bunch of works with no comments got deleted in the interim, there will be survivor bias here. I'll try to look into that possibility later. Another caveat: this is based on only like ~100 randomly selected works from each year -- this may all change with more data!
Another interesting tidbit: I still see some of the 2014 works getting comments. In fact, ~30% of works have gotten new comments over 5 years after they were posted, and it looks like ~10% of one-shots posted back in Mar 2014 got a new comment in 10 years later, in 2024.
I'm still doing other analyses; there may be other factors that better match with the discourse around how comment culture has changed. It could be that comment activity peters out faster now than it did back then, for instance. Or the total number of comments left on the popular works is less now than it was back then (though my current methods may not be able to capture that). Edit thanks to quick eagle-eyed readers: it's likely that some of what people are thinking about is ratio of comments to hits -- that is hard to compare in 2014 to 2024, because we don't know which hits came from which years. But I am working on some analyses along those lines. :)
If you have other hypotheses about what's changed in commenting culture, feel free to share! I'll look into what I can.
Some methodology notes:
*I've been tackling this by comparing AO3 one-shots posted in early 2014 to one-shots posted in 2024, and comparing activity in the days/weeks/months immediately after the works were posted. (To start with, I'm only scraping the first page of comments for each work -- meaning the first 20 comment threads -- so there are lots of comments I'm potentially missing for the really popular works. But for many works, this captures all the comments, and I think it may be sufficient for a lot of the analyses I am interested in.)
I'm choosing to focus on 2014 vs. 2024 because 2024 is close to now (but it's been long enough for comments to have settled down a bit), and 2014 was well after AO3 was established (thus it was already a pretty lively time on AO3). I don't want to collect data about every single year because it's too time intensive/too hard on AO3's servers. But if people think that I should be looking at different years, I'm interested in feedback.
Because it's only been ~10 months since March 2024, I am limiting a lot of my analyses to only look at commenting activity the first ~10 months after works were posted in both cases.
