Jackie

[ID: two doodles of alphys. one is of her in spongebob's goofy goober rock outfit, dangling from strings with a smile. the other is of her in her festival costume saying BOO with her claws held up. screenshots of spongebob in the goofy goober outfit dangling from the ceiling and of alphys in her festival costume also dangling from the ceiling are in the background. end ID]

Matured just in case

You are enabling AI companies to become gatekeepers of knowledge and giving them the ability to censor whatever they don't want you to see. You are abandoning your ability to find information independently and giving a corporation the power to decide what is worth knowing.

However, I do think this case is great example of what happens when smart people decide they can use these systems “responsibly.”

Let’s put aside the plagiarism and the energy use for a second (not that these don’t matter, but they’re not relevant to my point at the moment) and pretend these systems were made with entirely properly obtained info and ran on only solar, but otherwise were entirely the same. If you’re a person, you might think “okay, I’m going to only use this to come up with ideas for my next paper: I’m going to do all the research myself and the writing, I’m just gonna brainstorm topics.”

The thing is, even if you’re trying to limit use to just “brainstorming” the chatbot isn’t going to limit itself to just brainstorming. You might ask it “what should I write about involving Greek history” and it may suggest “the plague of Athens” but it’s also going to suggest some “basic info” on the plague of Athens that you might end up picking up and deciding your topic is. It’s going to provide you with “research.” And even if you decide to check that research yourself, that’s still setting you down a specific path you might not have picked organically.

And speaking of double checking its “research”, fact checking is a time heavy process. Not only now do you have to read the original text the bot provided, but you also have to compare it line by line with the summary the bot provided. That’s more time than it would have taken to just read the article by itself. And with any time heavy task, people are going to get lazy. And in original research being lazy might mean skimming a paper or an abstract, chatbots allow you to be lazy without looking at the article at all.

And soon enough, despite telling yourself you were only going to use it for brainstorming, you have offloaded topic generation, research and eventually even drafting because that’s what these bots are intended to do. They are not meant to serve as research tools or help brainstorm or serve as a bouncing off board: they are built to encourage maximum engagement. And that means if you go at them with the best of ethical intentions, they are built to tempt you to use them as much as possible, regardless of whatever line you drew in the sand for yourself.