AI and the Digital Frame

The use of Artificial Intelligence in creative endeavors is a topic of growing debate, with people who are strongly for it and strongly against it. Personally, I don’t think AI is as big a “threat” to creativity as some pretend. I also don’t think it’s a huge boon to creativity that many of its biggest boosters imagine it will be, although I certainly think it will have uses very soon. Let me explain what things look like from my very casual understanding of AI and my much deeper understanding of the art of storytelling.

First of all, let’s address the term Artificial Intelligence. This is a marketing term. There are a number of assumptions baked into the term which I don’t entirely agree with, although I will be using the term AI for the bulk of this post. What the programs we call AI do is they use mathematical algorithms to predict categories and outcomes. Pattern recognition and prediction is a function of intelligence. However, AI does not organize the information that it uses to make predictions by itself, it relies extensively on user input to create connections between data points then uses very advanced math to predict further connections or to anticipate what connections people would make between new data points.

A more honest term would be algorithmic prediction. However predictions are much riskier things than intelligence so the decision has been made to brand these programs as AI. There’s a lot of tricky things baked into this idea, not the least of which is that prediction is intelligence. That could be a whole essay in itself but I’ll leave it be for now. Let’s move on to the second important part of the discussion for the purposes of my area of expertise, the large language model.

AI that takes gives output via text or voice synthesizer choose their own words based on a large language model (LLM). These models analyze truly titanic quantities of text to build an idea of how the human language is used. Typically they are trained on some portion of the available text on the Internet. Risky? Undoubtedly. Most of the Internet is used by people who use its anonymity as an excuse to prolong their adolescence and write accordingly. As a result many of the “chat” AI out there, like ChatGPT, come off as shallow and immature. Personally I don’t think that’s a shortcoming of the technology but rather a shortcoming of how it’s been trained to make predictions. But I digress.

Once a LLM is trained you prompt it with a few words and concepts and the AI sees how those words are connected in its data sets, clubs them into the most common format out in the wild and regurgitates it all for you to read. Of course, it adjusts the format according to certain rules in its coding. AI tends to write with excellent spelling, grammar and punctuation, for example, even though much of the Internet has none of those things. So, with this information about LLMs in mind let’s talk about using AI in storytelling.

The art of telling a story involves very deliberately taking events and arranging them into a narrative to create character development and provoke an emotional response from the audience. The nature of a LLM makes it a very poor tool for this undertaking. Remember, the way AI works is by using it’s LLM to predict the most likely way words and concepts are connected. So if you use AI to build a story concept you will get what is statistically most common for that kind of story. I cannot think of any less creative way to tell a story. It may be mathematically deliberate but math doesn’t define character development or emotional response. Emotion, in particular, is blunted when the same emotional stimulus comes in over and over, which is exactly what you will get when statistics drive your outcomes. You might argue it’s the entire point.

If you’ve ever read any fiction on the Internet you’re probably aware that a huge amount of it is very derivative. Repetitive, predictable characters, plots and settings. There’s nothing wrong with writing something a lot like something you’ve read, in fact it’s one of the most important exercises for developing writers in my book. But when you’re building a LLM all that repetition weights the model towards those overemphasized story components. The AI is going to give you more of that than anything else. In short, your story will be confined by the whims of whatever is popular on the Internet, making it even more predictable and derivative.

In time, it may be possible to dig into the structure of your LLM and tweak what elements are weighted and how but even then, it will still be in service to an AI. It’s still a predictive – and predictable – algorithm.

The second problem with AI as a creative tool is the ability of the programmer to build frames into how it delivers output. I mentioned this already. AI chatbots can be programmed to regurgitate text with proper grammar, punctuation and spelling and that’s not something that’s well reflected on the Internet, after all. Those are guidelines programmed into the AI by their creators.

There is no guarantee that these will be the only preprogrammed tools put in place to bound the output of the AI. In point of fact there’s plenty of evidence other such tools already exist. People who have tinkered with ChatGPT have found it has very strict ideological blinders placed on it and many of the variants of AI image generators will reject prompts with certain key words like “fiery” in them. Yes, the word fiery is banned. No, it’s not clear why. Right now these constraints are very obvious.

However, like all computer software, AI is getting more seamless in how you interface with it and more opaque in how its internal logic works. I doubt the creators of these tools will have them simply reject prompts they dislike for much longer. Soon they’ll just replace these undesirable prompts with more palatable ones. The end user probably won’t even be able to detect the change.

This second problem is the part of AI that really disturbs me about the technology, that audiences and creators will have their creativity bounded by the constraints of programmers without even realizing the straight jacket being put on them. It’s why I currently view the technology with great suspicion. And its why I have no plans to use it in any of my endeavors at the moment, no matter how great the time savings from doing so potentially are.

Now I’m not a total pessimist. I think there are a ton of very useful applications for AI in creativity coming down the pipe. So far none of the basic structural issues of algorithmic prediction or LLMs have been overcome so AI still pushes towards homogeneity but that’s not insurmountable. If deployed carefully and judiciously, to handle small tasks, that can be balanced out. The digital framing problem is more complex. I doubt the danger it poses can be entirely removed ever, since it’s an effect of the human nature of AI creators rather than a result of some shortcoming of the technology. In that matter you’ll just have to find programmers who you think you can trust and pay as much attention as possible to what happens when you prompt it. That’s still years away, though.

In the mean time, continue to watch the technology develop with a wary eye. When the conditions are right for widespread use of AI the creative landscape will begin to change incredibly fast. If you’re ready for it that will be a once in a lifetime opportunity to get your stories out. I am waiting for it with great interest.