<h1>Do Not Write with an <span class="small-caps">LLM</span></h1>
<img src="/images/green_bird.webp" alt="A photo taken by myself of a green bird.">
<h2>A Growing Trend</h2>
<p>I have been see­ing an in­creas­ingly preva­lent trend of peo­ple show­ing up in on­line spaces proudly ﬂaunt­ing that they are writ­ing with the as­sis­tance of AI.
I of­ten see them clar­ify that they are go­ing fur­ther than let­ting the model per­form gram­mar or fact-check­ing.
They are de­scrib­ing an idea to an <span class="small-caps">LLM</span>, and giv­ing it com­plete con­trol over the ﬁ­nal writ­ten doc­u­ment.
They seem to be proud of this. They should­n’t be.</p>
<h2>What <strong>Does Not</strong> Work</h2>
<p>Writing seems to be a shadow of a more fun­da­men­tal and use­ful process we like to call<span class="push-double"></span> <span class="pull-double">“</span>thinking”.
There is a rea­son why LLMs, which are the clos­est thing we cur­rently have to<span class="push-double"></span> <span class="pull-double">“</span>software that thinks” is trained to think through writ­ing.
It seems log­i­cal, then, that we can use this<span class="push-double"></span> <span class="pull-double">“</span>software that writes” to help along our own think­ing process, right? Wrong.</p>
<p>Writing is one of the most cere­bral ac­tiv­i­ties that hu­mans do on a reg­u­lar ba­sis.
<a href="https://elijahpotter.dev/articles/why-i-talk-to-myself">I try to sit down and write about a com­plex topic at least once a week.</a>
There are a num­ber of rea­sons I do that per­tain­ing to my job in par­tic­u­lar, but there are more gen­er­ally ap­plic­a­ble rea­sons that can ap­ply to any pro­fes­sion.</p>
<p>When a math­e­mati­cian needs to think crit­i­cally about some the­o­rem or proof, they of­ten turn to a dry-erase board or a chalk­board.
The math­e­mati­cian then writes in clear no­ta­tion what they imag­ine the prob­lem to look like in their heads.
From there, they can ma­nip­u­late that no­ta­tion un­til they reach their de­sired out­come.</p>
<p>The English lan­guage is ex­tremely sim­i­lar, with a key dif­fer­ence.
Math­e­mat­i­cal no­ta­tion is specif­i­cally de­signed for a nar­row do­main.
Nat­ural lan­guages, on the other hand, can be ap­plied to any ﬁeld.
By writ­ing your idea down on pa­per (or in a Google Doc, it does not mat­ter), you give it sub­stance.
This sub­stance can then be shaped it­er­a­tively to­wards a goal of some kind.</p>
<p>No great ideas were writ­ten down on the ﬁrst try.
They started as a vague no­tion, and through writ­ing and rewrit­ing, they be­came some­thing con­crete and valu­able.
You can­not dic­tate a vague no­ta­tion to an <span class="small-caps">LLM</span> and ex­pect it to spit out some­thing tan­gi­bly valu­able.
Any at­tempt to do so is lazy, and it will re­sult in fail­ure.
I have seen it in the wild, and frankly, it is a lit­tle em­bar­rass­ing.</p>
<p><a href="https://ammil.industries/i-know-you-didnt-write-this/">This ar­ti­cle</a> feels es­pe­cially rel­e­vant to­day.</p>
<h2>What <strong>Does</strong> Work</h2>
<p>Using an <span class="small-caps">LLM</span> for re­search can be very ef­fec­tive.
Searches to ChatGPT or Perplexity can sur­face in­for­ma­tion faster than dig­ging around in a book you read three months ago.
For lots of searches, these two sources have com­pletely re­placed Google and DuckDuckGo for me.</p>
<p>They’re also quite ex­cel­lent fact-check­ers.
I’ve seen that plenty of folks have re­ceived quite good re­sults by past­ing their work into an <span class="small-caps">LLM</span> with an in­ter­net tool (like ChatGPT with Thinking en­abled).</p>
<p>Finally, I’ve per­son­ally found that LLMs are quite good at ﬁnd­ing places where I sim­ply for­got to in­sert con­text.
Some­times I for­get to de­ﬁne a term or in­sert a rel­e­vant link.
Even small mod­els like <code>gemma3n:e2b</code> can catch me.</p>
<h2>What <strong>You</strong> Should Be Doing</h2>
<p>When you need to com­mu­ni­cate an idea in your head, sit down with a notepad and a key­board and ex­plain it.
I per­son­ally think you should use a gram­mar checker, since they are far less likely to im­pede your thought process, but if you need to, you can in­struct ChatGPT to cri­tique your work once it is ﬁn­ished.</p>
<p>If an idea de­serves an au­di­ence, you’re ca­pa­ble of writ­ing it out your­self.
In the same vein, if you can vaguely de­scribe it to ChatGPT, you can vaguely de­scribe it to your in­tended au­di­ence.
Do your­self a fa­vor and skip the mid­dle­man.</p>
<h2>What We Should Be Building</h2>
<p>Now, I’d like to en­ter the sec­tion where I talk specif­i­cally about what this all means for peo­ple who cre­ate tools for writ­ers.
That in­cludes both Harper and WordPress.</p>
<p>A tool that helps some­one write is a tool that di­rectly in­ter­faces with how that per­son thinks.
That might in­clude what they think about, but more con­cretely I am re­fer­ring to the ac­tual day-to-day process of think­ing through com­plex ideas.
If you don’t be­lieve me, it’s prob­a­bly be­cause you skipped ahead in­stead of read­ing this post from the be­gin­ning.</p>
<p>Most cru­cially, we can­not al­low our­selves to build tools that dis­suade peo­ple from ex­press­ing their ideas in the way they imag­ine.
This can take the form of fric­tion, like build­ing tools that are so cum­ber­some that one dreads to open them at the start of the work­day.
This can also take the form of a tool that crushes or over­writes an au­thor’s core mes­sage.</p>
<p>A com­mon com­plaint I hear about Grammarly (from peo­ple who have switched to Harper from Grammarly) is that it’s too de­mand­ing. When they write prose in a cre­ative or un­usual fash­ion, their ser­vice of­ten forces them back into a colder and more for­mal way of speak­ing.
We don’t want to be like them.</p>
<p>For Harper, that means we need to be di­verse in our train­ing datasets and mind­ful of feed­back from our users.
For WordPress, it means we need to en­cour­age our <span class="small-caps">LLM</span> in­te­gra­tions to tread lightly and re­spect­fully.
They need to ac­cept when they’re wrong.
Just as any good hu­man should.</p>
<blockquote>
<p>Months af­ter writ­ing this post, I came across an­other.
Au­thor Cynthia Dunlop gives <a href="https://writethatblog.substack.com/p/dev-reaction-to-ai-blog-posts">a great overview of how de­vel­op­ers re­act to blog posts writ­ten by <span class="small-caps">AI</span></a>.
I highly sug­gest you take a look if you have more time.</p>
</blockquote>

I have been seeing an increasingly prevalent trend of people showing up in online spaces flaunting that they are writing with the assistance of AI. They seem to be proud of this. They shouldn't be.

<p>I have been see­ing an in­creas­ingly preva­lent trend of peo­ple show­ing up in on­line spaces ﬂaunt­ing that they are writ­ing with the as­sis­tance of <span class="small-caps">AI</span>. They seem to be proud of this. They should­n’t be.</p>

Do Not Write with an LLM

It didn't work for me, and if you reading this, it probably won't work for you either.

Do Not Type Your Notes

<h1>Slop Paralysis</h1>
<blockquote>
<p><strong>slop paral­y­sis - noun</strong></p>
<p>A com­plete or par­tial loss of func­tion while re­view­ing the out­put of a cod­ing agent.</p>
</blockquote>
<p>Let me paint you a pic­ture.</p>
<p>You have an idea for prod­uct.
It could be any­thing: A mo­bile app, a dash­board, or a script to au­to­mate your work.
So, you sit down with your fa­vorite <span class="small-caps">LLM</span> and de­scribe your idea.
Maybe you have a pretty good un­der­stand­ing of how it should be im­ple­mented.
You might even know the over­all struc­ture of the pro­ject in your mind.
You tell your cod­ing agent all of this.</p>
<p>Then, you let it loose.
It cooks and cleans and im­ple­ments your prod­uct for you.
In the end, you have <em>some</em> idea of how the end re­sult works, but it is not com­plete.
Since this is a pro­ject that is im­por­tant, which you in­tend to main­tain, you go to read the code.
That’s when it hits you.
<strong>Slop paral­y­sis</strong>.</p>
<h2>The Problem</h2>
<p>Slop paral­y­sis is the com­plete lack of de­sire to re­view the out­put of an LLM.
It could show up for any num­ber of rea­sons.
The most com­mon, for me, are:</p>
<ul>
<li>The sheer amount of code de­mand­ing con­sump­tion.</li>
<li>Missing con­text (that the agent was aware of, but not you).</li>
<li>A fear of break­ing some­thing.</li>
</ul>
<p>In the end, slop paral­y­sis slows you down and makes your life more stress­ful.
So, what can we do about it?</p>
<h2>Some Solutions</h2>
<p>I will de­scribe some so­lu­tions that have worked <em>for me</em>.
As al­ways, your mileage may vary.</p>
<p>The ob­vi­ous so­lu­tion is to sim­ply not use an agent.
Some­times cod­ing agents make your job eas­ier.
Some­times they do not.
<a href="./when_to_use_an_agent">Knowing which is which is dif­ﬁ­cult, but ex­tremely valu­able.</a></p>
<p>When you do de­cide to use an agent, you can have the agent sim­ply pro­duce less code.
I have heard of <a href="https://github.com/DietrichGebert/ponytail">pro­jects</a> that help you do this, but I have not ac­tu­ally tried them.
In­stead, I ask the agent to make a plan ﬁrst, then re­work that plan my­self to min­i­mize the num­ber of changes.
In the end, a plan which was orig­i­nally writ­ten by the agent be­comes one that has been mer­ci­lessly edited by my­self.
In this way, I min­i­mize the amount of code which de­mands con­sump­tion.
The side-ef­fect of this is that I then have an ex­cel­lent un­der­stand­ing of what the agent ac­tu­ally does, which helps with the con­text prob­lem.</p>
<p>The ﬁ­nal strat­egy, which I use when all else fails, is to refac­tor the code by hand.
When the agent has proven the tech­ni­cal fea­si­bil­ity of the pro­ject, but the code is sim­ply too ex­pan­sive to prop­erly grok all at once, I sit down with a ﬁne-tooth comb and refac­tor it, mod­ule by mod­ule.
I do not need to care­fully read each func­tion and eval­u­ate its mer­its, but I do force my­self to, at min­i­mum, lay eyes on them all.</p>
<h2>Stay Steady Out There</h2>
<p>I ﬁnd my­self be­com­ing more over­whelmed by the dis­course every sin­gle day.
It’s ex­haust­ing how much is hap­pen­ing in the world, and even worst, how much you are ex­pected to care about it all.
Take some time for your­self.
Save your­self from slop paral­y­sis.</p>

A complete or partial loss of function while reviewing the output of a coding agent.

<p>A com­plete or par­tial loss of func­tion while re­view­ing the out­put of a cod­ing agent.</p>

Slop Paralysis

<h1>Linkarzu: Harper Is Getting Better</h1>
<p>Linkarzu’s re­cent video about Harper is a great primer on what it can do if you spend a ton of time in Neovim (like I do). It’s true: Harper is get­ting bet­ter.</p>
<iframe width="100%" height="400" src="https://www.youtube.com/embed/he8V6gj9IG0?si=mbw6q8m3jqi1qhSf" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>

Linkarzu's recent video about Harper is a great primer on what it can do.

<p>Linkarzu’s re­cent video about Harper is a great primer on what it can do.</p>

Elijah Potter

Linkarzu: Harper Is Getting Better

Comments

Other Stuff

Do Not Write with an LLM

Do Not Type Your Notes

Slop Paralysis