<h1>Local-First Software is Easier to Scale</h1>
<img src="/images/flatirons.webp" alt="The Flatirons">
The ti­tle of this post is some­what mis­lead­ing. Local-ﬁrst soft­ware rarely needs to be scaled at all.
<a href="https://writewithharper.com">Harper</a> re­cently re­ceived a mas­sive in­crease in both traf­ﬁc and user count.
How?
By mak­ing it to the front page of Hacker News.
If you could­n’t tell by the ex­tent to which I talk about this, I’m thrilled.
This amounted to a tremen­dous amount of free ad­ver­tis­ing, if noth­ing else.
I’ve been think­ing a lot about the won­drous ben­e­ﬁts of work­ing at the edge.
That’s just one term of many that peo­ple use to de­scribe Harper: “edge-ﬁrst”.
Others in­clude “local-ﬁrst” or sim­ply “on-device”.
They are all just jar­gon for a sim­ple idea: We run all the rel­e­vant gram­mar check­ing code as phys­i­cally close to the users as pos­si­ble.
That way, we can serve up sug­ges­tions faster than any­one else.
To achieve our goal, we make sure that every­thing is well-op­ti­mized and lean.
Harper barely uses any CPU or mem­ory at all.
What does all this mean in the con­text of the re­cent uptick in user ac­qui­si­tion? Imagine, for a mo­ment, we are LanguageTool.
Our soft­ware is writ­ten in Java, with ques­tion­able at­ten­dance to the ef­ﬁ­ciency of our code.
Since our soft­ware re­quires a big server to run, we have a cer­tain num­ber of servers on standby to han­dle a cer­tain amount of ex­pected load.
If sud­denly the num­ber of re­quests we re­ceived were to dou­ble (as it did for the Chrome ex­ten­sion), we would be big trou­ble.
To avoid in­creas­ing the la­tency on re­quests (or drop­ping re­quests all to­gether), we would need to scale up the num­ber of run­ning servers.
This not only takes hir­ing an ex­pert in cloud ar­chi­tec­ture, but also ad­di­tional fund­ing to pay the AWS (or what­ever) bill at the end of the month.
Because Harper runs at the edge (no server re­quired), we don’t have to worry about that.
In fact, I only no­ticed that our user count had spiked af­ter I vis­ited Hacker News the morn­ing af­ter.
No hic­cups at all.
Lots of cloud providers like to brag about be­ing able to scale with their users. I like to brag about not hav­ing to scale at all.

The title of this post is somewhat misleading. Local-first software rarely needs to be scaled at all.

The ti­tle of this post is some­what mis­lead­ing. Local-ﬁrst soft­ware rarely needs to be scaled at all.

Local-First Software Is Easier to Scale

<h1>Why I Talk to Myself</h1>
<img src="/images/bike_sidewalk.webp" alt="My bike broke down. Luckily, I had my camera">
Each week I sit down and re­ﬂect on what I’ve learned. I think about which of my ef­forts have helped the Harper en­deavor, and which have harmed it. It’s not easy, but I think it’s one of the best habits I’ve built. More ac­cu­rately, it’s one of the best habits <a href="https://ma.tt">Matt</a> has en­cour­aged me to build.
When I re­ally think about it, I’m re­minded of the orig­i­nal <a href="https://blog.afterthedeadline.com/">After the Deadline blog</a>, which co­in­ci­den­tally also had a cat­e­gory called “Talking to Myself”. I won­der if Raphael Mudge (AtD’s au­thor) had a sim­i­lar mo­ti­va­tion.
I talk to my­self to ﬁnd the weak­nesses in Harper’s mis­sion and fo­cus my at­ten­tion on what mat­ters. It is an ef­ﬁ­cient way to get from <a href="https://ma.tt/2025/05/sharing-levels/">layer one to layer ﬁve</a>. It can help get other main­tain­ers on the same page and build a body of knowl­edge that can be linked to from any­where.
Not wor­ry­ing about keep­ing in­for­ma­tion locked-down is one of the more beau­ti­ful parts of work­ing in pub­lic. Open source code would be noth­ing with­out sim­i­larly open source knowl­edge. I talk to my­self on­line so my users can un­der­stand my in­ten­tions.
In many senses, we are not un­like moths. We are drawn to the lights of dis­trac­tion, hype, and pro­cras­ti­na­tion. For me, set­ting up check­points to stop and re­ﬂect has been an ef­fec­tive de­ter­rent from these lights. In fact, I think each minute for which I stop and think has paid it­self back three times over in time sav­ings. If I can bet­ter al­lo­cate my time and en­ergy, I can avoid do­ing re­dun­dant work pur­su­ing point­less goals.
<h2>Bonus Points</h2>
A <a href="./markov_chains_are_the_original_language_models">few</a> of my <a href="./local-first_software_is_easier_to_scale">ar­ti­cles</a> have be­come pop­u­lar on sites like Hacker News and Reddit. We’ve got­ten quite a few Harper in­stal­la­tions from links on these ar­ti­cles. I would never rely on this kind of blog­ging as a source of ad­ver­tis­ing, but it is nice to see it help spread the word.

It's not easy, but I think it's one of the best habits I've ever built.

It’s not easy, but I think it’s one of the best habits I’ve ever built.

Why I Talk to Myself

<h1>Slop Paralysis</h1>
<blockquote>
slop paral­y­sis - noun
A com­plete or par­tial loss of func­tion while re­view­ing the out­put of a cod­ing agent.
</blockquote>
Let me paint you a pic­ture.
You have an idea for prod­uct.
It could be any­thing: A mo­bile app, a dash­board, or a script to au­to­mate your work.
So, you sit down with your fa­vorite LLM and de­scribe your idea.
Maybe you have a pretty good un­der­stand­ing of how it should be im­ple­mented.
You might even know the over­all struc­ture of the pro­ject in your mind.
You tell your cod­ing agent all of this.
Then, you let it loose.
It cooks and cleans and im­ple­ments your prod­uct for you.
In the end, you have some idea of how the end re­sult works, but it is not com­plete.
Since this is a pro­ject that is im­por­tant, which you in­tend to main­tain, you go to read the code.
That’s when it hits you.
Slop paral­y­sis.
<h2>The Problem</h2>
Slop paral­y­sis is the com­plete lack of de­sire to re­view the out­put of an LLM.
It could show up for any num­ber of rea­sons.
The most com­mon, for me, are:
<ul>
<li>The sheer amount of code de­mand­ing con­sump­tion.</li>
<li>Missing con­text (that the agent was aware of, but not you).</li>
<li>A fear of break­ing some­thing.</li>
</ul>
In the end, slop paral­y­sis slows you down and makes your life more stress­ful.
So, what can we do about it?
<h2>Some Solutions</h2>
I will de­scribe some so­lu­tions that have worked for me.
As al­ways, your mileage may vary.
The ob­vi­ous so­lu­tion is to sim­ply not use an agent.
Some­times cod­ing agents make your job eas­ier.
Some­times they do not.
<a href="./when_to_use_an_agent">Knowing which is which is dif­ﬁ­cult, but ex­tremely valu­able.</a>
When you do de­cide to use an agent, you can have the agent sim­ply pro­duce less code.
I have heard of <a href="https://github.com/DietrichGebert/ponytail">pro­jects</a> that help you do this, but I have not ac­tu­ally tried them.
In­stead, I ask the agent to make a plan ﬁrst, then re­work that plan my­self to min­i­mize the num­ber of changes.
In the end, a plan which was orig­i­nally writ­ten by the agent be­comes one that has been mer­ci­lessly edited by my­self.
In this way, I min­i­mize the amount of code which de­mands con­sump­tion.
The side-ef­fect of this is that I then have an ex­cel­lent un­der­stand­ing of what the agent ac­tu­ally does, which helps with the con­text prob­lem.
The ﬁ­nal strat­egy, which I use when all else fails, is to refac­tor the code by hand.
When the agent has proven the tech­ni­cal fea­si­bil­ity of the pro­ject, but the code is sim­ply too ex­pan­sive to prop­erly grok all at once, I sit down with a ﬁne-tooth comb and refac­tor it, mod­ule by mod­ule.
I do not need to care­fully read each func­tion and eval­u­ate its mer­its, but I do force my­self to, at min­i­mum, lay eyes on them all.
<h2>Stay Steady Out There</h2>
I ﬁnd my­self be­com­ing more over­whelmed by the dis­course every sin­gle day.
It’s ex­haust­ing how much is hap­pen­ing in the world, and even worst, how much you are ex­pected to care about it all.
Take some time for your­self.
Save your­self from slop paral­y­sis.

A complete or partial loss of function while reviewing the output of a coding agent.

A com­plete or par­tial loss of func­tion while re­view­ing the out­put of a cod­ing agent.

Slop Paralysis

<h1>I Spoke at WordCamp U.S. in 2025</h1>
I had the in­cred­i­ble op­por­tu­nity to speak at WordCamp U.S. at <a href="https://ma.tt">Matt</a>’s sug­ges­tion.
I met a num­ber of won­der­ful, kind, and invit­ing peo­ple.
It was my ﬁrst WordCamp and ﬁrst con­fer­ence talk, so I was nat­u­rally ner­vous.
The com­mu­nity made it feel easy.
<iframe width="100%" height="400" src="https://www.youtube-nocookie.com/embed/e-jYf8ZV_SA?si=VDPWlTx0kV8lVJTU" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
I spoke about how we can use ma­chine learn­ing to im­prove the qual­ity of our ap­pli­ca­tions with­out big cap­i­tal ex­pen­di­tures.
In fact, I ar­gue that cap­i­tal ex­pen­di­tures are of­ten a step in the wrong di­rec­tion.
Fun fact: This talk started out as <a href="./training_a_chunker_with_burn">a blog post</a>.

It was my first WordCamp and first conference talk, so I was naturally nervous.

It was my ﬁrst WordCamp and ﬁrst con­fer­ence talk, so I was nat­u­rally ner­vous.

Elijah Potter

I Spoke at WordCamp U.S. in 2025

Comments

Other Stuff

Local-First Software Is Easier to Scale

Why I Talk to Myself

Slop Paralysis