<h1>Hacker News, sans AI</h1>
I like Hacker News, but I do not love that so much of it has turned into dis­cus­sion of a sin­gle topic: AI. So, I have cre­ated my own ver­sion.
A ver­sion of Hacker News, with­out AI.
<a href="/hnsansai">HNSansAI</a> pulls from the of­ﬁ­cial Hacker News API, looks through the con­tent of each ar­ti­cle, and dis­cards any that men­tion a term re­lated to “AI”. That in­cludes stuff like:
<ul>
<li>“OpenAI”</li>
<li>“Anthropic”</li>
<li>“Copilot”</li>
<li>“LLM”</li>
<li>…and many more.</li>
</ul>

I like HackerNews, but I don't love that so much of it has turned into discussion of a single topic: AI. This is a version of HackerNews, filtered to remove any article focusing on __AI__. Refreshes about every ten minutes.

I like HackerNews, but I don’t love that so much of it has turned into dis­cus­sion of a sin­gle topic: AI. This is a ver­sion of HackerNews, ﬁl­tered to re­move any ar­ti­cle fo­cus­ing on AI. Refreshes about every ten min­utes.

Hacker News sans AI

<h1>Local-First Software is Easier to Scale</h1>
<img src="/images/flatirons.webp" alt="The Flatirons">
The ti­tle of this post is some­what mis­lead­ing. Local-ﬁrst soft­ware rarely needs to be scaled at all.
<a href="https://writewithharper.com">Harper</a> re­cently re­ceived a mas­sive in­crease in both traf­ﬁc and user count.
How?
By mak­ing it to the front page of Hacker News.
If you could­n’t tell by the ex­tent to which I talk about this, I’m thrilled.
This amounted to a tremen­dous amount of free ad­ver­tis­ing, if noth­ing else.
I’ve been think­ing a lot about the won­drous ben­e­ﬁts of work­ing at the edge.
That’s just one term of many that peo­ple use to de­scribe Harper: “edge-ﬁrst”.
Others in­clude “local-ﬁrst” or sim­ply “on-device”.
They are all just jar­gon for a sim­ple idea: We run all the rel­e­vant gram­mar check­ing code as phys­i­cally close to the users as pos­si­ble.
That way, we can serve up sug­ges­tions faster than any­one else.
To achieve our goal, we make sure that every­thing is well-op­ti­mized and lean.
Harper barely uses any CPU or mem­ory at all.
What does all this mean in the con­text of the re­cent uptick in user ac­qui­si­tion? Imagine, for a mo­ment, we are LanguageTool.
Our soft­ware is writ­ten in Java, with ques­tion­able at­ten­dance to the ef­ﬁ­ciency of our code.
Since our soft­ware re­quires a big server to run, we have a cer­tain num­ber of servers on standby to han­dle a cer­tain amount of ex­pected load.
If sud­denly the num­ber of re­quests we re­ceived were to dou­ble (as it did for the Chrome ex­ten­sion), we would be big trou­ble.
To avoid in­creas­ing the la­tency on re­quests (or drop­ping re­quests all to­gether), we would need to scale up the num­ber of run­ning servers.
This not only takes hir­ing an ex­pert in cloud ar­chi­tec­ture, but also ad­di­tional fund­ing to pay the AWS (or what­ever) bill at the end of the month.
Because Harper runs at the edge (no server re­quired), we don’t have to worry about that.
In fact, I only no­ticed that our user count had spiked af­ter I vis­ited Hacker News the morn­ing af­ter.
No hic­cups at all.
Lots of cloud providers like to brag about be­ing able to scale with their users. I like to brag about not hav­ing to scale at all.

The title of this post is somewhat misleading. Local-first software rarely needs to be scaled at all.

The ti­tle of this post is some­what mis­lead­ing. Local-ﬁrst soft­ware rarely needs to be scaled at all.

Local-First Software Is Easier to Scale

Back in my day, we used math for autocomplete.

Back in my day, we used math for au­to­com­plete.

Markov Chains Are the Original Language Models

<h1>Harper’s Architecture — Presenting to ACM @ Mines</h1>
Earlier this week, I was asked to give a talk to the chap­ter of the Association of Computing Machinery at Mines.
It was an in­ter­est­ing ex­pe­ri­ence, es­pe­cially since it ended up be­ing so con­ver­sa­tional.
In my talk, I go deep into <a href="https://writewithharper.com">Harper’s</a> fun­da­men­tal ar­chi­tec­ture.
I fo­cused on the spe­ciﬁc as­pects that make it pos­si­ble to do our gram­mar check­ing of­ﬂine on ex­tremely low power de­vices.
I imag­ine it would be quite use­ful for po­ten­tial new con­trib­u­tors to the pro­ject, so I’ll make sure to link to it from the Harper doc­u­men­ta­tion.
<video controls src="/videos/harper_arch.mp4">
This is def­i­nitely not the best talk I’ve ever given, and in the video we go on a num­ber of tan­gents that might bore some view­ers.
You’ve been warned.</video>

Earlier this week, I was asked to give a talk to the chapter of the Association of Computing Machinery at Mines.

Earlier this week, I was asked to give a talk to the chap­ter of the Association of Computing Machinery at Mines.

Elijah Potter

Harper’s Architecture — Presenting to ACM @ Mines

Comments

Other Stuff

Hacker News sans AI

Local-First Software Is Easier to Scale

Markov Chains Are the Original Language Models