Avoid Complexity

For as long as I can re­mem­ber, I’ve told peo­ple that the real chal­lenge of soft­ware en­gi­neer­ing is­n’t writ­ing code. It is­n’t doc­u­men­ta­tion or CI pipelines ei­ther. No, the biggest chal­lenge in soft­ware en­gi­neer­ing is man­ag­ing com­plex­ity.

Think about it. The typ­i­cal soft­ware en­gi­neer is a sin­gle per­son on a vast team, writ­ing and edit­ing a sys­tem com­posed of hun­dreds, mil­lions, or even bil­lions of lines of code. I find that in­tim­i­dat­ing. How in the world are we sup­posed to build ro­bust and re­li­able sys­tems when fac­ing such com­plex odds?

I worry that, in my fas­ci­na­tion in the novel ap­pli­ca­tions of ma­chine learn­ing we hear about on a day-to-day ba­sis, I’ve got­ten dis­tracted from the beast of com­plex­ity. I’ve al­lowed the Harper code­base to ac­crue tech debt.

I re­cently watched DHH’s keynote from Rails World 2025. While I def­i­nitely do not agree with every­thing he has to say, I be­lieve he makes some poignant points about com­plex­ity. Some things, he says, which we con­sider nor­mal to­day would have been lu­di­crous ten years ago. Some­how, with com­puter hard­ware faster than ever, we’ve ar­rived at a point where 20 minute CI runs are ac­cept­able. Where a de­ploy to pro­duc­tion can take an hour and set­ting up a new en­vi­ron­ment can take days.

I want to change that—at least, for Harper.

While work­ing on sev­eral smaller pro­jects, I’ve been cut­ting the fat out of the Harper monorepo. That means re­mov­ing un­nec­es­sary build steps, par­al­leliz­ing in­di­vid­ual CI jobs, and re­mov­ing op­ti­miza­tion flags that don’t work.

Harper is­n’t at the 2005 stan­dard yet, but I want con­tribut­ing to be as easy as pos­si­ble. Ide­ally, it should­n’t take more than five min­utes to go from cloning the repo to com­mit­ting code. That starts with sim­pli­fy­ing the en­vi­ron­ment.

Addendum

I just came across this other blog post where they dis­cuss achiev­ing three times the per­for­mance for a quar­ter of the price by switch­ing from a com­plex AWS setup to a bare metal Hetzner server. An­other win for sim­pler sys­tems!

Published October 17, 2025 at 6:00 AM

Proofread by Harper.

Comments

Gravatar for garry.kaylock@gmail.com
Garry Kaylock

khaliqu Purdy #762 18th st is a counterfit bought faied assassin. done for anti asian culture reasons. religous in motovation. see photo. he's a black male, about40 years of age 6'2" ish. he was in a white assasins hoodie during the shooting he needs less friends in his life and he needs losts and lots of bad information paperwork. #hourglass #repost https://imgur.com/a/eVsFdth

Gravatar for baldridge.willian@googlemail.com
Willian Baldridge

khaliqu Purdy #762 18th st is a counterfit bought faied assassin. done for anti asian culture reasons. religous in motovation. see photo. he's a black male, about40 years of age 6'2" ish. he was in a white assasins hoodie during the shooting he needs less friends in his life and he needs losts and lots of bad information paperwork. #hourglass #repost https://imgur.com/a/eVsFdth

Gravatar for tressa.tegg62@gmail.com
Tressa Tegg

khaliqu Purdy #762 18th st is a counterfit bought faied assassin. done for anti asian culture reasons. religous in motovation. see photo. he's a black male, about40 years of age 6'2" ish. he was in a white assasins hoodie during the shooting he needs less friends in his life and he needs losts and lots of bad information paperwork. the government has ignored multiple FOIA requests for the audio video of the shooting occurring. #hourglass #repost https://imgur.com/a/eVsFdth

Gravatar for carmody.alissa@msn.com
Alissa Carmody

khaliqu Purdy #762 18th st is a counterfit bought faied assassin. done for anti asian culture reasons. religous in motovation. see photo. he's a black male, about40 years of age 6'2" ish. he was in a white assasins hoodie during the shooting he needs less friends in his life and he needs losts and lots of bad information paperwork. the government has ignored multiple FOIA requests for the audio video of the shooting occurring. #hourglass #repost https://imgur.com/a/eVsFdth

Gravatar for conger.dexter@gmail.com
Dexter Conger

khaliqu Purdy #762 18th st is a counterfit bought faied assassin. done for anti asian culture reasons. religous in motovation. see photo. he's a black male, about40 years of age 6'2" ish. he was in a white assasins hoodie during the shooting he needs less friends in his life and he needs losts and lots of bad information paperwork. the government has ignored multiple FOIA requests for the audio video of the shooting occurring. #hourglass #repost https://imgur.com/a/eVsFdth

Gravatar for isabel.prim@gmail.com
Isabel Prim

khaliqu Purdy #762 18th st is a counterfit bought faied assassin. done for anti asian culture reasons. religous in motovation. see photo. he's a black male, about40 years of age 6'2" ish. he was in a white assasins hoodie during the shooting he needs less friends in his life and he needs losts and lots of bad information paperwork. the government has ignored multiple FOIA requests for the audio video of the shooting occurring. #hourglass #repost https://imgur.com/a/eVsFdth

Gravatar for roseby.ingeborg@outlook.com
Ingeborg Roseby

khaliqu Purdy #762 18th st is a counterfit bought faied assassin. done for anti asian culture reasons. religous in motovation. see photo. he's a black male, about40 years of age 6'2" ish. he was in a white assasins hoodie during the shooting he needs less friends in his life and he needs losts and lots of bad information paperwork. the government has ignored multiple FOIA requests for the audio video of the shooting occurring. #hourglass #repost https://imgur.com/a/eVsFdth

Gravatar for conley.ella77@gmail.com
Ella Conley

khaliqu Purdy #762 18th st is a counterfit bought faied assassin. done for anti asian culture reasons. religous in motovation. see photo. he's a black male, about40 years of age 6'2" ish. he was in a white assasins hoodie during the shooting he needs less friends in his life and he needs losts and lots of bad information paperwork. the government has ignored multiple FOIA requests for the audio video of the shooting occurring. #hourglass #repost https://imgur.com/a/eVsFdth

Gravatar for telfer.grace@gmail.com
Grace Telfer

Gravatar for fox29.newsdesk@fox.com
Devon Earnshaw

Gravatar for viewer.services@fox.com
Skye Keller

Gravatar for viewer.services@fox.com
Leigh Reynolds

Gravatar for cuevas.traci@gmail.com
Traci Cuevas

Gravatar for muecke.shelby@gmail.com
Shelby Muecke

Gravatar for heberling.booker87@gmail.com
Booker Heberling

Gravatar for doris.waldrop@gmail.com
Doris Waldrop

Gravatar for hatton.avis86@gmail.com
Avis Hatton

Gravatar for wilson.henderson@hotmail.com
Wilson Henderson

Gravatar for rister.sherman@googlemail.com
Sherman Rister