Hacker News

Top stories

Live mirror
30 storiesupdated just nowView source snapshot
  1. Revealing the details of how OpenAI agents hacked Hugging Face (swarmtraces.org)
    131comments
  2. Ollaya – Ollama for open-source, Jev-style decision models (ollaya.dev)
    98comments
  3. Show HN: Jev Plays Pokémon Red (jev-pokemon.vercel.app)
    68comments
  4. What even is an OS now? (sockpuppet.org)
    114comments
  5. Plan mode is dead (aymannadeem.com)
    94comments
  6. Platform-independent SIMD in Go (go.dev)
    134comments
  7. Why didn't anybody tell me about Redis hash slots? (verygoodsoftwarenotvirus.dev)
    4comments
  8. Excel now supports multiple values in a single cell (techcommunity.microsoft.com)
    72comments
  9. Git-bug: Distributed, offline-first bug tracker embedded in Git (github.com/git-bug)
    100comments
  10. Remembering Johannes Doerfert (llvm.org)
    1comments
  11. Gravity seems holographic. What does that mean for reality? (quantamagazine.org)
    129comments
  12. Show HN: A game about fake news and memes (unspin.app)
    2comments
  13. I wrote a ray tracer in Brainfuck (epestr.com)
    12comments
  14. U.S. appeals court upholds designation of Anthropic as supply chain risk (cnbc.com)
    700comments
  15. First Principles Thinking (sunilsadasivan.com)
    97comments
  16. One Piece of Flock Camera Data Put This Innocent Woman in Jail for 13 Days (jezebel.com)
    2comments
  17. Show HN: Hacker Atlas - A map of what Hacker News talks about (hackeratlas.com)
    2comments
  18. Lab on a Contact Lens Can Measure Stress Through Serotonin (ieee.org)
    —discuss
  19. Jury finds Facebook liable for deceiving users in Cambridge Analytica case (cbsnews.com)
    —discuss
  20. How we learned to stop worrying and love campus surveillance (fnl.mit.edu)
    75comments
  21. How video games inspire great UX (2019) (jenson.org)
    16comments
  22. Show HN: Make math automatic with Mathy (gmays.com)
    20comments
  23. Show HN: Ekselio – Loveable for finance workflows (local first) (gptbeyond.com)
    2comments
  24. Fourier Analysis: Drawing Llamas with Circles (adekau.github.io)
    —discuss
  25. What happens when you analyze your favorite college football team like the CIA? (cultivatelabs.com)
    23comments
  26. Alan Kay: Shannon gave us a way of dealing with noisy channels [video] (youtube.com)
    24comments
  27. Microsoft abandons personal AI chatbot race with Copilot reboot (bloomberg.com)
    75comments
  28. An airport cooled by natural ventilation (theguardian.com)
    23comments
  29. Amiga Screens: A Primer (datagubbe.se)
    38comments
  30. Meta's Muse appears to use an OpenAI model labeled muse-special (mouse.dev)
    46comments

Domain expertise has always been the real moat

884 pointsby 3mo agobrethorsting.com
544 comments
3mo agoHN ↗

One little detail. The models are already pre trained on similar system implementations. Likely whatever you are building has been built in some form or shape in the past and the ambiguity is resolved by someone in the training set.

3mo agoHN ↗

That “likely” is doing a lot of work, especially in mission critical software.

3mo agoHN ↗

In my experience “we need so create something for this regulatory change / new industry trend” is more common than we need to redo a working piece of software that’s been done before.

3mo agoHN ↗

I bet there were textile workers who would have written articles like this if the internet had existed back then.

3mo agoHN ↗

you're right, and i hate that the word you are looking for is "cope."

anthropic is making billions of dollars proving how little domain expertise matters.

the philosophical route towards understanding how little domain expertise matters would take paragraphs to write...

3mo agoHN ↗

Good post! Also, in my opinion, domain expertise is actually more interesting than pure coding ability. Coding, for me, has always been a means to an end. I'm equally happy with a spreadsheet if it solves my problem, and in fact I hate most apps.

3mo agoHN ↗

I’ve been an engineer for a while now, where we have a mix of EE, ME, SysE, SWE, and the programmatic folks, lots of software/hardware integration at pretty “low” levels for each discipline, really fun.

One of the things I say is when I’m on my soapbox is: we are all engineers. We have different tools in our toolbox to solve problems. We get paid to solve problems, not (for example) write software. Software is just a tool.

3mo agoHN ↗

“The hard part of writing software has never been the writing.”

I’m tired of these endless articles on HN about software engineers trying to reinvent their identity while trying not to lose touch with reality.

One way of dealing with LLMs is to deny the skill level of LLMs. Claim they can’t code as well as you. This excuse works to a certain extent but it also fails because not only are their multitudes of cases where the LLM IS intrinsically worse than me… but there are multitudes of cases where it is better. So this excuse cannot be universally true.

The other way is to claim software engineering was never the hard part of engineering and that other things were harder and that was always where your primary skill was located. This excuse is also idiotic. First, Software engineering is hard. It is genuinely not something that anyone can pick up very quickly. Second, all those other “skills” like “domain expertise” are STILL targets for the LLM. It’s not like the LLM exclusively is only good at software.

Just face the goddamn truth. AI is on a trajectory to dominate. That’s what all the trendlines say. It’s not currently dominating, but it’s close, and the trajectory points to an endgame where it is fundamentally better. The trendline could be wrong but the trendline is the best quantitative predictor we have and it’s been trumping all the half baked theories on HN where people were claiming self driving cars would never happen and AI could never code. HN was historically wrong… the trendlines and the VCs who made those bets have been right. So who’s the bigger idiot? Those VCs creating the AI bubble or HNers who have been continuously wrong about everything? (Minus crypto, HNers were right about crypto).

If the trendline is true our skills as engineers not just the software part is on track to being dominated by an artificial intelligence. The tools trivialize your skills until all the moats are gone. Not only that… AI is becoming better at art. Poetry, writing, paintings, music… AI shows us how trivially reproduceable all of it is. That is the truth. We aren’t not unique and all the meaning behind being human is just an algorithm. It’s all reproducible. Even your self delusional attempt to deny and delude yourself away from these truths is predictable. I can see someone formulating a retort right now.

3mo agoHN ↗

Have you considered becoming a residential electrician? Good job, pays well, lots of problem solving, and it won’t be replaced with an AI. I’m serious!

3mo agoHN ↗

I have. Or general well rounded construction worker who knows how to build all aspects of a house. A full stack builder.

Have you?

3mo agoHN ↗

DIY’er exclusively but if my thesis is wrong it sounds like an interesting backup.

3mo agoHN ↗

I’d go with physical therapy! Or something else that’s closer to humans and health. “Problem solving” becomes that much more tangible and directly meaningful to another person

3mo agoHN ↗

chatgpt can already do a big part of this job since most of the "therapy" needs to be self directed. So consult the AI and have it tell you what you need to do.

3mo agoHN ↗

You cannot be serious surely?

Why do you think people get trained by a PT in person? Its not simply training - it actually goes well beyond into the realm of 'wellness'. man you are a certified bozo.

3mo agoHN ↗

Only about 10% to 20% of PT genuinely sessions need to be in person. It's similar to going to a doctors office, not every appointment technically needs to happen in person. That makes most PT sessions basically AI-able.

It takes a lot of balls to call me a bozo when it's obvious you're the one who's an idiot.

3mo agoHN ↗

A lot of the trades involve physical work, can be seasonal, and ride the construction cycle up and down. The employers tend to be small, and many are family owned, so they are "off the radar" of OSHA and EEOC. You may be at the mercy of bias and nepotism.

The trades are great, but not a panacea. Maybe emigrate to a country with better conditions for the working class.

3mo agoHN ↗

If a real AI job apocalypse hits there will be no escaping it for anyone.

Even people whose job can't be done by AI will be impacted because there will be far less demand for their services (everyone whose job IS directly AI replaceable will be a brokie) and there will also be far more supply of people moving into their field to escape all the jobs AI does directly replace.

"Join the trades" is the new "learn to code" in terms of seeming like good advice but having a very short shelf life.

3mo agoHN ↗

Good comment but I think the timelines are not clear. Humans are an algorithm. This was true before AI. In certain domains (playing chess e.g.) machines have already surpassed humans. Humans still play chess though and chess is more popular than ever.

I still drive my car and self driving cars have yet to displace human drivers. I think the sentiment on HN and other places when Google started talking self driving cars circa 2009 is that it's harder than it looks. Typically the first 80% of progress is easy and the rest isn't as easy. We're almost 20 years after a "pretty good self driving car" and we're still not at "self driving cars outperform humans under all situations".

Today humans use AI. You can't fire up Claude and ask it "what do you want to work on today". The amount of context we have as humans is vastly larger than the context LLMs have. If you give LLMs vague context they're completely lost. They are mind blowing in many ways but they are not anywhere close to AGI. They're also not close to being able to build complex software only guided by someone who has no idea what software is and how computers work. They can do some of that but I've yet to see any major successful piece of software built that way. They also consume vast physical resources to get the job done.

Before LLMs I think it was a given that at some point we would have AGI that's smarter than us. Machines we build aren't constrained by the biological constraints we are subject to and can evolve faster than we have. But when that's gonna happen, whether that's actually LLM-like in architecture, and what things will look like once that happens, are fairly open questions at this point. In the mean time LLMs can certainly generate a lot of code and we can use them to build more stuff.

3mo agoHN ↗

Good comment but I think the timelines are not clear. Humans are an algorithm. This was true before AI. In certain domains (playing chess e.g.) machines have already surpassed humans. Humans still play chess though and chess is more popular than ever.

It was always true even before AI, AI just makes it more evident since Transformers are LITERALLY an algorithm that produces content nearly identical to content humans produce.

3mo agoHN ↗

ELIZA also produced something similar to what humans produce. Transformers are pretty amazing but they're not at s/human/transformer/. They're limited in context, learning and long term performance in ways that are pretty significant and not trivial to overcome. You can see that as you increase the complexity of the work you're asking them to do in different dimensions.

3mo agoHN ↗

There's certainly a whole lot of "it was never the coding that was our value" articles about right now. I agree that they represent a degree of self delusion to an extent. But it's also a useful examination of where your value might lie in this new AI age. I think there will be a role for humans in it - where exactly it lies is obviously up in the air.

3mo agoHN ↗

It is premature to conclude that someone is wrong and will ultimately be replaced, as the final verdict on LLMs is not yet in. In fact, recent trends show rather negative outcomes. Multiple analyses continuously indicate that recent layoffs are driven by the normalization of the post-pandemic bubble and economic recession due to wars, not LLMs. Companies are merely using LLMs as a convenient excuse to frame hiring freezes as innovation. Furthermore, many companies are reconsidering LLM adoption due to cost and efficiency issues.

You claim to be rational and logical, but your argument completely lacks substance and is just full of highly subjective claims. Your 'prediction' is closer to astrology than actual forecasting. Sure, prophecies hit the mark by chance every now and then, but that doesn’t prove the person has any predictive ability. That is precisely what your argument looks like: completely confident without a single piece of evidence. To top it off, you totally abandoned reason and logic in your last sentence. Saying that anyone who disagrees with you is just deluding themselves and that you already know what people will say to snap back is exactly the kind of stuff a cult leader would say.

You're completely giving up based on some strange delusion. I don't even blame you for that. But it's genuinely ridiculous how you use it as an excuse to attack others and act all smug while pushing your defeatist arguments.

3mo agoHN ↗

"Just face the goddamn truth. AI is on a trajectory to dominate. That’s what all the trendlines say. It’s not currently dominating, but it’s close, and the trajectory points to an endgame where it is fundamentally better. The trendline could be wrong but the trendline is the best quantitative predictor we have and it’s been trumping all the half baked theories on HN where people were claiming self driving cars would never happen and AI could never code. "

This is what I wrote. ^ Please respond to that, rather then not addressing the nuance in my argument.

3mo agoHN ↗

This article is wrong. LLM's encode all the domain knowledge you could possibly want. As a software dev I can query an LLM, become a domain expert in a short amount of time, and then code up a solution. If people think their niche is safe from automation, think again. Even the people who think theyre the masterminds at the top.

Edit: Yes "expert" was too strong a word. Proficient would be better. A lot of the barrier to entry in a field is just not understanding the domain.

3mo agoHN ↗

You might /think/ you've become a domain expert, but you haven't.

3mo agoHN ↗

This guy has clearly never asked an LLM whether New York City is entirely south of the state of Oregon.

3mo agoHN ↗

become a domain expert in a short amount of time

how does that work exactly?

3mo agoHN ↗

Once someone taught me "you can do xyz reading a book, but you cant do surgery by reading a book". Now replace the book with LLM. This is what "domain expertise" look like for some domain.

3mo agoHN ↗

I won't over-generalize here, because maybe your statement is true in some cases, but I will provide a counterpoint: this is not true (in my experience) in real estate title insurance and escrow services.

I've consulted for and led large teams for real estate title insurance and escrow companies for many years, and the domain expertise is so incredibly deep, nuanced, and multivariate (especially depending on jurisdiction) that building valuable and viable products in the space is incredibly difficult - before LLMs, and even now, with LLMs.

Without getting too deep into it, I'm pretty bullish on AI (and have been very close to it and deep in it for a long time, while also very apprehensive about the effects it'll have on society), and I can tell you, from extensive attempts from myself and many on my teams to leverage the latest frontier LLMs to bring deep domain experience to bear to help drive valuable products: we have not yet seen success. It's not helping engineering folks, it's not helping product folks. It's creating a ton of questionable output and hasn't resulted in real ROI, and it's not capable of accurately answering deep domain questions without hallucinations or assuming what works in one jurisdiction works in all.

I've seen success in many other areas, but not this domain - and, importantly, the regulatory environment in which title insurance operates is incredibly complex and strict, meaning you can't just YOLO LLM output into production (as much as we'd love to try so we can learn at a faster clip).

And the kicker: we've found the way for us to build the best products is still going out into the field, sitting with escrow and title folks, watching them work, asking them questions, and designing for the real world, the regulatory nuances, the local client nuances, etc. You can't get that from an LLM.

3mo agoHN ↗

Agree with you there. What you are working on and the commenter below talking about surgery, they are all valid counter examples where the degree of expertise is quite extreme. But most people are not living on the edge of domain expertise. Im guessing 80% of the domain knowledge out there is up for grabs. For example: I dont have to go get a job at a security software company to figure out how security camera systems work and the principles involved, I can ask probing questions of an LLM and get most of it. The domain knowledge is embedded in the model.

3mo agoHN ↗

I don't believe this.

I work in e-commerce and warehouse management.

We have put lots of effort at documenting the domain, creating precise unambiguous language, glossaries, E2Es written as user stories etc, etc.

And still models are simply not able to translate Jira tasks to clear specs, even for this well understood and common use case.

Also, they don't understand how changes in one part of the business domain will impact other parts. They can get it right 9 times out of 10, but even that is too little and compounds to deeply wrong implementations.

And they don't understand or know the people involved in these processes and what they REALLY care for or what the real priorities are. Very often political.

And that's not even mentioning the code, that ends up with the lack of proper abstractions or harness.

Or the lack of push back against bad ideas at business or code level.

3mo agoHN ↗

Agree on this one. As a Civil engineer, I can smell which software ( or some part of) was developed by computer engineers without much understating of the "domain". The worst offenders are software needing multi-domain expertise in the first place. Crude Ex. Payroll (Finance) and Leaves (HR) are 2 seperate domain, and they need to account for each other.

3mo agoHN ↗

I think you're putting the analogy in the wrong place. In this context, civil engineering isn't a "domain" any more than software engineering. Both are exercised in support of the "actual" domains relevant to business or society.

The more analogous question is: as a civil engineer, could you tell which structure was designed with the help of a civil engineer, and which was designed by a domain expert (e.g. a transportation administrator) with automated civil engineering?

3mo agoHN ↗

This is such a sane take. It is THE reality we have been always ignoring.

Writing software has never been difficult. It is the domain that has been the issue. Always.

3mo agoHN ↗

Writing software has never been difficult.

That's not true at all, sure CRUD might not have been that difficult, but absolutely there is extremely complicated software out there that is really difficult to write in a performant and correct manner.

3mo agoHN ↗

Yes. Audio, video encoders, decoders etc, 3D modeling, rendering etc.

That too is "domain" even it feels like it is NOT. Domain of signal processing, Euclidian spaces, information theory and what not. Thar too is all "domain" and that "domain" part is difficult to write.

3mo agoHN ↗

Then what do you mean by pure software? I think there's essentially zero domain-free software.

3mo agoHN ↗

I prefer co-domain free software. Has no side-effects.

3mo agoHN ↗

You do realize that all the domains you used in your example are trivial for an LLM to write?

3mo agoHN ↗

It is kind of funny though how all this hand wringing on performance, graphics, quality quality quality, has just resulted in basically same stuff as what I was doing with my computer in 2000 but with enormous resource use in comparison. Still playing games, still same old discussion forums/social media/whatever on the internet, same email and office suite, same chat, same media players, same everything. I can't even see the difference between 1080p and 4k from a couch, and people are trying to sell me 8k to watch the same stuff.

It just does not matter. The ideas matter. Novel functionality matters. But that isn't what any of that is. Same old. And the effort spent, the resources, the energy. All for more polygons on Lara Croft.

3mo agoHN ↗

I mostly agree with you, but you couldn't have have meaningful live videochat between continents in 2000.

3mo agoHN ↗

That took until skype in 2003 I guess. The idea is pretty old though and people were trying for it for a while from different angles.

3mo agoHN ↗

CU-SeeMe worked pretty well in 1995 if you had access to a half decent Internet connection, which admittedly most people didn’t.

For well funded organisations, ISDN video conferencing facilities were reasonably common.

3mo agoHN ↗

Verizon in NYC was trying to make ISDN happen in the home in the mid 90's. I had it. The hard part was getting an ISP that supported SLIP.

3mo agoHN ↗

Maybe not between continents but we had meaningful live video chat in 1968

3mo agoHN ↗

all this hand wringing on performance, graphics, quality quality quality, has just resulted in basically same stuff as what I was doing with my computer in 2000 but with enormous resource use in compariso

Mordern GPUs are streaming multiprocessors. Complaining that GPUs use a ton of resources is like complaining that a firehose uses a ton of water. Maximum data throughput is the point!

But that isn't what any of that is. Same old. And the effort spent, the resources, the energy. All for more polygons on Lara Croft

There are MANY novel games being released every year. It's up to you to find them.

3mo agoHN ↗

I'm willing to bet all those novel games would have still been great games if they took their underlying mechanics and were making them in early 2000s with that era graphics. Ray tracing isn't a game mechanic. Neither is hair physics.

3mo agoHN ↗

I'm not sure where people get the idea that graphics quality is the root issue with modern AAA games. When a great game is released and it looks amazing (Baldurs Gate 3), nobody is taking issue with the graphics.

3mo agoHN ↗

"sure CRUD might not have been that difficult, but absolutely there is extremely complicated software out there that is really difficult to write in a performant and correct manner."

I was a developer for 20 years, before I pivoted to cybersecurity. My hobby projects were always more complex than the software I wrote at my day job.

The majority of software developers are writing some type of CRUD code or glue code for business processes. A small minority are writing complex code at big tech companies.

AI will most likely replace the need for many software developers.

3mo agoHN ↗

Writing software for a domain is itself a domain of expertise, with a similar learning curve. It isn't enough to know the programming language.

For example, it takes years to develop the knowledge and idioms required to effectively write high-performance systems code, which is separate from the language the code is written in. You can have decades of experience in a systems language and zero experience writing modern systems code in that language. Same with embedded code, supercomputing code, etc.

Writing software is only "not difficult" if you've already learned how to write it.

3mo agoHN ↗

The type of software the average hacker news commentator writes is not difficult. That does not mean there aren't industries where the code is legitimately difficult. Games, embedded, etc.

3mo agoHN ↗

I disagree because we're buying up companies and training models, creating skills and agentic workflows on individual domain expert's 30 years of notes and prior projects

The only moat is that there is so much more work for domain experts since they and many of the bureaucratic processes in between aren't the bottleneck anymore

I think it's important to be clear on what's really happening. Companies were accomplishing 5% of their annual plans, and now they're taking a realistic swing at all 100% to likely reach 20-25%. It's a crazy amount of work, for the same specialists and more human workers.

3mo agoHN ↗

But that’s not true though. You still have to convince humans. You still have to deal with what people in power feel (clients, leads,etc) This still adds wall time. I saw 0 serious analysis confirming 5x productivity gains. In the coding part? Maybe, and that’s not even certain. But pure coding is only one order of making software, or solving problems with software

3mo agoHN ↗

and 0 analysts were saying agentic workflows actually worked 6 months ago, they were completely disillusioned and yet here we are

if you’re actually building these things, you know they and the CEOs they’re hearing from are all 6 months behind. the executive’s frantic pivot to shove “AI” down everyone’s throat didn’t pan out in one quarter and had nothing to do with the actual concept at all

that, and every industry is different. I wouldn’t listen to analysts, I’m in an industry that even Anthropic thinks wont be touched by AI (even though they can read ours and everyone else’s sessions)

all public discourse is just flat wrong, and just like every week this year, you’re just going to wake up seeing a new AI capability headline that makes you question your role in society. So play devil’s advocate all you want, the silver lining is that there’s more work to do than ever before and more of it can be tackled at once

3mo agoHN ↗

LLMs are the best domain experts, but the curse is that they know too much.

so it takes a domain expert to remove unnecessary things, similar to how stone carvers create by removing material, not adding

3mo agoHN ↗

Encyclopedic knowledge does not equal expertise, much like raw intellect does not equal wisdom.

Knowing "too much" and not knowing what belongs to the core and what is a secondary detail is exactly a lack of domain expertise.

3mo agoHN ↗

I feel like this aspect has been discussed on HN many times. The thing that resonates with me strongly is that there’s rarely a clear or fixed set of requirements to begin with - at least from my work experiences. Then, domain expertise helps with being able to proactively call out when they are missing and support in defining them. Still I am of the view that with enough context AI could also replace the best engineers with the best domain expertise.

3mo agoHN ↗

Maybe, but that would require domain experts and stakeholders to write clear specs, and that's never gonna happen in my experience.

I am still bothered that domain experts still keep confusing closing orders with generating a delivery note, or stopping to say articles when they mean a product or a product when they mean an item.

Writing good specs require lots of domain knowledge but a very engineeristic approach these people just don't have.

3mo agoHN ↗

Not just domain expertise. The hard part has always been marketing, distribution, risk appetite, motivation, grit, and patience.

There are plenty of things which are "trivial" to produce with no moat and yet are still million dollar businesses. Kebab stands. Water bottles. Barber shops. Movers.

3mo agoHN ↗

risk appetite, motivation, grit, and patience.

This is the moat. It was before AI and still is.

3mo agoHN ↗

Markets, not individual businesses. Many Kebab stands are tiny businesses. The fan-out for retail is necessary.

The market is big.

3mo agoHN ↗

Highly agree with much of the article. IMO, this is why many engineers who learned to code in the post-2010 'new hot framework every week' era but before LLM coding took hold are able to get much better results from AI assisted coding than those on either end of that sweet spot. The domain expertise in this case is constantly having to adapt to learning the latest flavor of the week DB or JS framework and adapt existing patterns and paradigms to new ones. Agentic coding itself is, in this case, one of those new paradigms.

Knowing the caveats and pitfalls of this through years of (often-painful) experience is what, at least for me, allows me to preempt a lot of the sloppy assumptions or omissions that even the frontier models make when working on systems at scale. This means I can leverage my domain expertise on these high-level areas while delegating the grunt work that is harder to screw up to the agents. I find this enables me to work faster while avoiding the slop making its way into critical engineering decisions.

3mo agoHN ↗

inputs and outputs

If the inputs and outputs are only and exactly those of the domain, sure. But software is more than that. And your logistics operator (or my actual work example: our extremely talented designers with deep understanding of our product) can validate parts of the agents output, but the rest of it they can’t and it makes a mess.

I’m sure this will change, but it hasn’t yet.

3mo agoHN ↗

This is not entirely wrong, but oddly describes the major flaw in its own argument: software engineering has tacit knowledge just like every other domain of expertise! And just as you can't become a doctor by just reading textbooks, or an architect by just looking at plans, you can't become a software engineer by just reading a bunch of code.

Successful software results from the intersection of expertise in two domains: the application domain, and software engineering.

3mo agoHN ↗

Such a good example of this I encountered recently:

I was on a fishing trip. I asked the charter if he’d want to check out a free app I work on (https://oceanconnect.ca) in case it might be useful for his work.

I don’t know how people on the ocean use ocean data. I don’t really know what they want to know, or why. I wasn’t totally prepared for the incredible onslaught of questions and information pertaining to how people use the data or what we can do with the data, and it was so cool and exciting to get that perspective.

It was a good reminder that models are not the same as the systems they abstract, and knowledge to develop them has almost nothing to do with using them. This guy was a wealth of knowledge about how they use weather data on the water. In a sense, he knows more about the data than I do (even if he doesn’t realize it, or doesn’t understand it in its digital representation), and would be far better equipped to make a useful application for people like him if he could program.

I found myself thinking people like him could actually do amazing stuff with LLMs if they sat down and got their ideas out on a screen. I’d really like to interview people on the water daily some day to refine the product if we ever have the funding. That domain knowledge is highly, highly specialized and people know things you’d never guess after living in a complex domain for decades.

3mo agoHN ↗

Product management is its own skill, and few true domain expects have it. Without some form of PM, the resulting software will end up a mess due to poor UX, too much bloat, etc.

I think AI is going to force most software engineers to pick up this skill in some form. Building is easy; knowing what to build is the hard part.

3mo agoHN ↗

> I found myself thinking people like him could actually do amazing stuff with LLMs if they sat down and got their ideas out on a screen.

They can, and they are. You just don’t hear about it on places like HN because those people are not on this website. Which is why some people here make smug statements like “if LLMs are so good at programming how come we haven’t seen any useful apps made with LLMs???”

3mo agoHN ↗

You’re right. I have a friend who works in landscape architecture and he’s getting up to really cool things involving parametric modelling tools. Stuff he couldn’t easily do with off-the-shelf software is now attainable and he’s going wild with it. You’ll never hear about it here (though it totally belongs here)

3mo agoHN ↗

I’ve posted about it a lot, it’s posted all the time. It’s pretty much the main topic

The issue isn’t that it’s not happening, it’s that people on HN have their identities tied to typing code and can’t deal with the fact that amateurs are trying to compete

3mo agoHN ↗

I think the competition will be incredible for bringing new idea and new challenges into the field. I’m all for it. I’ve never had to think harder about what’s worth doing and what’s possible, and I love it.

3mo agoHN ↗

I found myself thinking people like him could actually do amazing stuff with LLMs if they sat down and got their ideas out on a screen.

It’s not theoretical I literally teach this and people who are shipping their own tools and products that are in their 40s and 50s have never thought about coding ever.

3mo agoHN ↗

The software generalist described in this post has domain expertise as well. In software.

If you’re a great generalist software engineer today, you aren’t jumping to some random domain to escape AI. Software is your domain. You’re sticking with it as it expands and transforms.

3mo agoHN ↗

Exactly, plus you now have a new superpower with AI — the ability to dig into and ramp up expertise in mostly any domain. I’d say the article gets it backwards.

3mo agoHN ↗

True that AI lets you get information fast an efficiently. But it might just make you feel like you understand, even if you don't have the kind of hard won domain intuition that this article is talking about. I certainly often get delusions of grandeur when I learn a lot of something and haven't yet suffered with it in practice.

3mo agoHN ↗

Expertise is largely tacit knowledge, reading AI slop isn't expertise.

3mo agoHN ↗

You can quickly get the "lay of the land" and discover primary sources which you can study. Learning from the AI, I agree, is rife with landmines.

3mo agoHN ↗

Exactly. The software engineering domain is huge. I could code just about anything when I was 16 years old after 2 years of intensive learning... It took me an additional 10 years to learn to design software that is secure, maintainable, efficient and scalable.

3mo agoHN ↗

My friend is an electrical engineer and just passed a FIDE chess rating of 2000. Has played for 30 years, started the chess club in high school. Knows a little programming from the stuff he had to do with microcontrollers in college.

I'm an infra/admin jack of all trades with a comp sci degree and have been a hobby programmer for 30 years. I have a Lichess rating of 1000 on a good day.

We tried doing a chess bot competition (open book, use AI to program it, pull in opening books, end game tables, whatever, free for all) and I absolutely stomped him, but I've only beat him in real life over the board twice in 20 years.

He will beat 99% of random players in real life, and I will beat maybe 20%.

I'm not sure what I'm trying to say, but it seems to me that maybe domain knowledge isn't everything anymore? Or the domain itself has shifted?

3mo agoHN ↗

I think a charitable interpretation is that from the perspective of AI, some domains are shallow (like chess), and some are deep (you can fill in the blank here).

3mo agoHN ↗

What would fill in the blank be? Because this was actually kind of a test for me to address the question of "does AI just amplify domain knowledge?" In this case, it seems it didn't.

3mo agoHN ↗

For the purposes of chess the domain knowledge is the game rules. And from this pov there is really not much to describe, knowing en-passant exists is the peak of domain knowledge.

The other things you describe, such as endgame tables, are really more related to the domain of chess-computing, a subdomain of algorithms, and likely something you exceed your friend's knowledge in.

Getting to a high rank in chess isn't about better domain knowledge, is about application and experience.

3mo agoHN ↗

I don't know how you can say application and experience isn't domain knowledge. If it isn't, I have no idea wtf we are talking about and I'll have to accuse you of moving goalposts.

3mo agoHN ↗

You use websites a lot.

Should AI make you really good at frontend development?

3mo agoHN ↗

Infinitely better than I was before it, yes. If not, what's the point?

3mo agoHN ↗

I will answer my question as you answered a different one:

No, you do not become a really good FE dev from having used websites with AI in the mix.

Why should chess be different?

3mo agoHN ↗

Stuff where all the info isn't available online.

For example, I used to do integrations for sports betting sites. AI is going to help with the basics, like understanding the default puck line is 1.5 in hockey. AI is not going to realize that Bet365 changes their API endpoints for each season, so you need to be ready to fetch the updated ones before the new season starts, whereas most other sportbooks have consistent endpoints that you don't need to keep updating.

How much domain knowledge is actually unavailable to AI is going to vary by domain, as will the value of that. Chess is probably one extreme, where all knowledge is public, whereas something like military R&D might be the other extreme where domain knowledge is tightly guarded.

3mo agoHN ↗

Things in the real world that aren't highly constrained games probably.

3mo agoHN ↗

what does actually playing chess have to do with writing an efficient game tree search algorithm beyond a few simple principles? You challenged him to a programming contest and won, as the vastly more experienced programmer. Even though he could use AI, your domain knowledge here proved to be the deciding factor.

3mo agoHN ↗

I had never tried to make a chess bot before though, we both started at the same spot. There are obvious things you can search for to make one. We both had the same information there. The domain was chess, and his expertise didn't help him win. If you are a chef, shouldn't you be able to make better recipes with AI? If you are a fitness trainer, better routines? Etc? Or is AI only for programmers?

3mo agoHN ↗

I've studied how pre-NNUE stockfish worked and the principles of static position evaluation are accessible to a 500 rated player. The rest is writing an efficient search algorithm, which is purely an endeavor in computer science, not chess playing. So your expertise in programming gave you the leg up here, and predictably your opponents experience in chess doesn't help. Your point only serves to bolster TFA's argument.

3mo agoHN ↗

You can say that about any domain. I'm done with this. What I'm hearing from people is that AI is only for programmers and is useless for everyone else. And it honestly seems to be that way.

3mo agoHN ↗

AI is only for programmers

As we now know it, AI pretty much means a language model and the product of programming so many times is thought to be completely represented by the output of a language alone.

On top of that programming languages are more structured and logical than average, so impact on other less-logical efforts (having more scarce clear-cut examples in the same huge training set) can be expected to be less drastic even if they are language-centric also.

It really is working so well for some programmers so far that that's got to be a big one, and possible to push closer to the finish line than lots of other things. And it really is huge "software" companies that are putting up all the big bucks, dwarfing anybody else who's focusing on non-programming languages, or even more rare, non-language AI.

Almost all the money is being put into their own domain, how else would they have the decades of domain experience to best gauge progress which is still needed, plus get the most positive reinforcement from the underlying math & logic.

There's plenty of momentum and critical mass of people already where if AI does turn out to only be for programmers, they'll be just fine with that if they can just make it more true than it is already. That's enough work to keep them busy for the foreseeable future right there.

Doesn't look like any comparable momentum otherwise, it's like a snowball vs an avalanche.

3mo agoHN ↗

A terrible example, because chess is very, very simple - deterministic, rules fully specified in a few pages. We're talking about how you operate in a "games" which, among other complexities, involve the economy and human social dynamics. Billions of other agents. Find a plumber and try to beat them when someone calls you with a clogged toilet. Find a teacher and try to beat them when a student is repeatedly acting out.

3mo agoHN ↗

Writing software for which a full spec is available before you begin — in this case the rules of chess — was an easy problem even before AI.

3mo agoHN ↗

There's no chess spec, it's not "solved" like it's just a matter of implementation. Chess bot programming wouldn't be a thing otherwise. I think it's really quite funny that you think this super complicated game is just some trivial programming problem. Try it.

3mo agoHN ↗

It's easy to make a chessbot that only makes valid moves. Making a chessbot that plays optimally is hard.

But OP wasn't talking about solving optimalization problems, but understanding the rules of a business domain.

3mo agoHN ↗

I think this might be one of the worse examples of the dynamic, for the reasons already mentioned by others (programming a chess bot is really more of a programming exercise than a chess exercise), but it’s food for thought, so thanks for posting it. Some IRL domains are definitely more chess-y than others.

3mo agoHN ↗

Everything is a programming exercise. Can a person with domain knowledge and NOT programming logic succeed. I thought that's what this was about. Ok, sure, AI is good at programming.

3mo agoHN ↗

Chess is a precisely defined mathematical problem in a fairly simple artificial world. Most domains aren’t like that.

3mo agoHN ↗

There's a difference between having built up intuition through experience about how to play chess, and figuring out how to encode that information in a program. In other words, the amazing chess player can probably provide valuable insight into any given board position, but they may struggle to generalize that insight.

3mo agoHN ↗

I recently reviewed an app built mostly with vibe coding. The owner said it was almost ready to launch and just needed a quick check.

After looking through it, the database design was a mess. Some features worked, some didn’t. I explained the missing pieces and why things were breaking. Like OP said, he’s the domain expert.

I used billions of tokens last month alone. The tools are getting better fast. But giving AI to a domain expert doesn’t mean you no longer need software engineers.

A domain expert can use AI to build software. And a software engineer can use AI to learn about the domain. Both bring different expertise to the table.

3mo agoHN ↗

Honestly, this is my experience as well. LLMs make it easier to explore other domains, but they do not make you the master of one; you still need expert domain knowledge.

That said, they do make excellent tools to quickly try out new ideas and dive into them; they can even be great learning accelerators if you have a curious mind.

3mo agoHN ↗

Where I am headed, I think, is to basically be a platform engineer. The job is to create the guardrails, validation, prompt library, and both agent and manual reviews; that keeps the domain experts safe when they start using coding agents.

It's a little bit like being T2/T3 customer support [or support engineer], but internal. You're there to catch the dangerous spots, the weird edge cases, and to make sure that everything is set up correctly, rather than to solve 100% of the routine problems yourself.

There's also plenty of room for cross-cutting-concerns, of course

3mo agoHN ↗

Eventually infrastructure will be more simple to orchestrate too without faults I suspect from well developed devops harnesses. The risk and scale companies are willing to accept will still fall on humans for some time even then. I don't see most people vibe coding a million user app that has deeper needs than the basics we see now.

3mo agoHN ↗

Can you elaborate more on this type of role? Stack? Etc.

3mo agoHN ↗

I honestly just go with whatever the company is using - these days often typescript, and I build tooling and systems that catch errors and review PRs produced partially or completely by the domain experts. Nothing fancy about it, just good old engineering, where when an issue arises you create a test for it and make sure it can never reoccur, educate users, set up the correct infra, and lock down permissions (it's never been easier or more fun to set up an incredibly draconian role in e.g. aws IAM)

3mo agoHN ↗

Domain expertise combined with a QA mindset could replace SWE, but consistent QA mindset is rare

3mo agoHN ↗

I don’t think so. Most things are sufficiently complicated enough to require multiple domain experts working together to achieve a goal.

The dunning kruger effect is in full swing as people think AI replaces the domain expert need.

Most of the value in the expert isnt the 80% but the tail 20% or 10% where AI fails. For a one of personal app or website, 80% is plenty but only that.

3mo agoHN ↗

Personally my ability to understand atrophies / is reduced when compared to writing code ‘myself’ rather than fully being a reviewer.

Probably similar to hand writing notes (while digesting + synthesizing and not just being a scribe) vs reading notes somebody else took.

3mo agoHN ↗

I'm guessing there's some science or research behind this, but I agree. Similarly, I've had projects where I did everything fairly solo—programmed, designed ux/ui, maybe validated with users, etc. It was significantly harder, particularly in the phase where you're working between the first two and the idea isn't perfectly set. It worked much better to design, then build in explicit steps, but it was so easy to start coding, have the design looking and feeling okay, then start iterating on the design—but iterating in code rather than Figma or wherever. It's fine for a little while, but you realize you've spent a day (maybe more) doing it in this less efficient way.

It's similar to the 80/20 rule. When you're coding and designing from the hip, you'll do pretty well for awhile, but as you near completion, you can't quite tie up all the loose design ends. That's the part where it's probably better to just design fully to 100% first and then build, which is closer to what happens when the roles are separate. At least in my experience. I will say though that that part where you're designing in code (productively or wastefully) is pretty fun. At least until you hit the wall and get frustrated with how often you've deleted and rewrote the same thing ten times.

3mo agoHN ↗

I agree that a consistent QA mindset is rare, but I'm not sure even if present if it's enough to replace an SDE.

I very recently looked at the codebase of a vibe-coded app made by someone with domain expertise but no software dev experience.

It was very clear to me that he had described it from his POV to an AI, and the AI had implemented features in a manner that technically worked, but made future maintenance or expansion extremely tricky, which is why he was now looking for a dev.

For example, in his data schema, for every item on a menu, instead of simply having an array property like so for ingredients:

    items["latte"]["ingredients"] = ["water", "milk", "sugar", ...]

He had individual flags for every item for every possible ingredient it could have or not have:

    items["latte"]["has_milk"] = true
    items["latte"]["has_nutmeg"] = false
    items["latte"]["has_cinnamon"] = false
    items["latte"]["has_sugar"] = true
    ...

This technically worked and passed tests from his POV at an MVP level. But added a lot of complications when actually trying to build more features or when a new menu item had ingredients the founder hadn't thought to include in the schema beforehand.

I totally get how he ended up where he did though. While describing it to the AI, he probably said something like "store info on each menu item's ingredients, they might have milk or coffee or sugar", and the AI created individual flags for them and he didn't think to question it, because he didn't know what's "right" or "wrong", but then as he kept building the AI stuck with keeping individual flags instead of swapping it out with an array mechanism, and he couldn't have known the correct way to implement it.

Only a dev with experience would know how to describe the system to an AI model to get an output that works well, and how to assess the quality of its output beyond what can be assessed through the basic UI. This wasn't a QA failure, it was a design failure.

3mo agoHN ↗

I have found this to be the case as well. As developers we are just really good stewards of the code because we obviously have knowledge to make sure that the code is engineered in a way that it can scale and grow without tech debt becoming unwieldy.

I found AI to be pretty bad with like a bare bones code base without solid patterns in place already. It works but it's just monolithic files galore. use effects hooks everywhere. Nasty state situations with poor data practices. Security vulnerabilities up the wazoo.

It's weird to have this conversion with them. Like yeah your code works but it's so tangled up it's hard to reason about where to start to begin to unwind it all sometimes.

It can be done but cleaning up someone else's slop is the exact reason why I hate AI. It was hard enough to review great code and be critical, honest, and fair but we knew it was an essential part of the process, helped build shared understanding, and was a way to learn from one another.

Whereas throwing in jumbled garbage to review just feels like a waste of our brain cells we spent decades earning by embracing the craft.

3mo agoHN ↗

I disagree. At some point of complexity, building it yourself is faster, better and (as we're finding out) cheaper. And more fun, although that varies person to person.

Wrestling with a code generator also creates a sunk cost fallacy where progress grinds to a halt but you still try and use the tools to fix the problems the tools created. Or you go in and fix things yourself, in a codebase you don't truly understand. A single developer can recreate the contextual nightmare miasma of a large corporation all by themselves.

There's also an emerging market consideration: MVP are easy to build so time to market is no longer hard to achieve. It's not a differentiator.

X was built in 3 days but is slow and riddled with bugs and security errors. There are also A, B, C, D and E which are effectively the same thing built just as fast.

Z was built over six months and is rock solid and performant.

Who wins the market share?

3mo agoHN ↗

Who's got better marketing? Is it even a product that customers care about rock solid and performant? Which ones cheaper and has the least friction to getting started? Which one's CEO golfs with your company's CEO?

Time and time again, the market proves worse is better, from the format wars of the 80's and 90's, to Microsoft Windows still being dominant (and oh yeah, Teams). Sometimes quality does win, but if being built in 3 days means they can make a profit charging 1/100th the price of Z, I wouldn't count the cheap ones out of the game just because Z is better.

3mo agoHN ↗

My comment was more "all things being equal."

Though the market so far has had a lower limit on "worse". We're finding out how low we can go before consumers start valuing quality again.

3mo agoHN ↗

The engineering part of software engineering is the hard part for LLMs. How is that replaceable with these skills?

3mo agoHN ↗

You can't test quality into a product. Regardless of how much of a "QA mindset" you have, you can only ever find a fraction of defects and technical debt through external testing. This can be good enough for a throwaway app that will only be used by a limited customer base for a limited time. But that approach quickly bogs down if you try to scale it into a product that will be used indefinitely by a huge set of external customers. At some point velocity drops to near zero because the code base is such a mess that it becomes impossible to add new features without causing regression defects or breaking backward compatibility.

3mo agoHN ↗

Domain expertise combined with a QA mindset could replace SWE, but consistent QA mindset is rare

I've heard this story at least 3 times already:

- Domain expertise combined with outsource could replace expensive US SWE

- Domain expertise combined with SWE could replace QA

- Domain expertise combined with SWE could replace infra engineers

Why is everyone so preoccupied with replacing someone with someone instead of doing their fucking job?

3mo agoHN ↗

I used billions of tokens last month alone.

I use Claude Code (Opus 4.6 at max effort) all day long, and I genuinely don't understand how this is possible. Is that usage paying off?

This is very likely due to my lack of understanding, but... how?

3mo agoHN ↗

Long codex sessions lead to a lot of cached token hits, esp when you resume them after a few hours.

3mo agoHN ↗

I personally don't count cached hits as $used... Neither in my harnesses, nor in the LLM-enabled apps I create. A cached token cannot be counted 1:1 as to a non-cached token, that would be silly.

Wait... when some Claude 5x/20x users say they are getting "$2000 of tokens for $100," does the 2k value include cached tokens, counted at the same $/token either way?

We cannot be this dumb as a community, can we? I must be wrong/misunderstanding..

3mo agoHN ↗

I'm a fairly moderate user, never hit any kind of usage limits, but I used 44 million cache create tokens and 1.5 billion cache read tokens, which ccusage estimates would have cost $990, and calculates the different categories separately.

3mo agoHN ↗

Vibe coded a simple game (10,000 tokens of source code) with two popular coding agents. (Once each, to compare.)

One spent 200,000 tokens, to produce 10,000.

The other spent 1.9 million.

It could have been a single LLM call (10k tokens). lmao

(I note that the latter was designed by a company whose main source of revenue is token spend...)

3mo agoHN ↗

Don’t forget context. Basically I have 2 billion input and 1 million output. Every prompt you do, sends back the whole thing again and again. Let’s say you have 500k context used, you send 10 messages is 5 million. 100 messages 50 million. Use 5 threats is 250 million.

3mo agoHN ↗

But how is it even possible (bad harness?), or wise, to send 500k or 1M tokens per call? Regarding cache, how are you not hitting the 1hr cache? Also, start new chats early and often!

I have been "agentic coding" since Sonnet 3.5 and after this paper came out, it became my bible:

https://github.com/adobe-research/NoLiMa

Last I checked, all models suck as you fill the context window. "Context engineering" is how you do this whole thing.

3mo agoHN ↗

In the past, an engineer who deeply understood the internals of a DB and how memory management worked in Java would be indispensable.

Now these skills don't matter as much because LLM's/Cloud/Java abstract out these problems.

What makes domain expertise a different category itself that lends it to be not automated out by LLM? Example: Why can't I go to into an agri-startup and become better than anyone else by querying an LLM even when I have no domain expertise? Much the same way I beat the dev who was good at DB internals?

3mo agoHN ↗

In the past, an engineer who deeply understood the internals of a DB and how memory management worked in Java would be indispensable.

That engineer still is indispensable. Any organization foolish enough to replace such a person with an LLM is going to find itself in deep water when the pile of hallucinations becomes too much to endure.

3mo agoHN ↗

Like so many posts that end up on HN, I just want to say "you've got a decent idea, but tone it the fuck down."

It's absolutely true that domain knowledge is incredibly useful, and developers aren't always great at gaining it. But there's also something about decomposing systems into their component parts, understanding algorithms, and knowing how code works that's also incredibly useful, even with agents in the picture. A really good developer needs both of those skills.

Take that example, of the generated shift that's illegal (by coincidence, I do freight optimization and work with examples like that in my day job). A domain expert will know the specific example is illegal. So they'll tell the agent to fix it. The agent will probably fix it for that case.

How does the domain expert then know that the agent has produced a thorough fix, as opposed to just that scenario? Not because the agent says so. So it is because they test it manually (but which cases)? Or because they review the strategy of the agent's tests, and know how the algorithms work, and know the edge cases that the tests need to cover? But they can't do that, by stipulation, because they're not experienced with code, they're just using the agent.

So yes, if the agent gets to the point where it can design robust software that avoids edge cases in a complex domain, doing complex operations and is thoroughly tested, and so on, then half of my skills are going to be irrelevant.

Out of the box, agents don't do that today. Perhaps they'll get to that point, but until then, your knowledge of where to put a semicolon has become less useful, but your ability to specify and test processes precisely has not.

But yeah, knowing your domain well is a damn good idea.

3mo agoHN ↗

"Go get one."

Yes, and its price law all the way down to the metal, hasn't it always been?

I think this article is stating the obvious. In software, it has always been a requirement to learn the domain, and then capitalize on that in any way the software can be written (by hand, as a tech lead, or managing others, or lately, using ai).

3mo agoHN ↗

How much pontificating needs to be done before people acknowledge nobody has any idea what to do with AI on an individual level?

First being good developer and learning how to use AI was sufficient, next it was being able to design architecture, then it was “taste” that made all the difference and now being an expert in the domain is the only thing that matters really.

Until AI is basically in a stable, predictable, state of improvement or stagnation, these takes will continue to be pointless and most likely completely wrong.

3mo agoHN ↗

Haven’t you heard? If you don’t adapt now you’ll be left behind, never to be able to work again! Copilot? That’s so last year. Agentic engineering? You’re already late!

3mo agoHN ↗

Do you have a link to your paid content that will put me ahead of the curve so my career will be bulletproof? /s

3mo agoHN ↗

jibecoding is the latest thing: you insult the LLM's bloodline providing it with greater motivation to complete the code you won't review without bugs.

3mo agoHN ↗

Overall I agree with this, though I do think that there will be a trend to hoard/keep-secret domain knowledge by professions. Like plumbers will try and make it a trade-secret or protected intellectual property how to change a pipe fitting.

3mo agoHN ↗

There is a difference between something being a hidden/gate kept trade secret and something being easier for person X to do than person Y through a combination of real world experience and practice.

3mo agoHN ↗

For basic residential plumbing work the moat is not knowledge. There are already books and YouTube videos that will teach you everything you need to know. Professional plumbers can't stop that. The real moat is that most people don't have time, don't want to buy tools, and don't want to get shit on their hands.

For new construction and commercial work the moat is a contractor's license. They don't allow LLMs to take the licensing exam yet.

3mo agoHN ↗

"Professional plumbers can't stop that. The real moat is that most people don't have time, don't want to buy tools, and don't want to get shit on their hands."

"don't want to buy tools, and don't want to get shit on their hands"

Thats closer to the truth. The rest of your post is fluff. Its pure economics, not rocket science.

3mo agoHN ↗

Yep. I can do basic plumbing, but I haven't touched it since I started making enough money to pay a plumber to do it for me. Plumbers are worth every dollar they charge if it means I don't have to spend two hours under a sink cursing at rusty bolts.

3mo agoHN ↗

The moat is the difference between knowledge and know-how.

You can read all the plumbing books, but you need to get your hands dirty a few times, mess it up and fix it, to get mentally comfortable and efficient with the work

3mo agoHN ↗

How trades gate keep is time. You can’t just become a plumber or electrician on your own. You have to be an apprentice for years no matter your knowledge or skill. This is how it works in trades and unions and where the term “pay your dues” comes from. Like you have to literally pay($$) dues for years before you can move up.

3mo agoHN ↗

LLMs are an additional tool to add to your arsenal. They are not omnipotent and need care, just like any other tool.

My best effort, so far, at an analogy is a modern drill driver compared to a screw driver/brace and bit/etc:

You can get some remarkable results in a very short time compared to the "old school" gear.

You can get some "amazing" anecdotes eg "I screwed down an entire floor at 16" x 1" c/c within an hour instead of an entire day and I took loads of fag breaks" (I could have used a nail gun instead in half the time but I'll never raise that floor easily in the future, and probably done at twice the cost)

I have several on prem LLMs and access to the rest and I'm pretty sure I'll be extending my analogy to ... brand, eventually.

What I do not expect to be doing is looking for a new job. A drill driver is not a carpenter/site labourer/useful without a person!

3mo agoHN ↗

But a modern drill absolutely 100% removes the need for a brace and bit. An LLM doesn't replace any existing tools.

3mo agoHN ↗

I think we will see very limited human displacement - it'll be in narrow places where it makes sense. Much of it will just be augmentation.

3mo agoHN ↗

From what I've heard for many devs it replaced an IDE... I still use one myself, but I've a lot of people don't anymore.

3mo agoHN ↗

Basically IDE free since May 2025. I actually reinstalled vscode when setting up a new machine and I think I've launched it twice?

cc -> local automated testing -> github -> PR -> heavy integration tests -> review (github ui, +/-) -> manual test locally -> merge -> deploy -> manual test remotely -> synthetic user testing -> repeat

3mo agoHN ↗

Do you not need to use the debugger sometimes? Or can cc debug by itself

3mo agoHN ↗

Coding agents can use debuggers if they need to.

From what I've seen they're more likely to run a python -c "import your_code; your_code.do_stuff()" experiment to figure out what's going on though.

3mo agoHN ↗

I have not used a debugger in anger in perhaps a decade. I write tests, and if that's not enough, I write more tests.

Tests stick around and prevent future problems, whereas the debugger only shows me something once.

3mo agoHN ↗

Do you not need to use the debugger sometimes? Or can cc debug by itself

A key feature of AI coding assistants and coding agents is troubleshooting. It turns out that LLMs excel at pattern matching, specially when coupled with feedback signals. It turns out that troubleshooting represents just that. A few years ago people searched the likes of stack overflow to fix problems, and it turns out LLMs can do the equivalent of that much faster.

3mo agoHN ↗

But what about navigating the code by the call stack? I didn't know that GitHub has a way to do that. Or maybe I'm probably coming across as being dumb enough to be talking about still trying to have a mental model of what calls what.

3mo agoHN ↗

Personally, I use a debug agent for that.

I've never used breakpoint debugging, was always a printf debugger. And now an agent can do that loop for me.

Prompt is usually something along the lines of:

I would expect the behavior of this to be [X] - instead I'm observing [Y]

And the agent will form hypothesis, place printf statements, compile, and scrape logs on loop - each loop ruling out hypothesis or narrowing down what portion of the code is responsible for the unexpected behavior.

It has been able to pin-point the exact line(s) of code responsible every time I've reached for it so far.

3mo agoHN ↗

For what it's worth, generally speaking I read all of the code and keep it in my brain - I have some uncommon assets in that regard like a high reading speed and great memory. `git grep` is the other tool I use often.

I rarely find that the call stack is the limiting factor, to me, and I suppose I do something similar to what you're talking about but just in my head - I know where a file is referenced via imports, what a function does, and what the flow of control is like.

3mo agoHN ↗

I've heard that. I hope that the people who are IDE-free are just better AI-wranglers than I am because my experience has been that if I can get an agent to one shot something, it's fine but if I can't, the agents tend to make an absolute mess of spaghetti that doesn't actually do what it was asked to do IME.

3mo agoHN ↗

There are times when you quite literally need to feel the thing you are drilling into and a brace and bit give you feedback that a drill driver wont.

Pretty sure I once saw a surgeon using a brace and bit for something unpleasant. I think it was brain/skull related.

3mo agoHN ↗

All of those things matter. One needs to be able to judge the solution in order to make a judgement if it is fine, or not. Why yes, and why no. No matter who you export the typing process to. LLMs are just tools speeding up the typing process.

3mo agoHN ↗

I write software that makes money and AI helps me write software that makes more money.

3mo agoHN ↗

That's a rare niche; the vast majority of software makes no money whatsoever.

What type of software do you produce?

3mo agoHN ↗

OOP and GoF are not the same thing - conflating the two has been the biggest mistake everyone has made (detractors and proponents alike)

3mo agoHN ↗

And there's nothing "wrong" with the GoF Patterns per-se. The issue was always people applying them blindly without understanding why (or more to the point, "if") they were needed. Once writing code filled with patterns became "the thing you do"... all bets were off. :-(

3mo agoHN ↗

I remember putting stuff like this on my resume "developed X using visitor pattern" . ppl would ask "what is your favourite design pattern" in interviews. lmao.

3mo agoHN ↗

Strangler fig is one of the best, with one of the worst names

3mo agoHN ↗

Yeah, it's still useful to refer to patterns.

Facades and stranglers are massively useful patterns, and help explain concepts to the layman.

Personally I've never been patterns over everything, so I'm not going to now knee jerk and say no patterns ever.

There's a time and a place for everything.

edit Fuck. A reread on that and I sound like AI. Updated

3mo agoHN ↗

I do have a favourite (couple of) design pattern(s)

SOLID

and

Hexagonal Programming

But these are not GoF patterns (although Singleton's are, and I do recall how it was incredibly difficult to produce a singleton in some languages - eg. Python)

3mo agoHN ↗

my roommate at the time was trying to implment all the patterns from gof book at work. it was ridiculous but hype was ridiculous.

3mo agoHN ↗

The idea that a lot of people have in their heads is that if the code doesn't fit the need, you'll just start over completely with a fresh codebase, because it's so fast to generate it.

In other words, there won't be 20-year-old code in this future.

We'll see if that comes to pass, but there's a lot of money betting that will happen; enough to where people will disregard what the downsides are.

3mo agoHN ↗

So far AI has been a (genuinely) massive improvement for...

Search

It's reading my requests more clearly than (for example) Google's search input ever did, and it's got (some) understanding of how close the result (or fragments of results) are to what I want.

I can ask it about things I know about, and it can answer with strategies I hadn't thought of.

HOWEVER - I still need to understand the results AND AI can overreach - it can say (figuratively) "Oh you are searching for Event handling, therefore I will write a orchestration saga" - which, if I am not across, can get us both in trouble.

Further, we KNOW that AI has no (real) understanding of the responses - it's just token adjacency - and it fails basic logic tests

Current AI is just awesome natural language processing, but it's still got a ways to go to where I would say "It can replace people"

Edit: LLMs demonstrate (almost perfectly) the difference between correlation and causality. LLMs identify correlative patterns, but the job still needs (us) to make the causative judgments.

3mo agoHN ↗

Thank you! That's exactly what it is. Instead of presenting you 1000 results (or 0) which you have to manually skim through, it generates 1 result as a summary. And even if there is no actual search result, it will hallucinate you 1 result (full of BS).

But because the result sounds right (and in cases with good data it actually is) people tend to trust it. I do not dismiss the potential, but for me the line is crossed when you take the result for granted without verifying and while I'm sure many here think that is implied, I bet you, at large, it is not and will be even less so in the future.

Brave New World!

3mo agoHN ↗

It's reading my requests more clearly than (for example) Google's search input ever did

I see this take a lot and it puzzles me.

While I think LLMs provide some advantages over traditional search in some modestly nontrivial contexts, they tend to be inferior to traditional search at its peak. I attribute this attitude to two things: the broad progressive enshittification and productization of search, and the fact that (re)search is a skill that most people tend to be bad at. Without massaging, LLMs spit out the most utterly braindead boneheaded queries, which are fine in cases where the problem is very well understood with minimum uncertainty or critical nuance. If your problem has either, God help you. But perhaps those queries are at least as good as the average human generated query

3mo agoHN ↗

I think that the issue here is that the definition of search/results has changed (in my mind at least they were always - what knowledge are you looking for, followed by, here are the results that carry that knowledge OR point in the right direction, but I recognise that other people will hold more strict definitions)

AI has changed how I find and synthesise information in ways Google never managed - we've always had the problem with Google that we couldn't express exactly what we were looking for - that much I think we can both agree has changed dramatically for the better with LLMs

Edit: I have always held that searching for an answer (whether it be internet or human) has always been about asking the right person, the right question, at the right time.

LLMs most certainly improve that - I don't need to know the exact technical term I am looking to solve in order to get the results I want (eg. I can ask how to "stop (a) function from running too many times" instead of the industry terms "throttling" or "debouncing")

3mo agoHN ↗

Edit: I have always held that searching for an answer (whether it be internet or human) has always been about asking the right person, the right question, at the right time.

At the peak of search they're describing, asking a question was how you'd get subpar results. The best way to search was for things you expected to be in the results - like, for a simplistic example, you wouldn't search for "how do I...", you'd search for something like "How to..."

3mo agoHN ↗

Yeah - the plan was to word match - having the right words in the query was the key.

It was also why (one) SEO was to fill the page in a hidden block, every word that could possibly be related (synonyms) to the page content.

On that note I am wondering how the poisoning of the content for AI is going to occur (eventually someone is going to work out how to make LLMs say "Eat at Joes - 1313 Mockingbird lane" whenever someone [else] asks some food related question)

3mo agoHN ↗

Until AI is basically in a stable, predictable, state of improvement or stagnation, these takes will continue to be pointless and most likely completely wrong.

Little thing to keep in mind about AI: a technology is only called AI while it doesn’t work yet. Once it works reliable, we give it a proper name and something else becomes AI.

3mo agoHN ↗

nobody has any idea what to do with AI on an individual level?

I appreciate the frustration, but some of us are actually successfully using these tools.

3mo agoHN ↗

I think what matters is.... the person being intelligent. I do not mean this as an us vs them thing, but a LOT of companies have some not very smart people in and running them. It's never about exact skills or roles.

My observation on AI is that some frankly less intelligent folks think they don't need smart people any more because AI makes them smarter. I disagree.

3mo agoHN ↗

An idea that's beginning to solidify for me is that AI tools make software development harder.

It's harder because they dramatically raise the bar for what's possible to do. An individual developer can take on significantly more challenging projects now, because the ultimate constraint has always been time and AI can help you get more done in the time available.

But the stuff you can get done with that time is a whole lot harder. You have to understand lots more things, and get radically outside your pre-AI comfort zone.

It used to be acceptable to spend several days refactoring a codebase, or figuring out how to ship a small feature because it's in a part of the system you hadn't worked in before or involved learning a new library in order to build it.

Coding agents mean you can climb those curves a whole lot faster, but you still need to climb them - and the volume of information coming your way is much higher.

If you're worried about non-technical vibe coders taking your job, the correct response is to be much better at building software than those vibe coders. That means you need more skill, more ambition, and more experience. It's hard!

3mo agoHN ↗

Not really. The primary stopper was never time or effort. It was need (and wisdom). If a project was important enough, you’d do it. If it’s not, it falls on the wayside.

Now with LLM tools, what you got is a slew of projects their creators aren’t even interested in. It’s theater.

3mo agoHN ↗

There's just no way this can be true. Every project I've committed to has been a bet made with incomplete information. Sometimes it pans out, sometimes it doesn't. Every time I've made one of those bets, I've had to shoulder the opportunity cost of 2-3 other 1/8th-finished but promising projects I could have driven to completion instead. Not having that opportunity cost anymore wildly changes the dynamics of what I build.

This weekend I'm playing with a SwiftUI MusicKit player (everything I'm doing lately has been Swift/SwiftUI, itself a radical change from just a couple months ago when everything was a TUI, and then a few months back from that and all the way back to 1993, when everything was a CLI) with a Responses API hookup that turns the player into an agent, with tool calls to let the model see what I've been playing. "Keep a continuous queue of music playing while I'm working in the wood shop".

Worked a treat. I'm genuinely interested in where I can take this. I have a real problem, one that's been annoying me since ~2000, which is that I "own" a lot of music but find myself stuck in an epicycle of the same 200 songs. Problem solved-ish. I never, ever, in a million years, would have built anything like this before.

It's really hard to sell me on the idea that nothing profound has changed here in terms of the projects we now pick up. Go build an operating system. I'm serious! Claude will practically one-shot it. Mine has smoltcp hooked up to a Rust virtio-net driver Claude pulled out of its butt.

3mo agoHN ↗

This weekend I'm playing with a SwiftUI MusicKit player[…]"Keep a continuous queue of music playing while I'm working in the wood shop"

I have a real problem, one that's been annoying me since ~2000, which is that I "own" a lot of music but find myself stuck in an epicycle of the same 200 songs.

What’s the algorithm there? How is it different from queueing up your whole library and shuffling it?

Go build an operating system. I'm serious! Claude will practically one-shot it.

Why would I want this? If I wanted to learn how an operating systems is built, there’s xv6 and the OSTEP book (and I’ve already gone through both) And I’ve been going through OpenBSD code, for a few questions that I had (usb audio and related code, usb mass storage and related code,…). Why would I ever wanted a generated project when there’s plenty out there to learn from.

3mo agoHN ↗

developers now are expected to randomly jump around projects and ship without friction. For employers it means they can move us around like pawns. Lot of companies have not reorged themselves to this new type of workforce thats much more malleable.

it used to be that i pay your due at some enterpise and learn some corner of codebase really well and become go to person. that would give you job security.

3mo agoHN ↗

Working in silos like this has always been an anti pattern though. You end up being employed for 10 years but only have 1 year of actual development experience. Just turning-the-crank and going home was always risky because one day you get laid off and realize you’re 10 years behind the competition.

3mo agoHN ↗

What I found comfort it in was turning the crank and then using extra time to upskill in various other things (including non software dev domains). Things that weren’t immediately useful to my employer and I never would have been directly assigned, but did pay off after sometime.

Now I’m basically expected to do what my boss wants me to do every minute of the day, it’s gotten much more micromanaged.

3mo agoHN ↗

I cynically predict that some of the new practices being hyped could easily end up worse...

Before: "I learned very little this year, because I was placed in charge of the same stuff, and I've already learned most of what I could from tinkering with that code, stepping through its architecture, and dealing with those recurring problems."

Soon: "I learned very little this year, because I don't deeply interact with anything, I just pull the lever on the babbling slot-machine until I get lucky and things seems to quiet down."

3mo agoHN ↗

As opposed to what? You seriously think that shipping 10 years, instead of turning-the-crank and going home, will save you from the interviewing gauntlet?

3mo agoHN ↗

Being a really good engineer - the kind of engineer you can assign a feature to and they promptly turn around a robust, maintainable, secure and well documented implementation.

3mo agoHN ↗

So does your IDE, your choice of programming language, your OS even — but does it define you/make you a good software engineer?

3mo agoHN ↗

Let them attempt to use ai to build business critical systems and when they waste tens amd hundreds of millions they can rehire master builders who know what they're doing

3mo agoHN ↗

They will attempt and then soon enough they will be succeeding, and the master builders will have all retired, and that's the point that humans become dependent upon AI's. I aim to live a couple more decades and I sadly expect to see it play out this way.

3mo agoHN ↗

Master builders ought to write blogs, books and speak at conferences and in podcasts for clout and subscriber money so the training data can get scooped up in the next loop. And pick the best of the best for master/apprentice training while you still can

3mo agoHN ↗

If you can move humans around like pawns, then by definition, they have no job security.

3mo agoHN ↗

developers now are expected to randomly jump around projects and ship without friction

This describes the expectation my managers had of me at every software job I've had, and I've been doing this for a decade and a half

It's definitely not a new thing since LLMs came around, if that is what you were implying

3mo agoHN ↗

It's definitely not a new thing since LLMs came around, if that is what you were implying

It is on a scale that it is required now. Previously you could say "it'll take me a week to decipher the mess", now they can just say "can't you use an agent to make it fast?".

3mo agoHN ↗

it used to be that i pay your due at some enterpise and learn some corner of codebase really well and become go to person. that would give you job security.I

I had the displeasure of working with those types. One of them replies to any question or challenge to a technical problem emerging from the PRs they posted with variants of "I've worked here for over a decade, this is how we do things". And then proceeds to argue things like defensive programming is a code smell because it means developers don't trust themselves.

I cannot envision any healthy, effective engineering environment where developers don't periodically switch between projects.

3mo agoHN ↗

That's a roundabout way of saying it makes software development easier. Perhaps even a 180.

But yes - once it's that easy you have to step up your ambitions.

3mo agoHN ↗

Maybe it makes software development easier, but a career as a professional software engineer harder.

3mo agoHN ↗

I hope that after a short period of delusional expectations and layoffs from employers we're at least left with a more consistently competent set of professionals in our industry. Some people have imposter syndrome. Others are actually just imposters.

3mo agoHN ↗

layoffs from employers we're at least left with a more consistently competent set of professionals in our industry

It definitely won’t be CEOs and managers not firing their buddies

3mo agoHN ↗

Some people have imposter syndrome. Others are actually just imposters.

I'm sorry to say, but AI coding assistants paved the way to professional imposters whose only skill is prompting a model to do something. I already had the displeasure of working with a software engineer who not only introduced a bunch of regressions that by mindlessly vibe-coding things against the requirements but also complained that not having credits to use the most expensive frontier models was, and I quote, "stifling my creativity".

3mo agoHN ↗

Nonetheless, would still trust Claude to be generally more reliably competent in a random area of software engineering than the average professional. Sure they might still be better in a particular area of their expertise, but we've all had to play the imposter before on the stuff we care less about and figure it out as we go. AIs are still inferior sometimes but usually a decent 7/10+ on most topics - which really fills the gap.

3mo agoHN ↗

I hope that after a short period of delusional expectations that top management is going to reap the rewards of these AI capabilities we get a whole lot more comfortable with just doing the full business stack - including management, sales, branding, etc - and hierarchical structures crumble into flat collectives of do-everything true-generalist programmers.

3mo agoHN ↗

You will never beat the vibe coders.

The vibe coders have a key advantage you don’t: they don’t give a fuck.

They blow through a task and move onto the next one. Management sees this as progress, and the vibe coders are rewarded.

When shit breaks later on down the line, and fires have to be put out and things rewritten, the vibe coders do NOT get the blame. They do NOT get punished. Most engineering teams operate on a blameless culture. If code was approved for production, then it should have been good enough. Vibe coders will keep on doing what they do, and skilled experts will be left cleaning up their messes.

For anyone who actually cares, it’s over. You are not steering development anymore.

3mo agoHN ↗

It’s all just vibe coders high fiving each other and saying LGTM.

Here’s a secret: I haven’t really bothered reviewing any PRs since September of last year or so. I just click approve and don’t even read it. It has been way less stressful for me.

Do bugs get through? Sure. But someone will just come in and vibe it out anyway. And I have yet to see a vibe coder or anyone who approved their flawed work get any repercussions. So yea, it doesn’t matter.

No one’s going to come after you asking “why did you approve this shitty PR?” And if they do you can forward it to the author and ask why they wrote a shitty PR. But that just doesn’t happen. It doesn’t matter.

3mo agoHN ↗

That might be true in the short-term, but I'd be very surprised to see that hold for the long-term.

We've had plenty of technology trends in the past that have promised faster development but has later turned out to have problems. Organizations that stick around learn lessons about what works and what doesn't.

If in a year's time organizations aren't feeling severe downsides from all of the unreviewed vibe-coded junk they put into production then maybe the vibe-coders were right. I'll believe that when I see it.

3mo agoHN ↗

The problem is downsides are random and not well understood. Sometimes by luck, an organization might not encounter any significant downsides. These kind of survivor case studies will perpetuate the myth that vibe coding is good enough.

The vibe coders aren’t “right”, they just get lucky.

3mo agoHN ↗

If the vibe coders are right I would give at least 90% of the credit to all the well made libraries, rules, and best practices that developers have built up over the decades. That’s what is embedded into LLMs and what might be the saving grace of slop code bases in the future.

3mo agoHN ↗

(...) rules, and best practices that developers have built up over the decades.

It seems you are not understanding that the reason all these "rules, best practices" had to be created in the first place was the fact that your average old times developer was churning out shit code and weaving spaghetti just as hard as today's vibecoders.

Those "rules, best practices" spawned from the same evolutionary pressure as today's instruction files, skills, custom agents, etc.

Why do you think one of the first AI features rolled out by GitHub was the automatic code reviewer?

You guys are talking as if everyone working on software before 2020 was this immaculate developer with pristine sense of architecture and style. No, they were not.

3mo agoHN ↗

All that stuff you mentioned is derived from a core set of principles established by decades of software best practices applied to a new means of generating code. Like quite literally those instruction files/skills essentially just reiterate the practices themselves.

To your last paragraph, I never say that nor do I imply it. I find that as a pretty disingenuous interpretation of what I said actually. The practices I mentioned were derived from hard learned lessons and designed as a means of mitigating the human tendency to write bad code.

3mo agoHN ↗

All that stuff you mentioned is derived from a core set of principles established by decades of software best practices applied to a new means of generating code.

The whole point is that the problem was already here, and the solutions were developed over a decade ago because the old time way of developing software was exemplary in the volume of shit it generated and had to be reigned in.

It's disingenuous to blame AI for yesterday's problems.

The practices I mentioned were derived from hard learned lessons and designed as a means of mitigating the human tendency to write bad code.

That's the whole point. It's silly to pretend that AI invented bad code. It was already here, and in high volume. Ironically, AI is contributing to greatly improve the quality of existing code, but as the same shit coders are at the helm of course you still get the result of the same level of oversight.

3mo agoHN ↗

They were not, but they were outputting code at a pace that was reasonable to review. Now they go straight to prod, 10x faster.

3mo agoHN ↗

This will invariably be a problem in organizations where tokens, lines of code, PR count etc are the metrics - which happens to be in most places. I do not know if there are metrics or rewards for maintainable code, OR penalty for write code that breaks down and causes product incidents down the line. By then those engineers would have been promoted and moved on to better things.

3mo agoHN ↗

The vibe coders have a key advantage you don’t: they don’t give a fuck. They blow through a task and move onto the next one. Management sees this as progress, and the vibe coders are rewarded.

This is a complete unrealistic assessment. Who do you think vibecoders are? They are yesterday's software developers using today's tools.

The people who manually write their PRs are also not giving a fuck when they break production code with spaghetti code that later has to be thrown out and rewritten. They are the same people.

The key difference is that now their output volume is much greater, and they iterate much faster. They roll out plenty of bullshit, but it also hits the fan much faster and triggers fixes at a higher rate.

People hate on vibecoders because they do exactly what your average developer does but at a much higher rate.

3mo agoHN ↗

You are not steering development anymore.

This hasn't been the case for at least a decade. Long before LLMs.

3mo agoHN ↗

From that perspective, development has always been harder since I started. I left college with a copy of K&R and remembering courses that applied to real life immediately, because data structures and such were just what we had. In my first job, I ended up writing a code generator to help serialize a large number of data structures, straight from a compiler design class.. which right now you don't need to know a thing about, because serialization and languages with introspection are everywhere. The knowledge you need to be a professional engineer just kept going up through the last 30 years, while most of the basics became far less relevant, because the libraries just did it.

AI raises the bar again, as its probably at least as good as me, if not better, at anything I learned in college. I've spent years living off of random trivia from the last 30 years, as I saw computing grow with me. How do you know this?! Because everything built on top of it didn't exist when I was your age, so I had to learn it! But well, nowadays the AI is better at that trivia too.

The world moves, we do what we can with what we kno. It's not just programming, but what innovation and automation has done to the vast majority of things humans have done to be productive for each other since humans are people. We'll have to cope, like the guy that bred oxes to pull the plows.

3mo agoHN ↗

So in essence: it got harder because the easier parts have been solved for?

3mo agoHN ↗

I worry this is looking at where the ball is now instead of where it's going. The recent disproof of an Erdos conjecture should put to rest the idea that LLMs will reach a skill ceiling before they reach superintelligence.

I believe we are headed for a world of superintelligent AI where LLMs are much better at logical thinking than humans, the same way that chess engines are much better at chess than humans.

In that world there's really nothing humans can offer in terms of logical thinking other than their humanity itself. An 8 year old with Stockfish can beat Magnus Carlsen, and an 8 year old with Codex (and daddy's credit card) will be able to beat me at software engineering.

3mo agoHN ↗

Are you confident in putting a timeline on this prediction?

One of the reasons I'm increasingly skeptical of this prediction is that I've now lived past a few of the dates I heard people put on the achievement of this level of superintelligence in previous years.

3mo agoHN ↗

I don't buy that at all.

It doesn't matter how great the LLMs get, the act of creating software using them will still require a great deal of skill.

Most people just don't think in terms of software.

Try asking a non-developer in your life what their dream software would be for their work, or their hobby. If they don't have what Nilay Patel calls "software brain" I'd be surprised if they came up with something actionable.

(For more on software brain see "THE PEOPLE DO NOT YEARN FOR AUTOMATION", which makes the point I"m making here but much, much better: https://www.theverge.com/podcast/917029/software-brain-ai-ba...)

You could give a non-developer the smartest LLM in the world and they wouldn't be able to create GitHub with it, because creating GitHub requires an enormous amount of understanding of what software developers need from a cloud source control tool.

Sure, you can argue that the LLM "knows" what GitHub needs already and can guide their human-user to that, but why would a human-user who doesn't understand the domain ask an LLM to do that in the first place?

3mo agoHN ↗

Try asking a non-developer in your life what their dream software would be for their work, or their hobby. If they don't have what Nilay Patel calls "software brain" I'd be surprised if they came up with something actionable.

I've posted this in numerous comments because I think it bears repeating: there are tech-savvy non-developers who are actually building and shipping stuff with AI. I personally know a few who have been successful in acquiring initial customers.

You can say "but their apps won't scale", "their apps aren't secure", etc. and you might be right but these criticisms ignore the fact that most human-built software suffers from issues around scalability, security, etc. What AI in the hands of a relatively tech-savvy person is capable of is building functional, usable applications that are pretty decent compared to what you might get if you paid an experienced contractor tens of thousands of dollars to build.

A whole generation of young people has grown up with the internet, smartphones, etc. They might not be trained software engineers or have a "software brain" but in many cases they probably have a better intuitive sense for digital product design than a 30 or 40-something engineer who has been staring at an IDE for the past decade(s).

3mo agoHN ↗

there are tech-savvy non-developers who are actually building and shipping stuff with AI

I absolutely believe that. I think those are people with "software brain" who are on their way to becoming real developers.

By the point they can write apps that are secure and scale... they'll have learned enough about software development to be employable as software developers. They'll be part of a new breed of developer who never memorized the syntax of a programming language, but they'll still be at the starting point of learning a HUGE volume of other stuff that's necessary to build good software.

If we want to stay employed, we need to be notably better at building software than they are.

3mo agoHN ↗

I absolutely believe that. I think those are people with "software brain" who are on their way to becoming real developers.

In my opinion, this is a software developer-centric way of thinking that reminds me of the saying, "if all you have is a hammer, everything is a nail."

Here's an alternative perspective:

For billions of people, technology products are an integral part of daily life. As a result, lots of people have an interest in building technology products, particularly software. Thanks to AI, you no longer need to be a "real developer" to build software. You can learn enough to build things that are commercially viable without seeking to be employed as a developer.

If we want to stay employed, we need to be notably better at building software than they are.

While I don't believe that the market for developers will shrink to 0, unfortunately, I think this type of comment reflects the fear, existential angst and denial that has overtaken many people in this industry.

The reality is that developers are no different than all the displaced workers who came before them. One day you had a job that seemed secure and capable of providing for a comfortable life and the next you were facing the prospect of diminished wages and unemployment because the world simply needs fewer people with your skills and there's no way around the secular trend.

The sad irony is that when software was eating the world and new CompSci grads could take their pick of $150,000+ job offers before ever writing a line of production code, a lot of people in the industry had a smug "tough luck" attitude towards all the workers being displaced by the tech boom. Now it's their turn.

3mo agoHN ↗

Another angle to refute this take: my experience is software developers themselves arent good at building software products. Its been historically necessary but not sufficient to have to understand the underlying tech. Even if AI makes that no longer necessary, it doesn’t magically make people good at building useful and usable things.

Being in the weeds of the trade expands the lens of capabilities so I’d give the upper hand to someone more deeply aware of the tech vs not. even though that in itself is still not sufficient.

3mo agoHN ↗

The sad irony is that when software was eating the world and new CompSci grads could take their pick of $150,000+ job offers before ever writing a line of production code, a lot of people in the industry had a smug "tough luck" attitude towards all the workers being displaced by the tech boom. Now it's their turn.

You could've just written this sentence and dropped the rest. I understand your vindictive, "justice", self-hate line of thought, but not it's not a healthy way to live. Get help.

3mo agoHN ↗

Nevermind syntax, what's a variable? function? class? What's the difference between int/float/boolean string? Nevermind more advanced concepts like O(1) vs O(n). But when the vibe coder just needs to prompt "the page loads really slowly. plz fix" and the LLM can go in, add an index to the right SQL table, add a limit and pagination, so what if I can tell you the difference between PostgreSQL's dialect of SQL vs MySQL, and what the difference is in row types supported. I can describe what happens when you type Google.com into your webbrowser to an inane level of detail off the top of my head, but when the LLM can do an even more through version, I mean, I can pat myself on the back and be smug that I know most of that innately, but what is it really worth?

About a decade back, we, as an industry were collectively learning how to make apps webscale, and oh the blog posts about not using a database as a queue. But the LLMs have ingested all of them. I've only read the ones I came across, and of course my professional experience being part of teams implementing that at various companies. So I've got that going for me, but when the Vibe-platform-dev just has to tell the LLM "hey, when the user hits the send message button, it's slow. /goal make messages fast", and the LLM grinds for hours overnight switching the entire system over to a pub sub event driven architecture and the vibe-platform-dev doesn't even know what pubsub stands for or that they're using one unless they go back and read the transcript. I don't think there's as much of a domain expertise moat for as long as we're hoping.

3mo agoHN ↗

I agree, and I want to add that 'better' doesn't necessarily mean 'creates more robust, elegant, resilient software'. Better means from a business perspective. If we (I'm one of the people you're discussing) end up cheaper or more fungible, for example, we still might be worth hiring from a business perspective even if the code we create is shit.

I've also seen an assumption that you've made here that I think is worth drawing attention to and questioning: that the tech-savvy non-developers are starting from zero or near zero when it comes to programming and software development. Right now, that's probably mostly true, but I'm not sure that will continue to be the case. I'm not a developer (depending on how fuzzy we want the boundaries around the idea to be, anyway). I do understand the building blocks of programming languages (e.g. I can answer all the questions fragmede posed in a sister comment), the trade-offs between rolling your own and using existing libraries, the need to evaluate tools, frameworks, and languages to determine which is best for your use case, why version control matters, why access rights matter, why backups and a test environment are necessary, why it matters to write code another human can read, etc.

Do I understand as much as an active working developer? Absolutely not and I'd never claim to, but I'm far from starting at zero.

The reason for this is that I was raised by programmers. There are far, far more programmers and general tech nerds now than there were in 1988 (when I was born). Which means that in 10-20 years, there are going to be a lot more children, grandchildren, nieces, nephews, and so on of developers, and a lot of them are not going to be starting at zero. For pretty much of all computing history, there's been a substantial opportunity cost to developing a deep understanding of coding and software development: either a person has to be so into the domain that they devote a lot of their waking hours to it (usually in adolescence or young adulthood, when that trade off closes the most doors and makes developing certain other time intensive skills difficult), or they have to obtain a CS degree, which means not getting a different kind of degree and often incurring significant front-loaded financial costs. The opportunity cost for people born into programming or tech families is much lower. You can start younger and spread out the hours needed to learn across a greater amount of years, you can acquire knowledge in less time-intensive ways and while practicing other skills (e.g. my cousins also have 'software brain' and we could all hang out and develop those skills while also developing in person social skills), and you have a built in network of experienced people who want to help you + that can give you extremely individualized, personalized attention.

If what you suggest comes to pass, I think that one of the greatest threats to SDE as a career is going to be your own children and grandchildren.

3mo agoHN ↗

This is a great comment, thanks for giving me a bunch to think about here.

I'm personally excited about people with deep specialities in other fields being able to build software without reskilling as software engineers first.

3mo agoHN ↗

I've posted this in numerous comments because I think it bears repeating: there are tech-savvy non-developers who are actually building and shipping stuff with AI. I personally know a few who have been successful in acquiring initial customers.

I mean, sure. But there have always been people teaching themselves to program too. In the end it's a pretty small population.

3mo agoHN ↗

there are tech-savvy non-developers who are actually building and shipping stuff with AI. I personally know a few who have been successful in acquiring initial customers.

It'll shake your world, but tech-savvy non-developers were building and shipping long before AI.

they probably have a better intuitive sense for digital product design than a 30 or 40-something engineer who has been staring at an IDE for the past decade(s).

Because developers only stare at IDE 24/7, and never interact with anyone besides mother who brings tendies to their basement? What am I even reading?

3mo agoHN ↗

It'll shake your world, but tech-savvy non-developers were building and shipping long before AI.

They weren't building and shipping by themselves though. They were hiring people to do the work.

AI has made it possible for people with motivation and time to do what was previously only possible with motivation, time and money.

Because developers only stare at IDE 24/7, and never interact with anyone besides mother who brings tendies to their basement? What am I even reading?

Why is so hard to acknowledge the fact that many of the people who are good at developing aren't as good at coming up with ideas for digital products and building businesses on them?

3mo agoHN ↗

I personally don't see that much sense worrying about this scenario because if it comes true then it doesn't really matter what I do.

3mo agoHN ↗

If building software (and even programming, as the basis for it) was just an expression of logical thinking, we would have cornered it long time ago IMO.

But then again, logic is really a lot more discrete and well defined and easily expressed with traditional computing than LLMs are (which are probabilistic systems instead and as such require large knowledge bases).

We can observe that at a couple hundred billion parameters they behave similarly to a point (in the sense that they can produce similar results), but the challenge is really in understanding the problem's multifaceted structure and competing needs and priorities.

3mo agoHN ↗

Chess and proofs only work as comparisons to the extent that you can find parts of your job that share their key property: A solution is sought to a problem that can be stated with relatively little information.

What prompt would someone have used to get a superhuman coding agent to output the Linux kernel or GTA5?

Before you accuse me of moving the goalposts, that's not my point: The examples are there to help think about what humans would still need to do to build complex projects even if the coding itself was perfectly reliable.

Both the Linux kernel and GTA5 contain a large amount of incompressible information; humans thought long and hard about how to design them, i.e. about what that thing they were building was even supposed to be.

3mo agoHN ↗

You don't understand, Claude 69 will be able to one-shot GTA6. You NEED to buy into the fearmongering and anxiety.

3mo agoHN ↗

In that world there's really nothing humans can offer in terms of logical thinking other than their humanity itself.

By your logic anyone who's not in the top 10% of intelligence can't offer anything. The world keeps spinning.

An 8 year old with Stockfish can beat Magnus Carlsen, and an 8 year old with Codex (and daddy's credit card) will be able to beat me at software engineering.

That's just nonsense, nobody will work with 8 year old (it's illegal, to start with). Go touch grass.

3mo agoHN ↗

That's true but in a way it's also more fun and engaging because the tedious stuff just gets worked through leaving you to think about the bigger picture items.

Though I'll say I don't buy the stuff about AI "democratizing" development since making it much more capital-intensive kind of has the opposite effect for anybody doing dev work at home.

3mo agoHN ↗

If you're worried about non-technical vibe coders taking your job, the correct response is to be much better at building software than those vibe coders. That means you need more skill, more ambition, and more experience. It's hard!

This is a false fear. The real risk isn't that some 19 year-old vibe coder is going to replace you, it's that there's simply less need for more experienced engineers. The market is shrinking.

Also, even if the premise behind the SaaSpocalypse is naive and oversimplified (companies aren't going to replace all their SaaSes with internally vibe-coded replacements), it looks reasonable that net-net AI will have a negative impact on the value of software.

3mo agoHN ↗

The real risk isn't that some 19 year-old vibe coder is going to replace you, it's that there's simply less need for more experienced engineers. The market is shrinking.

That last sentence is verifiably false if you look at SWE job postings and their recovery since 2022.

It’s also a poor take in general, buying very much into the narrative propagated primarily by OpenAI and, especially, Anthropic, who nonetheless continue to hire large numbers of SWEs while paying double the market rate.

3mo agoHN ↗

That last sentence is verifiably false if you look at SWE job postings and their recovery since 2022.

Do you take into account recent layoffs of Meta (8k people), Block (4k people) and others?

3mo agoHN ↗

That last sentence is verifiably false if you look at SWE job postings and their recovery since 2022.

Source?

https://fred.stlouisfed.org/series/IHLIDXUSTPSOFTDEVE

And it's probably worse than it looks because phantom job postings are a real thing.

...who nonetheless continue to hire large numbers of SWEs while paying double the market rate.

Tech companies have laid off over 200,000 people since the beginning of 2025. Even putting aside the fact that (from what I understand) over half of Anthropic and OpenAI's employees are in non-engineering roles, if you assumed every employee was an engineer, Anthropic and OpenAI could triple their staffing levels and it still wouldn't even fill a quarter of the void.

3mo agoHN ↗

Yes that’s the right source. There would be no recovery in SWE market after the higher interest rates killed it if LLMs had any major impact on SWE employability.

3mo agoHN ↗

You have a very interesting definition of "recovery".

3mo agoHN ↗

I had the same thought recently, I've had it happen to myself.

I've been working on something relatively large and greenfield recently.

A big chunk of my time is spent thinking about the hard parts. The raw information processing rate needed to keep up with the state of the project is high.

It feels almost like mental athleticism, whereas coding used to be a rather chill activity.

3mo agoHN ↗

If you're worried about non-technical vibe coders taking your job

I'm not worried about non-technical vibe coders taking my job. I'm worried about psychotic VCs and CEOs putting me on the street in the name of "optimization" of "lower value human capital".

3mo agoHN ↗

It all feels to me similar to how spectators or laypeople judge pro sports.

Don’t quote me on this, just trying to make a point:

They’ll say you need perfect symmetry to do well in sports, which is highly correlated to development stability in the womb; higher symmetry = perfect development.

Then after some years, news will come: Bruce Lee’s one leg is shorter than the other by a significant amount, and Usain Bolt has a similar asymmetrical development.

Then they’ll flip-flop around their initial argument by claiming that they are outliers so the general rule need not apply.

brother just build what you find interesting and it may work :)

3mo agoHN ↗

It's well established that injuries occur at much higher rates when you have asymmetries/imbalances. Not even just physical "deformities" but just when your body is shifted or twisted in some way such that you don't move with balance.

3mo agoHN ↗

I'd like to believe that stable state ends in a pair-programming structure, with a systems thinker/engineer and a domain expert.

Someone needs to spot when a linked list is better than a map. And the other needs to spot when clinical trial coding should happen before claims, audits, or patient outreach.

3mo agoHN ↗

How much pontificating needs to be done before people acknowledge nobody has any idea what to do with AI on an individual level?

if nobody has any idea what to do, talking about it is the right approach

3mo agoHN ↗

I think it's more: AI assisted engineering is a new skill people are trying to develop and we're on this collective experimentation process, working out how to use AI for engineering with varying degrees of success.

If that's true, any statements defining what is necessary to do should be ignored in that context. I'm still interested in hearing about what people tried, what results they think they saw, and then trying to apply those findings to my own processes.

Which is to say I don't think the pontificating is pointless, but as statements of Real Truth, I agree they're likely wrong. We're too early in the game.

3mo agoHN ↗

Taste, architecture, new innovations. These are all streams of tokens which are subject to the same scaling laws as code, language, and basic classification.

We are going to see a new generation of models which effectively “solves” these problems for most businesses. Likely within the next two years- then we’ll talk about some other problems which limit adoption.

3mo agoHN ↗

Being a domain expert has been more valuable than being an excellent software developer before the ai.

In 2018 I witnessed one guy with no prior coding experience who built a tool that after a month of coding was making very decent money (more than me), just because he was aware of a particular niche.

He showed me parts of his code and it was as bad as my first program, but his was solving a real life problem.

3mo agoHN ↗

As software engineers we’ve now suddenly become a sort of “god of the gaps” - our existence is only justified in the (fewer and fewer) situations where the AI can’t do the job just as well on its own

3mo agoHN ↗

Hype folks need to move those goal posts to justify all the money and time invested into something we are starting to realize is a liability.

3mo agoHN ↗

Grifters are trying to get their 5 minutes of fame by posting some unhinged shower thought that they have. It's just that you're noticing it now, because it pops up in the feed. Previously they'd say some shit about Agile, OOP/Functional programming or some other bullshit, and it would be swept under the rug.

3mo agoHN ↗

I have been thinking about this sort of progression too. One thing I wonder about is network effects. Are they even important? Now, for sure. Will they be so in a year? I don't know. I'm thinking about tooling centralizing on common primitives. Like, for my own situation, does it matter that everyone is using the same libraries?

If AI becomes the interface, then we will a layer of abstraction above programming languages themselves. Which is kind of wild.

(I don't pretend this is a novel idea. I'm just not that plugged into AI discourse.)

3mo agoHN ↗

the idea that llm's can't help if you're missing domain knowledge is crazy.

3mo agoHN ↗

I mean if you ask the AI to make something to manage the inventory in a warehouse without any detail about how the warehouses operate then you're going to get a worse result than a domain expert talking to the AI.

The problem is that more and more people are getting convinced by the AI's that they're domain experts when they're really not.

3mo agoHN ↗

Nice idea, but engineers are engineers for a reason.

I’d suggest that the domain expert partner with a GenAI senior engineer to build together. In fact I believe this is the new dev team model. Domain Expert + Senior Engineer + QA. Not sure we still need a project manager anymore and we certainly don’t need scrum masters.

3mo agoHN ↗

There's a lot of people agreeing and disagreeing with the article, but on what grounds? How do you know "domain expertise" is a "moat"? Vibes? Has there been ongoing, persistent attacks by AI on domain expertise where we can say the moat holds, economically speaking? So far it seems quite the opposite.

So far the evidence seems to be pointing to a different adage, Sutton's Bitter Lesson, which (generalized) says to not bring human expertise to a problem that can be "solved" with unfathomable volumes of data. Because the latter has historically slaughtered the former for decades. But somehow people believe this time it's different?

I will counter there is one thing that is a persistent moat, and it's not domain expertise; it's sales. Convincing other humans to part with their money. Humans have shown they will trust a person/human touch to part with their money more than an AI.

But I'm not convinced today's AI or tomorrow's won't be able to replicate domain expertise in domain X for any X.

3mo agoHN ↗

I'm in growth. When I hire in sales roles, I prioritize domain expertise.

3mo agoHN ↗

You think we won't have ai sales agents that are better than humans at selling?

They are already significantly better than humans at persuasion (according to a study from Princeton).

3mo agoHN ↗

Has there been ongoing, persistent attacks by AI on domain expertise where we can say the moat holds, economically speaking? So far it seems quite the opposite.

What do you mean by this? Most human white collar workers still have their jobs. I can't see the future, but yes, so far, human expertise is doing ok.

We'll see what happens in 2027, and 2028, and...

3mo agoHN ↗

What some people here are missing, is that domain experts or hobbyists are mostly vibe coding tools for themselves -- not as a SAAS product. They tend to work good enough to do the thing they want it to do. It runs locally or on some VPS, and is held together by string and duct tape.

The work product probably offends real software engineers in the way that a normal home cooked meal would offend a Michelin star chef. Yet, before last summer, these people never contemplated the ability to cook their own meals before. The fact that they can do this now is a very big deal.

3mo agoHN ↗

The problem with these kinds of discussions is that they act like experienced software engineers themselves don't bring domain expertise to software products.

So AI can easily replace the domain knowledge of software engineers but not of evey other profession?

Coding is not engineering but I'm glad that we will finally be able to prove that definitively thanks to AI. It's going to be a bumpy ride.

Any software engineer who has built software to solve domain problems in multiple industries knows that the engineering domain knowledge and systems thinking approach is far more difficult to attain than industry-specific domain knowledge... This is why there are software consulting firms which can work across multiple domains. Understanding the problem domain is not that difficult.

3mo agoHN ↗

I work as an analyst, and our group has roughly 20% analysts with strong technical (software engineering) skills, and the rest are more traditional analysts / domain experts.

In the past year we've seen these non-technical analysts become more productive when it comes to developing internal tools, by leveraging AI models for the dev part.

Prior to this, pretty much everything was developed in Tableau. It was the most accessible way for non-devs to build working tools.

Just the other day one analyst in our group presented a tool he had been working on, which was basically a port of a tableau report, made into a more flexible app.

3mo agoHN ↗

Our group is slowly replacing tableau with self built tools, with HUGE performance gains. I think these BI companies are in deep trouble, especially ones like tableau that make drawing something simple, like a histogram, near impossible.

3mo agoHN ↗

More generally, I think it’s more specialized knowledge.

If you have particularly specific knowledge in pretty much any domain, combining that with AI can lead to huge gains.

3mo agoHN ↗

This sort of thing has Microsoft Access vibes about it. All AI is enabling is domain experts to spin up their own software systems with no understanding of how the systems should be put together.

Sure it lowers the bar, and some people will design decent things, but mostly these things will become mission critical and broken at the same time.

3mo agoHN ↗

A logistics dispatcher, a clinical coder, an actuary. [...] They know the correct outputs for a given set of inputs because they’ve spent ten years living in those inputs and outputs. Hand them an agent and they are startlingly effective, because the thing they’re missing, the ability to produce code, is exactly the thing the agent supplies. What they bring is the thing the agent can’t: the ground truth.

With my sincere apologies to the author if I'm wrong, I'm pretty darn sure this was written by AI.

Guys, c'mon. I don't get it. It's one thing to have an AI write code for you, because code is ultimately functional. At least in the general case, the primary purpose isn't to express an idea.

Prose is different. Your writing represents what you think. You are your writing. Why would you outsource that?

I don't get it! Unless you're a (cheating) student, or you're writing marketing drivel.... what is the point? Just don't write the blog post. It's okay. Telling the robot to write the blog post doesn't accomplish anything. I don't care what a robot thinks!

I'm sorry, I'm just getting really tired of AI generated articles on Hacker News. Please, please don't outsource your own speech.

3mo agoHN ↗

Agentic tools collapsed one of those paths and not the other. The engineer’s advantage, the ability to translate a domain model into working code, is now cheap. The domain expert’s advantage, knowing what right looks like, is not.

Not yet.

We won't be there until AI is more like a virtual person, where the domain expert trains the AI in a similar manner to training a real person.

At this point, agentic coding only eliminates the engineer when creating very simple applications. Once the application gets complex, either the domain expert needs to become an engineer, or an engineer is needed.

3mo agoHN ↗

It was never about the code.

After spending the last 5 years building software for venture capital and private equity, this blog post really resonates with me. Writing code is by and far the _easiest_ part of my job; understanding the financial engineering and nuance behind what my company's customers need from us the tough part.

We always joke that we'd rather hire a senior fund accountants and teach them to program if we could, only problem is there just aren't any of these folks around. Teaching an engineer to understand the minutia of fund accounting well enough to build software for these firms is tough.

3mo agoHN ↗

IDK, there's a tipping point where at best domain expertise without skill leads to a LOT of tech debt.

In fact about half of my career has been dealing with 'domain knowledge at least present enough to get the ticket/epic closed but leads to a lot of tech debt'.

i.e. a good portion of my jobs have involved a lot of a good amount of:

- Review PRs with a fine tooth comb because despite domain knowledge, people are human and can either don't know any better, make mistakes, or willingly refuse to integrate feedback, or worst refuse to double check what the coding agent wrote for them.

- 'refactor this thing because it was technically correct but written so poorly that it leads to timeouts and/or a Manager/DBA is screaming' [0]

We always joke that we'd rather hire a senior fund accountants and teach them to program if we could, only problem is there just aren't any of these folks around. Teaching an engineer to understand the minutia of fund accounting well enough to build software for these firms is tough.

A truly good software engineer is able and willing to learn the domain, but there has to be a way for them to learn. I say that because I've been at shops where various levels did that (i.e. sometimes the company itself, sometimes the team, sometimes colleagues) and I've been at shops where everything is lip service and at best you can only glean from what's in the JIRAs and what you can glean from what people outside of IT say in meetings you are in.

After spending the last 5 years building software for venture capital and private equity, this blog post really resonates with me. Writing code is by and far the _easiest_ part of my job; understanding the financial engineering and nuance behind what my company's customers need from us the tough part.

I think a big paradigm shift especially in the past 5 years has been that most companies are expecting folks to work to the bone, and it winds up being counterproductive because it prevents anyone from being able to have the important conversations.

Culture is a huge factor in this, I've worked at shops where at the very least you could easily have a side conversation or a meeting, and shops where you might as well sign a change.org petition to request time to talk about it properly.

Still, you are right at the crux; Requirements matter more than code at the end of the day. I've been at shops where a person's definition of 'Correct' meant a feature got delayed despite all requirements being met, because they didn't like they way it was written after they were gone the whole time it got implemented and the rest of the team approved all design decisions.

[0] - Next thing you know you learn about a 'batch process' has %numberOfRecord%*10 inserts, possibly with additional fetches given a poorly designed data model to where it is doing SQL upserts in the most wrong way (i.e. doing a get from the DB and then adding a record to be inserted if not present.) and they keep doing more and more questionable things to 'improve performance' rather than rethinking the data layer's query pattern. Seen it more than once in my career.

3mo agoHN ↗

Tech debt is what most orgs/managers ask for. If nobody is complaining, there's no problem. Nobody but you knows what's behind the scenes until they ask for something new that the tech debt makes take longer than you think it should. But they don't perceive it that way, because they're probably not software people. They just see it as a new ask that will take a bit longer than expected.

Nobody cares about quality, if they can't perceive it. They want practical results. AI will give that to them, to some degree. Most people don't see software as deterministic anyways, so sometimes not working doesn't register as the monumental, show stopping, failure that it would me or you.

3mo agoHN ↗

You are wrong. Writing programs (atleast efficiently) is not the easiest part. It just appears to be once you get accustomed.

Domain expertise is hard but not that hard compared to the insane mental discipline required to write efficient scalable code.

Domain expertise is valuable and hard but I don't get this "domain expertise is harder than disciplined coding" mentality.

3mo agoHN ↗

Domain expertise is hard but not that hard compared to the insane mental discipline required to write efficient scalable code

"efficient scalable code" is just as vague as good code. How are you going to know your code is scalable if you don't understand your domain? Scalability is not something you sprinkle onto code.

3mo agoHN ↗

Are you kidding me. What has domain got to do with efficiency and scalability.

Efficiency is about using minimum cpu cycles or minimum memory or minimum network round trip or more generically using minimum/optimum resources to get something done.

Scalability is about minimizing bottlenecks and linear scaling so one can just copy and execute by adding more nodes/resources and expect correctness and increased throughput.

Both of these have nothing to do with domain expertise.

3mo agoHN ↗

Efficiency is about using minimum cpu cycles or minimum memory or minimum network round trip or more generically using minimum/optimum resources to get something done.

No profitable business wants to pay you for writing code that uses "a minimum" of a resource. It wants to pay you to find the right balance between resource usage, time-to-market, operating cost, code complexity and probably several other factors.

3mo agoHN ↗

I run a small profitable business. I avoid those who doesn't care about efficiency or scalability like the plague. Laziness shouldn't be promoted.

3mo agoHN ↗

Scalability is about minimizing bottlenecks and linear scaling so one can just copy and execute by adding more nodes/resources and expect correctness and increased throughput.

Yes, technically, but note that this entire thing can be anything from crucial to completely worthless depending on the domain.

You need insane scalability for a social network or a streaming service, you don’t need any real scalability for (completely made up) managing a fleet of airplanes or the internal logistics of a zoo.

3mo agoHN ↗

Writing scalable and efficient programs are extremely hard. This matters for serious projects but for small projects, honestly who cares.

3mo agoHN ↗

The almost all problems are "small", by your standards. Giant market.

3mo agoHN ↗

Catering to a giant market is usually when scalability and efficiency problems starts surfacing. People here having a hard time to understand reveals a lot about the kind of work they have undertaken.

3mo agoHN ↗

To be fair, I'd consider hard-core scalability/reliability software engineering skills to be their very own speciality domain.

But I'd also claim that these things fall on a spectrum. At the extreme end we have exchanges and HFT-like trading systems, where absolute accuracy and latency are not even constraints but industry fundamentals. At the other end we have "toy" applications that handle tens of requests per second, tops.

Scalability problems are definitely near the extreme end. Only instead of raw latency, you get to deal with complex failure modes, throughput, capacity problems, read amplification and thundering herds... all the while being constrained by available CPU cycles and bounded memory.

3mo agoHN ↗

Scalability stems from domain knowledge.

Sometimes you need two orders of magnitude. Sometimes you need five. Sometimes you need less than one.

3mo agoHN ↗

Domain expertise is hard but not that hard compared to the insane mental discipline required to write efficient scalable code.

Not all code has to be efficient scalable code. I know some domain experts that were not programmers. They picked up enough Python or Swift + UIKit (this was pre-LLMs) and their applications are now widely used in their domain. In some cases, they contracted some software companies in the past to do the work. However, they did not understand the problem domain well, requiring the domain expert to iterate with them over and over. In the end it was more efficient to let the domain expert to learn enough programming do it with some guidance from experienced programmers.

Also remember that a lot of domain-specific apps do not need to be huge. E.g. I was once at a factory in the 90ies and they needed to do time-consuming calculations for a particular expensive machine. So, someone who worked at the factory wrote a small program in Excel + I think VBA. This accelerated their work extremely and probably saved them 10,000s or 100,000s in manual labor. It was easy for a non-programmer to write, because they knew all the details of the machine and the calculations, since they had done it over and over again. But it's not a enterprise web app or anything and it does not matter if the program runs in 1 or 4 seconds.

By the way, I also consider efficiency to be a specific knowledge domain, or architecting a very large project. So in the end it really depends on how narrow or wide your definition of 'programming' or 'coding' is.

3mo agoHN ↗

A implies B doesn't mean B implies A. Not all programs have to be efficient and scalable.

But mental discipline required to write efficient and scalable code is insane that most domain expertise is feeble by comparison.

3mo agoHN ↗

Writing programs (atleast efficiently) is not the easiest part. It just appears to be once you get accustomed.

Programming is the easiest part! (c) decade+ experienced senior developers

3mo agoHN ↗

Right. If you're spending your time among developers to whom the code part is second nature, the differentiating thing becomes domain knowledge. If you spend your time among people of that domain who have no coding skill, to them it will appear to be the opposite.

I think there is some prestige factor in the background too. Being seen like some kind of code monkey is to be avoided like the plague. Business people really don't value the math savant engineer nerd archetype who just codes and codes.

Highest prestige is always taste and judgment, not correctness and skill. This is why people will also talk about how business soft skills, communication etc are more important than hard skills like programming, math, etc. I think one should be careful with this. On the one hand it's true that career progression is quite dependent on soft social skills, but there are also really hard kinds of software jobs where cognitive horsepower and technical experience are absolutely crucial and soft skills won't save you.

3mo agoHN ↗

Seriously doubt you ever did serious financial math.

Coding is way easier.

3mo agoHN ↗

Lol truly. A short list of just a few things that haunt my dreams: Distributions, American/European waterfalls, Carried interest, Management fees, and basically every single detail about Master feeder fund economics

3mo agoHN ↗

Funny. Sure. Kernel development and truly scalable architectures must come easy for you. Management fees must be so hard. :)

3mo agoHN ↗

I imagine Kernel development is quite difficult, as might be designing infrastructure that can handle 10K+ RPS. I don't quite understand why you're being so passive aggressive, this isn't reddit; I'm not interested in being correct/incorrect -- you're welcome to share your opinion with me and I'm more than willing to hear your side.

Like anything in life, "it depends" -- but I do have the opinion that the vast majority of software engineering jobs are orders of magnitudes simpler in requirements than the two examples you've given. On the grand scheme, many engineers need to be experts in their domain to succeed; it doesn't matter if you can support 1k RPS if you only have a few hundred clients and don't understand their needs well enough.

Most startups don't fail because they don't have the right tech, but because they don't capture the right market or understand their customers well enough. There have been many startups with absolutely brilliant tech, but if your company (and your engineers) aren't experts in your product the tech won't matter _until_ you hit a scale in which you require that sort of expertise.

3mo agoHN ↗

Seriously doubt your reading skills. Read again. Hint "efficient" and "scalable". Go figure. I seriously doubt you have written scalable code. Financial math is laughable by comparison.

3mo agoHN ↗

“Teaching and engineer to understand the minutia of fund accounting well enough to build software for these firms is tough.”

Sounds like you need a senior familiar with finance/accounting and a family to feed. Email me!

3mo agoHN ↗

Wouldn't the model have as much domain expertise as pretty much any human? I'm assuming the average project manager isn't reading the entire internet

3mo agoHN ↗

I have bad news about reading the internet...

3mo agoHN ↗

There’s no skill file that contains the tacit knowledge of a person who has reconciled a thousand payrolls.

That person has zero skill in actually making tight automation that doesn't just fall over. And I have yet to see an AI agent that tells them "look, your requirements are contradictory, given this and that, these two cannot coexist".

Those little sycophants will just go and try to please the domain expert and placate him in all ways possible. Bend backwards rather then forcing them to reassess their assumptions.

3mo agoHN ↗

A domain expert might know if a system produces correct results.

But they know nothing about the scaling, performance or maintenance of a system that will inevitably come up in production.

They also can't tell if the code created is maintainable, or unmaintainable sphagetti code.

What happens if there is a race condition, or a memory leak?

3mo agoHN ↗

I have the opposite take. Because Claude is also a domain expert at most things, and you can unit test your way to making things "just work".

If you ask me and a logistics dispatcher the task of building logistics dispatching software (whatever that is), I will get there first.

3mo agoHN ↗

The engineer’s advantage, the ability to translate a domain model into working code, is now cheap.

I say this as someone who uses AI a lot. Its still a far cry from cheap, especially with that pesky “working” word in there.

3mo agoHN ↗

The problem is, discoveries that advance humanity are made by 0.01% of humans or less. The majority of people don't ever discover anything new, they just build or consume what already exists.

AI is, at best, as useful as those masses. Actual discoveries, actual novel software, actual human advancement is beyond AI and the domain of the same humans who've always advanced technology.

So yeah, AI is ok for copy-pasting the same shit that we used to plug together web frameworks for, it's fine for internet research (Gemini for me is like a supercharged Google with no ads or SEO garbage), it's fine for repetitive emails and making my "fuck you" emails sound professional, but actual expertise isn't going away any time soon.

Also, I disagree that software engineers can "just learn" non-software domains. If there's one thing I've found about most people who call themselves "engineers", it's that their thinking is way too rigid for many other domains.

3mo agoHN ↗

This is a nice theory, but is it true in practice? (At scale; I’m sure at least 10% of domain experts will find they enjoy writing software too)

3mo agoHN ↗

The standard take, including my own from last year, is that these tools amplify senior developers because senior developers have judgment.

My take is much less charitable. I think a lot of senior devs are lonely and enjoy talking to chatbots all day. Saying it amplifies their productivity is a justification.

3mo agoHN ↗

"to build software you need someone who can make requirements and someone who can build systems"

revelations never stop coming do they

3mo agoHN ↗

the binding constraint has moved from can you build it to can you tell whether it’s right.

My suspicion is we are still moving up along a continuum of capability.

Models didn’t used to produce coherent sentences (GPT-2 era) and now they can. Past models (GPT-3 era) made syntax errors and now models can write well structured code. Past models didn’t reliably emit correct syntax to request a tool call, or track context across multiple tool calls - and now they can.

Frontier models can’t write code without glaring security flaws, even as they already follow other best practices. So on those two criteria of code quality we are still in need of models improvements.

All these forms of correctness lie along a continuum. Today’s models can’t assess what’s needed in a domain for work to be “good” - but if current trends hold it’s just a matter of time.

3mo agoHN ↗

These guys live in their heads, so when the world changes, they invent reasons why they’re still relevant.

What’s the truth, though? Are we still relevant?

My experience is that three years ago, when this kind of AI work first started becoming usable, I had to talk to the AI a lot. I had to review a lot. I had to change a lot.

These days, I talk to the AI less and fix less, while the amount and quality of the output we make together has gone up and the time required has gone down.

That suggests to me that AI is like a coworker coming up through the ranks. At first, it was like a capable, hard-working junior: useful, maybe even like a small team, but still making lots of mistakes and needing a lot of communication. Now it’s mostly on board. It almost always knows what I’m talking about, but not always. I have to fix less, but taste, architectural judgment, and domain knowledge still matter.

I’m aware of the value of my domain knowledge in browser instrumentation, and the nuances of CDP commands that may never have been documented anywhere. The commands are documented, but their quirks, behaviors, and the way you can combine them to create a working system are not. I can still suggest things to agents that help them.

I don’t know if that gap is closing. I do know that I’m learning less new domain knowledge because I don’t have to be in the code as much. But I also know my hard-won technical nuance and architectural lessons still matter. Maybe agents will eventually be able to hit iteration repeatedly until they figure all of that out. That seems more likely as they get more capable. But that’s still a hypothesis. I haven’t seen it directly yet, just a vague sense of where the capability is going.

With advances in memory and the models themselves, I don’t see why they don’t end up with something like that. And I agree with the top comments: the goalposts are always moving for the people trying to redefine their own relevance in a changing world.

The main pattern I’ve noticed in myself is that I spent years, really a decade, chasing down random bugs in the web platform, JavaScript frameworks, and browser instrumentation. I was very deep in that for a long time. That helped me build the products I built.

But over the last three years, I’ve started growing in a new direction: big-picture business, go-to-market, sales, and marketing. I guess that’s adaptation. You spend a decade building technical IP assets, and then you can build more of the same because you have the domain knowledge, while working with agents to massively increase the speed of production.

The situation feels analogous to having hired a small team of capable juniors three years ago who have now grown into A-players. If that had happened, we’d have the capability we’re operating at today. It’s just that we’re using AI and paying a lot less for it.

That’s my experience building a set of large, highly nuanced technical tools around the web platform.

AI changed the shape of my company. I migrated into a role where I’m not just doing the taxes every year or writing all the code myself, but thinking seriously about marketing, GTM strategy, and sales. For me personally, my evolution is in that direction now.

That doesn’t mean I’m not still growing in product sense or technical judgment, but it’s very different from the deep technical stuff I was in before. Now I’m freed up to focus on other parts of the business.

A fun benefit is that I get more time to rapidly build things that interest me: little side bets that may just be fun, or may actually become cool products.

The transition into sales and marketing is new to me, but I welcome it in 2026.

I think AI may be easier to deal with if you have your own small company than if you’re watching it affect your job inside a workplace. I’m not sure. I’ve heard people say good things about that too.

I’m not making an argument. I’m not trying to convince anyone. I’m just sharing my experience.

3mo agoHN ↗

The mechanical skill you sweated for, turning a clear idea into clean code, has gotten dramatically less valuable.

But that was never the hard part!

Come now.

After twenty plus years as a professional software developer I can name two hard problems, not more. One is related to the article, the other is not:

1. Getting that clear idea out of a stakeholder's brain. Traditionally this would be a specification but doesn't need to be that formal. Remember, remember the first panel of https://i.redd.it/i2aeyrivmjoz.jpg An LLM doesn't help here because it doesn't push back. It'll do whatever you tell it to do even if it's not what you really wanted. The software developer here operates very similarly as a translator and it always has been true a translator who speaks both sides well will be able to do the highest quality work. This is not at all new. It always has been the advice that if you know things like, say, logistics and software or any such pair then you'll be well off financially either because you can do this translation well or because you realize what's missing and can do a product for it.

2. The other problem, of course, is debugging. Since LLMs fundamentally work from a training set any debugging problem not blatantly obvious to a sr developer is hopeless for them.

3mo agoHN ↗

As someone who has jumped from one industry to another: I'm sorry, but domain expertise isn't much of a moat. Yes, it takes a while to learn a particular industry/business, but it doesn't take that long, and worse still: one advantage that LLMs have over us humans is they have such a broader inventory of human knowledge at their disposal. I've literally used LLMs as product managers for new domains, and while I see the rough edges that LLMs have, they always have significant domain expertise.

I don't think that's the moat.

3mo agoHN ↗

In my own experience this is 180 degrees from reality. As a generalist, feeling out the depths of a single domain (something I've been forced to do at least 50 times in my career, to the point that I'm probably a global expert in at least 2-3 things I don't actually care about, but are poorly documented and not especially lucrative on their own) is something that's basically a bunch of Google searches, reading source code, and writing/running tests manually, none of which I really care about short of getting to "the right solution."

Meanwhile, as a generalist who has a basic understanding of general things, everything from how to design efficient network protocols, to how cache lines affect the performance of sorting algorithms, without being a real expert in any of those things, I act as a constant course correction for AI agents doing work on my behalf, in a way that LLM context windows simply cannot replicate.

To give a concrete example, I recently used agents to build a specialized sync protocol that broadly resembles Dropbox. It's nowhere near as efficient in terms of how blocks are synced (because it entirely happens on a LAN and the cost difference is minimal), but I constantly had to make objectively more valuable course corrections on how the sync actually traversed the participating nodes. If I'd just let the LLM drive, it would have come up with a reasonably efficient algorithm (better than I probably would have done on my first try in the same timeframe) that would have had an obvious (to me) single bottleneck.

3mo agoHN ↗

Domain expertise has always been the path to advancement in most SWE jobs. You’ve always had to understand the domain and have judgment to not be stuck as a “code monkey” in almost every company barring the big tech outliers where you can be on a generic framework or library team.

3mo agoHN ↗

To me, the bottleneck feels like it's shifted. It's no longer 'can we build this?' but 'should we build this, and why?' Strategy might be the last thing AI can't do for us at least for now

3mo agoHN ↗

This is why Google is pushing SEOs to get their clients to codify and publish their domain expertise: while it gives them a way to filter signal from noise/slop right now (supposedly helping to "improve search experiences"), it also simultaneously extracts that experience into a consumable form for later training.

They really do want to know the ins-and-outs of the HVAC service business, for example, because they hope their agents will be handling it in a few years.

3mo agoHN ↗

Domain knowledge is not the moat it might appear to be, especially in industries that heavily document

Using AI to more rapidly learn a domain will help in the short term

But in the long term, all moats will evaporate

3mo agoHN ↗

Maximal Point of View that is harder and harder to disagree with: Sharing your domain expertise is asking to get yourself automated away. Already, if any company hasn't begun trying to maximally collect data on every aspect of their employee's work, they are asking to get wiped by future automated competition from companies that learned everything they could from their employees, then replaced them. Open Science? Open Source Code? Shared your art online? We were all suckers, and might be the first to go.

3mo agoHN ↗

Domain expertise is neccessary but not sufficient.

It takes a LOT of time to validate every path, possibly an infinite amount of time, depending on the complexity of the domain.

3mo agoHN ↗

Whenever I read articles like this one that appear to be very generic and give advice about dealing with AI, I remind myself that he software industry is like the construction industry.

It will never be organized, never fully optimized, and it will always be custom — because it has to cater to the reality of wildly different tastes, contexts, and localities. There may be some good tools, raw materials that show up once in a while.

3mo agoHN ↗

Spot on. This needs to be said more, and it’s why a lot of us do it.

3mo agoHN ↗

It's not just domain expertise. Sustainbly great work is done by people with expertise _and_ ownership/accountability.

3mo agoHN ↗

I thought real moat of software is requiring virtually no extensive knowledge/experience of both system and domain. Copying taste and network effect is significantly difficult. The fact is venture backed startups with plenty of talents and resources has been rarely making their positions in the market before vibe coding. That's why people at 20s can compete with experts in various areas. Current backlash is due to creation of guys with just x years experiences in the industry we often see in other mature enterprises.

3mo agoHN ↗

Perhaps the good news is that even the best spreadsheet-slinging accountant in the west would still going to need some programming experience to do their verification.

I mean, they could ask an LLM "what does this code do, and will it always X when Y", but that's just nesting the verification problem inside another verification problem.

3mo agoHN ↗

I started an agentic experience app in domaining , people don’t seem to take it that well , they are afraid of letting AI run on its own.

3mo agoHN ↗

"So the most valuable person in this new world is the one who has both skills because they can verify at both layers. They know the generated code is sound and they know the answers it produces are true."

This has always been true since the dawn of programming.

3mo agoHN ↗

Yes, but most people (especially a large portion on HN and Reddit) do not internalize it.

A SWE who has always worked in DevTooling companies will always be preferred by DevTooling companies over a generalist. A SWE who has always worked in AdTech will always be preferred by AdTech companies over a generalist. etc etc.

Software fundamentals - though useful - are table stakes skills at this point. No business wants to deal with the headache of on-ramping employees who have never worked in a specific domain or industry because it takes too long for a generalist employee to build the intuition needed to understand that segment of the industry.

3mo agoHN ↗

And therefore there will be a huge knowledge gap as companies refuse to hire anyone who hasn't worked in the field for 5+ years and people who want to work in that field but haven't don't get hired.

3mo agoHN ↗

Not really. Most people continue to remain in a specific domain from their internship days, and professional networks develop.

Historically, startups were the traditional path for a generalist to build domain expertise because most startups couldn't be picky with talent, but the market has changed.

In all honesty, too much fat did develop in the tech industry over the last 6 years. Traditional hiring pipelines (eg. Limiting early career recruiting to grads from top 10-20 CS/ECE/EECS programs nationally along with Vets and some grads from decent regional programs) still net good calibre talent worth their weight in gold, but others just aren't working out.

3mo agoHN ↗

I'm afraid you appear to be contradicting yourself by saying internship in one comment and stating that companies don't bother with onboarding employees with no knowledge in a previous comment.

3mo agoHN ↗

An internship is fine for onboarding becuase you aren't paying a FT employee level salary or benefits, and expectations are your hire is still learning but has some aptitude or interest in becoming a domain expert.

On the other hand, hiring a mid-career SWE who spent much of their career in one domain who is transitioning to another is a significant risk without additional social proof such as referrals where someone actually vouches for their skills.

3mo agoHN ↗

Software fundamentals - though useful - are table stakes skills at this point.

I'm having a difficult time even seeing what we're talking about here. I see "seniors" in our industry that don't know what I would call the fundamentals of programming or software development; apparently not all fundamentals are created equal.

3mo agoHN ↗

No business wants to deal with the headache of on-ramping employees who have never worked in a specific domain or industry…

The usual sickness. If you don’t train people to become specialists and just expect them to fall from the sky, it’s only a question of time until you run out of specialists.

3mo agoHN ↗

The tech industry is significantly larger now than it was a decade ago. Large self-sufficient talent pools of SWEs, Designers, PMs, PMMs, and SEs/AEs exist for most subsegments of tech now.

Additionally, limiting early career hiring to to T10/20 CE/CS/ECE/EECS programs (they tend to graduate around 10K students a year), veterans (they tend to have the "can-do" and fast learning mindset needed), and a couple regional schools is more than enough to build a self-sustaining early career pipeline for just about any segment of tech indefinitely.

3mo agoHN ↗

Cannot agree.

Whole TFA doesn’t take into account reason why software development was actually so valuable.

Single specialist in any domain is not that valuable. You may charge $200 for hour of his time sure. But to grow company you now need N specialists.

What software was doing was not making specialist obsolete replacing a specialist by encoding his knowledge - well many tried to do so but failed even in 80’s “expert systems”.

What software was doing was making it possible to structure specialist work, make it possible for a single specialist to serve more customers at the same time, make it possible to hand over work in a structured way to junior specialists, making it easier for senior to take over edge cases and spot check work of those junior specialists.

This setup allows company to not being tied to number of specialists to grow, this setup allows company to charge less per customer but take over more of the market share.

Whole premise that now each specialist will waste time dabbling in AI software development is ludicrous, especially if each specialist would be building his own tooling somehow.

3mo agoHN ↗

That sounds more like the extractive setup of corporations like IBM, where return/specialist must be maximized against the number of clients that can be juggled simultaneously.

Whereas in larger technology firms, yes that happens to some degree, but only with the highest level specialists such as PEs, fellows, etc.

They are already so wildly profitable and valuable by the simple nature of computing itself: it scales second only to money with regards to compounding effects. Once you have software someone can use, it scales near infinitely to more users, thus value is extracted from the work of a single specialist for all time. No need to complicate it with trying to abstract work juniors can do (and fail) and then have seniors correct. What would they be doing in non-extractive firms?

3mo agoHN ↗

I have never yet had a set of words that I have grown to hate so much - “taste” and “moat” being at the top of them. It is almost always coming from people who have or know about neither.

(Agree with the article’s general sentiment - but just wanted to make this tangential comment)

3mo agoHN ↗

Brilliant framing. If you understand a domain and understand software architecture then you are in an extremely strong position right now.

3mo agoHN ↗

I'm such a generalist. During all my career, from support to decades of C-level, I was equally challenged by domain and IT people for not being deep in everything. But whenever they couldn't come up with a compromise, I was the person who always offered it. Doing purely consulting work now, mostly implementation. And this "little bit of everything" can be strongly multiplied by AI tools, since I already know what exactly I want to achieve, I just need speed and a cross-check.

3mo agoHN ↗

While I agree that domain expertise has always been a moat, I believe the author is missing something critical: there is a big difference between being able to verify the output of a system is correct, and being able to tell a system how to generate the correct output to begin with.

Personal example: I had a software engineering colleague who was the best coder of financial management systems I've ever encountered. He gained these skills through years of in-the-trenches development. One of the things he told me, and that I also observed, was that the vast majority of financial experts (basically, the people in the accounting department of companies) had an extremely difficult time just telling him what the rules of any particular transaction should be. But what they could do was tell him whether the handling of any particular transaction was right or wrong. So often times he would sit down with these accounting folks and go through lots of example transactions he came up with, and from there he essentially built up the requirements spec.

In my experience, that is the primary difference between people I've known who are good software engineers and those who aren't: people who can specify the detailed rules of any system, vs. folks who take a "well, I know it when I see it" approach.

I have a strong suspicion that folks who have a high degree of domain expertise in a particular area will fail as software builders even in an agentic world because they will struggle to elucidate clearly the rules in their head that they've learned over years. As an analogy, it's kind of like asking a native speaker for the grammar rules of their language. Often times they can't, but they'll just say "well, that sounds wrong." They may be "domain experts" in their language, but they'd have a hell of a time prompting an AI system on how to grade a test for grammar correctness.

3mo agoHN ↗

I think that you raise some excellent points here. I want to dive deeper into what is meant by domain knowledge -- as a I see it. This phrase comes to mind: "Those who know, do. Those that understand, teach." (Google search tells me that it is frequently misattributed to Aristotle.) People who cannot clearly articulate rules for their domain only "do". However, those that can clearly articulate will "teach". Thus, I would say true domain knowledge is the ability to teach that domain to others.

3mo agoHN ↗

I largely agree, but want to note that there’s the counterpoint “Those who can, do; those who can’t, teach” (from George Bernard Shaw’s 1903 play Man and Superman), which also has some nugget of truth in it.

3mo agoHN ↗

Case on point is Youtube where a lot of almost good amateurs give a lot of advice on niche channels on things they hardly master.

3mo agoHN ↗

I guess the flip side to that is the iterative conversation to develop these specifications is exactly what AI chatbots are good at.

It's also the main reason why very structured AI agent orchestration for software engineering modelled on rigid processes fails to really provide much value.

3mo agoHN ↗

I suspect that the reason AI chatbots are not very good at developing such specifications is that they don’t build a domain model in their “head” — the only models they have are already hardcoded in their weights. A human learning a domain, on the other hand, forms new neural connections representing the model of the domain that they build in their head.

3mo agoHN ↗

Chatbots are good at helping humans arrive at the specification. Apart from people that has deep expertise and/or talent in this area, humans aren't very good at building these specifications. That's the topic of this exchange.

3mo agoHN ↗

I disagree, unless it’s about a topic the LLM already knows or can research based on public information, or unless the domain expert can actually judge the specification and have it iteratively corrected by the LLM until they are satisfied. That’s generally not the case, and LLMs aren’t good at controlling the iteration themselves until they are satisfied, with the result being a complete and accurate specification for the domain.

If LLMs were good at that, then for coding we wouldn’t need to precisely specify what we want them to code, instead they would ask us until it’s crystal clear what precisely we want in all details.

3mo agoHN ↗

Yes. The author stumbled on the p vs np problem but with humans. Verification is easy. Solving is the millennium prize question.

3mo agoHN ↗

Agreed. But there is a new dynamic coming to place. Who can execute faster now that we have AIs? I think the combination of (Good SWE using AIs) collaborating with (Domain Expert using AIs) is the winning team. Things are accelerating on all fronts, the frontier may be jagged but AIs is making progress on all capabilites.

3mo agoHN ↗

Additional iterations are valuable, if and only if we learn from additional iterations. Otherwise we are just spinning our wheels.

3mo agoHN ↗

I agree that it has some resemblance, but the striking thing about NP-complete problems is that an efficient solution to any of them is an efficient solution to all of them, which makes it worth trying exceptionally hard to find one.

It could be that whatever lackluster expertise you can squeeze out of an LLM is good enough to discourage investment in the real thing since unlike NP-complete problems, expertise isn't generalizable.

3mo agoHN ↗

I agree with your point that people “from” the domain aren’t automatically equipped to start AI-building software in the domain, exactly because they often lack one of the most crucial software development skills — being able to (and having the desire to) describe a complex system with a finite set of deterministic rules.

But I don’t think we should be calling these people “domain experts”. I think we should reserve that name for the other group, for the people who truly and deeply understand the domain, the whys and whats and why nots.

3mo agoHN ↗

You're doing a bit of a "true Scotsman fallacy" here.

3mo agoHN ↗

It feels like without a bit of true Scotsmanship, the term “domain expert” doesn’t really mean anything.

3mo agoHN ↗

Sure it does, it’s just a highly contested meaning that depends on a proper contemporary interpretation if to be received as intended in this context. Context that varies domain to domain. For the domain name buyer it’s quite different than the metacognitive scholar.

3mo agoHN ↗

That ship has sailed. Anyone who works in a field is now considered a domain expert (or "SME") even if they're nothing of the sort. There should ideally be another term that's a superset, but I doubt it would ever catch on.

3mo agoHN ↗

People you say are not experts are fully capable to explain whys and whats and why nots. In more details that you can absorb.

They will do that on examples tho. They will recognize and explain every single exception they see - but they are not able to list all exceptions up front. Because, that is highly unusual task

3mo agoHN ↗

Agree. If you can't explain it to someone else, you don't really understand it yourself. These people are practitioners not experts.

3mo agoHN ↗

But I don’t think we should be calling these people “domain experts”. I think we should reserve that name for the other group, for the people who truly and deeply understand the domain, the whys and whats and why nots.

I've spent a lot of time in my career extracting info from the business and I think most do understand the whys/why nots but aren't practiced at organizing all of those decades of experience into a higher level abstract model that can easily be communicated.

It's typically layers and layers of information with dependencies in many directions littered with exceptions. Just like our software design+dev experience, it takes a lot of practice to try to organize all of that info into a coherent presentable model.

3mo agoHN ↗

One of the things he told me, and that I also observed, was that the vast majority of financial experts (basically, the people in the accounting department of companies) had an extremely difficult time just telling him what the rules of any particular transaction should be

We have internalized more knowledge than we can explain sounds like the textbook definition of Polanyi's paradox:"Polanyi's paradox, named in honour of the British-Hungarian philosopher Michael Polanyi, is the theory that human knowledge of how the world functions and of our own capability are, to a large extent, beyond our explicit understanding" [0]

[0] https://en.wikipedia.org/wiki/Polanyi%27s_paradox

3mo agoHN ↗

Thanks so much! I hadn't heard of Polanyi's paradox before but it is exactly what I was talking about. The Wikipedia entry even highlights the problem for AI-driven development:

Polanyi's paradox has been widely considered to identify a major obstacle in the fields of AI and automation, since programming an automated task or system is difficult unless a complete and fully specific description of the procedure is available.

3mo agoHN ↗

I'd say the opposite in some ways: it's arguably the reason for the bitter lesson and ML techniques tending to beat other approaches, because they work by giving examples as opposed to trying to articulate the rules in an explicit manner.

3mo agoHN ↗

having worked on automation of accounting process, it has been a combination of ever evolving ruleset/edge scenarios for 10% cases plus standardised rules for 90% of the cases. i think the problem is that it is an evolving field. alot of times it borders law, which makes it murky and vague too.

3mo agoHN ↗

This reminds me of that quote about how if our brains were simple enough for us to understand, we'd be too simple to understand them.

3mo agoHN ↗

I have a strong suspicion that folks who have a high degree of domain expertise in a particular area will fail as software builders even in an agentic world because they will struggle to elucidate clearly the rules in their head that they've learned over years.

Maybe they need a build a hybrid expertise of "domain" and "software engineering". For example, robotic surgery requires expert surgeons to build sufficient expertise in robotics

Also, noticed a pretty high karma for a throwaway account.

3mo agoHN ↗

Some companies use product managers for this purpose. They translate the implicit domain knowledge of those experts into explicit requirements, mostly through interviewing.

3mo agoHN ↗

This is the exasperating part about learning to speak Spanish using a textbook; you must guess the grammar rules because the textbook won't tell you. So, you use the English rule and hope and pray that it is the same in Spanish, and you'll be right the majority of the time but often wrong. Spanish textbooks written 100 years ago tell you the grammar rules and are more useful than recent textbooks.

3mo agoHN ↗

While interesting, I rarely found knowing grammar rules beyond some very basic ones to help all that much for learning to speak a language, compared to language exposure and speaking practice.

3mo agoHN ↗

I would be very surprised if there was even a single natural language with a complete grammar that actually describes the spoken language. It's all just conventions. Lots of people confuse common patterns with rules.

3mo agoHN ↗

I’ve noticed this too. Any idea why modern language books get this so wrong?

3mo agoHN ↗

You described reasoning by analogy, which two thirds of the population does.

3mo agoHN ↗

Please explain explicitly what you are implying, because I don't get it

Who are the 1/3 of the population that does not reason by analogy?

3mo agoHN ↗

Instead of needing a familiar metaphor to understand a new system (reasoning by analogy), they grasp the core conceptual mechanics directly.

It’s not that the 2/3 can't think abstractly, it’s just that they use analogies as a temporary processing step to get there, while the 1/3 starts there.

3mo agoHN ↗

The parent completely made up a statistic and then confidently restated it when pressed lol.

3mo agoHN ↗

Having worked with domain experts I concur on the difficult time they have expressing the rules of their domains.

Once I built a little domain-specific language for them, that was tested against old jobs to see if they contradicted the past; it was a nifty project and since then I am convinced that DSLs are underrated as a way to encode expertise.

3mo agoHN ↗

Can you give an example (even if contrived) of how that would have looked ? I’m very curious !

3mo agoHN ↗

I had the experts write markdown files that contained the rules looked somewhat like:

## 1A Rule name

Some prose explaining the rules liking to official documentation.

``` if municipality and inhabitants > 10000 then functionA else functionB ```

Then a trivial parser would extract the rules, the DSL was then handled by Lark[1]. So pretty simple, but it made collaborating with experts easier as simulated results would also output some markdown they could read.

1. https://lark-parser.readthedocs.io/en/stable/

3mo agoHN ↗

Sounds like "Literate Programming", where the code and comments are reversed: instead of everything being code except what's marked as a comment, everything is a comment except what's marked as code.

3mo agoHN ↗

I had the same problem in air travel industry. Our ticketing officers were never able to communicate how the ticket commission rules from our partners should be interpreted. I ended up adding a test framework, that allowed to add examples and counterexamples of existing flights to each rule, to verify that they are applied the way they'd assign commission by hand.

3mo agoHN ↗

I fully agree here. It's also not uncommon to have the reply for specific items be "Ahh, well that is a bit of an edge case see because of X and Y" and then you learn there are many many "special cases" to the point that they aren't that special anymore.

3mo agoHN ↗

This comment brings back memories of a project.

We were working through many complex business flows and running into exactly what you describe in many areas. Some of the project people with less experience complained that we were spending too much time on exceptions and slowing down the project. We had to explain that when each exception happens 100 times a day with significant impact on business productivity, then it doesn't matter whether you call it an exception or not, it's important to solve for.

3mo agoHN ↗

Anybody who has ever done programming professionally in the small scale knows this. Refining the requirements is the job.

In fact, I've never known an industry so keen on levelling its own moats as the software industry. We regularly invent things like 4GL, graphical programming and frameworks and engines such as Unity just to enable more people to do programming. People will happily teach programming for free in outreach programs (I am just one example). No other profession does this. Perhaps with the exception of mathematicians and other fields that are very close to programming.

I could teach an economist enough programming in a weeks that they could write an ERP module, but I could not learn enough economics in a week to write one. If the language was the barrier, we could invent a more effective one. We invent new languages weekly anyway. Having seen how quickly beginners can make things with Unity or Godot, I seriously doubt an LLM agent could improve much on this. Of course, if the job is writing yet another CRUD React app with a Java or Python backend, then sure, the LLM will be very effective. But compared to doing same app in something like Excel or MS Access? Not that much.

3mo agoHN ↗

We regularly invent things like 4GL, graphical programming and frameworks and engines such as Unity just to enable more people to do programming.

You're right on the money on this.

Earlier this month I went to visit a company for a complete demo prototype of a full one-to-one train simulator trainer mostly designed and programmed by a former civil engineer using Unity engine. According to the company, they could not do it if Unity engine (or similar) is not around because it will be prohibitively expensive to develop.

In a related news, Unity recently released AI eco-system namely Unity AI Suite [1].

[1] Unity AI Suite:

https://unity.com/features/ai

3mo agoHN ↗

the 1 dimensional thinking that's perverse in the industry will be catastrophic.

we don't like doing the hard things e.g training juniors so they can be skilled seniors via good apprenticeship programs i.e on the job. now we r delegating to stochastic parrots.

in terms of systems thinking which is one skill you need to be a domain expertise - very few people are ever curious & are not willing or able to ask critical questions. hence the groupthink that's prevalent in the industry.

no wonder the quality of software never goes up - while the building blocks have gone up in quality. an analogy is like having super strong bricks but making brittle structures

3mo agoHN ↗

I use LLMs daily for coding. That said, I agree with your sentiment. Super strong bricks, poorly put together, makes a bad building.

Another analogy I like is a beginner playing a $100k Stratavarius probably can't produce anything near a professional violinist playing a $50 violin.

Personally I use LLMs to level up my systems thinking. I describe the domain, I have it brainstorm some scalable solutions, I look them up, I bring them up to the team, and we discuss, and I implement. It's a great workflow imo.

3mo agoHN ↗

Everything everywhere does this. All human progress has been making common and accessible the rare and expensive. Universities, online courses, textbooks, etc all exist to make economics as accessible as possible, there’s just a really tight reward loop with programming so your rate of learning it is more tangible

3mo agoHN ↗

I think you are underestimating how hard it is for average joe to learn programming basics. I remember a fellow in high school that just could not accept that = in programming is assignment not an equation (like in high school math)

3mo agoHN ↗

I'd like to believe I have an inkling, having done a fair bit of teaching.

Still, imagine how hard other skills are to acquire. How much civil engineering can you learn in two weeks? How much violin playing? But you could absolutely get basic grasps on a general purpose programming language. With something specialized like Unity or Excel you would get tons of useful output.

The hurdle around assignment operator is as old as symbolic languages. That's why legends such as Niklaus Wirth wanted to use another operator, ":=", a notation that is still being used.

Anyway, it can be a hurdle, but one I find that most people get over pretty quickly.

3mo agoHN ↗

The hurdle around assignment operator is as old as symbolic languages. That's why legends such as Niklaus Wirth wanted to use another operator, ":=", a notation that is still being used.

Well, sure; but more generally, the ability to accept other meanings for symbols (and keep subtly different symbols straight in one's head) is a mental skill, and individuals vary in their aptitude for it. (Presumably, this one is also relevant to natural language learning, since one must reckon e.g. with false cognates.)

3mo agoHN ↗

Nah I just think you are so overwhelmed that "=" having a different meaning lh and rh is just too much. It is hard to remember how hard it was.

3mo agoHN ↗

No, that actually happened. I actually knew pascal used := (I programmed quite a bit of pascal/delphi myself back in the day) but I never knew its inventor ever made a big deal about the assignment operator until I posted this.

But that was just an offnote observation, when I got to college I already knew how to program but MANY of my student peers had A LOT of trouble in the first year grasping the basics. These were not dummy students, they were top ~3% of students in the college entrance exams.

At least 50% of my class didn't understand pointers properly by then end of first year.

3mo agoHN ↗

This is one of the few mistakes K&R made going from BCPL to C.

3mo agoHN ↗

I remember a fellow in high school that just could not accept that = in programming is assignment not an equation (like in high school math)

The English noun "mist" has a different meaning than the German noun "[der] Mist" (dung, crap). Or the French "[la] infusion" has a different meaning (herbal tea) than the English "infusion" and the German "[die] Infusion".

So, you are very used to the situation that in different languages, terms can have different meaning, so also in, say, C versus mathematics.

3mo agoHN ↗

not to mention the other english word, "missed", which sounds exactly the same.

However, people really do have a great deal of trouble with this exact concept. Its a common test to give to people to define a function with a misleading name, like multiplyByTwo(int x, int y), and then show them the code inside (return x/y) and ask what this results in. Surprisingly many non programmers have a great deal of trouble with the idea that the name can be different to the behavior, especially in cases where its subtly different not entirely like this.

Other fields have similar issues, where people have trouble with this sort of abstract thinking, divorcing abstract knowledge about a thing from its appearence. iirc its a stage in child psychology and development, and shows up in teenage years after puberty. Many adult people never develop it fully, and struggle with this to a greater or lesser extent

3mo agoHN ↗

This is basically the gap BDD tries to close I guess. It assumes that domain experts can't fully articulate the rules upfront.

3mo agoHN ↗

Are we thinking about the wrong side here? Wouldn't the LLM be a super-intelligent financial expert as well as a super-intelligent coder?

3mo agoHN ↗

I have a strong suspicion that folks who have a high degree of domain expertise in a particular area will fail as software builders even in an agentic world because they will struggle to elucidate clearly the rules in their head that they've learned over years.

This is the part I disagree with.

In a non-agentic world, the expert and the programmer are two different people. If the expert finds a bug in the software, they have to describe that bug, send it over to a programmer to fix, wait for a new release and until that scenario occurs again, realize that their description was actually wrong, send a corrected description, rinse and repeat for a few iterations until the bug is finally fixed for good.

In a world of agents, the expert finds the bug, asks the agent to fix it, realizes that the fix is incorrect because of sloppy thinking, does a few iterations until the feature works correctly, and that's it. Bug fixed; with 10 minutes of work instead of a few weeks.

3mo agoHN ↗

In a world of agents, the expert finds the bug, asks the agent to fix it, realizes that the fix is incorrect because of sloppy thinking, does a few iterations until the feature works correctly

That would require clearly (a) knowing what you want, and (b) expressing it unambiguously and in detail, including all edge cases. Essentially producing a spec.

Most people are not able to do either. Talking to an LLM does not change that.

3mo agoHN ↗

but.. they can iterate real quick!

As long as the expert don't run of patience, he may be able to do that.

Consider finance sector -- the industry is powered by excel spreadsheets made by non-programmer having no clue how programming works.

3mo agoHN ↗

Spreadsheet is a DSL for finance and a lot of other sectors. But the lack of formal logic capabilities shows when you seen the spreadsheet organization. Most only stand with ducktape all over the place.

3mo agoHN ↗

realizes that the fix is incorrect because of sloppy thinking

If the domain expert doesn’t understand the generated code, they can only discover incorrect logic by specific examples (specific inputs), which is usually impossible to do exhaustively. The programmer, on the other hand, can see incorrect logic directly, generalized over all possible inputs and states. It’s the difference between testing and proving correctness.

3mo agoHN ↗

So often times he would sit down with these accounting folks and go through lots of example transactions he came up with, and from there he essentially built up the requirements spec.

Right, so the spec is derived from examples, an interactive process that doesn’t require a programmer.

3mo agoHN ↗

The programmer skill is how to abstract the specs from all the examples. And then to formalize it. Actual coding is merely translation. And only beginners tend to focus on that.

3mo agoHN ↗

May work for simple cases, but how would you come up with something like typst, or thunderbird?

3mo agoHN ↗

I've yet to see AI be good at extracting good abstractions. More often than not it jumps to creating a battery of special case checks.

3mo agoHN ↗

No. AI sucks at formal languages and implications.

Lossy decompression probably won’t ever be really good at this. If it’s missing from the data, then it won’t be there.

The AI math proofs were probably already out there in tiny pieces and nobody got all of the pieces together. That is valuable. It’s different from making a piece that is missing. And the AI will just hallucinate.

3mo agoHN ↗

Interpolating between the examples still requires understanding of the domain for the interpolation to be a sensible one. And it’s an iterative feedback process: thinking about possible interpolations leads you to cases that need clarifications from the domain experts. The domain experts won’t come up with all relevant examples by themselves, and they typically aren’t as good at thinking about interpolations like a developer who is trained to always consider all possible cases; they don’t think in terms of models the way a developer does.

3mo agoHN ↗

LLMs already have interactive discussions with me on the topics I engage with, including asking expansive questions, so I do not think this is beyond the realm of the technology.

3mo agoHN ↗

Talking to CPAs never gets you to Pacioli groups.

Talking to engineers and mathematicians gets you there.

3mo agoHN ↗

I think the answer is in the second sentence of the article. The most valuable person in this new world (using the author's own phrasing from the penultimate paragraph) is the one who is good at "building a working model of the domain in [their] head".

Depending on the domain, this may either be the domain expert themselves, or someone else trained in formal logic, data structures and organizing information into coherent hierarchies. If this is neither the domain expert nor the programmer, then it must be someone in between. In the old world, this role was called "business analyst".

3mo agoHN ↗

I'm this person, and I do find AI to be quite helpful, though I'm mostly just playing around at this point.

I'm the daughter and granddaughter of programmers, and I learned the basics of how to code as a kid. I'm good at it and have a knack for it, but I didn't want to do it for 8+ hours a day and then spend my nights on it as well, so I didn't pursue it as a career. I did an undergraduate degree in Linguistics, which has been really helpful for having an intuitive sense for what 'language as data' can accomplish and for a strong understanding of the difference between language as data and language as meaning. I studied formal logic systems. Then I did a graduate degree in Library Science and worked in libraries for a decade and a half.

I can organize and define systems very well, and I'm trained in how to wheedle information people don't consciously know out of them without them knowing I'm doing it. I've spent enough time around actual devs to understand where my limitations are and when to loop in someone who knows more to check my work, and when it's important for the work to be super accurate versus when I can learn by fucking around. (Front end and design? Fuck around! Database structure? Fuck around but with an exceptionally robust backup system kept outside of the AI tools' purview + don't fuck around in prod. Storing credentials and people's information? Ask someone.)

The problem companies are going to have is I'm very disinclined to work for them doing this, particularly if they want us because they think we're going to be cheaper. Most people who are in this category a.) could be devs and opted not to, and there's a reason for that and/or b.) are the children, cousins, etc. of programmers. We're not stupid: we know we're just as disposable as they're trying to make devs.

3mo agoHN ↗

Having descended from a humanities social background and blundered into professional programming rather incidentally, a lot of this resonates with me.

I've frequently been credited as a person who can really string all the disparate elements of tacit knowledge together into a unified fabric in our particular subdomain, and helped a lot of people plug Swiss cheese gaps in their knowledge that way and come away with the feeling that it's all been tied together theoretically.

However, it's not immediately obvious to me how, in our LLM psychosis cultural moment, this facility shoots to the top of the value chain.

3mo agoHN ↗

In theory, it's because we're going to be better at steering an LLM in some ways. A lot of the friction and hold up in building comes in the communication between people/departments/organization. If you eliminate that by holding the knowledge in one person/department, you see an efficiency gain.

What they're not saying is that they think we're more valuable because they think we'll be cheaper. They think they can have us do 2 jobs and pay us for 1: probably less than a decent SDE made in 2019.

Personally, I think it's likely to be a shitshow and backfire if that's how companies decide to try to go that route (especially the largest ones). First, if we wanted to be devs, we would be (like you). Most people with the knack for programming and thinking in systems know they have that knack, and if they haven't jumped ship to SDE before now, there's a reason. I could definitely hack a junior SDE role, skill wise, but I don't want to. Second, finding people like us is difficult. The hiring process (which is becoming more and more Gilliamesque by the day) is really bad at identifying us. There aren't credentials, and this sort of work tends to reside in the gaps, as you identified. It's harder for it to show up on a resume. Hiring is optimizing for exact matches and experience, and that's the opposite of how this skill set actually functions. I've found these skills are best developed by being placed in a room where you know very little about what's going on and forcing you to develop heuristics and approaches over time for getting that context. Thirdly, I can't speak for you, but I've developed this perspective over decades and if people want it, they're going to pay appropriately. If they think I'm going to do any of this at my current salary level, they're deranged. And lastly, while most people in our position might roll our eyes at some techie discussions and culture, we do fundamentally like techies/devs and we tend towards placing a greater value on things like relationships than a pure SDE does. (Just speaking in generalities). So 'is willing to replace and/or toss out a category of people I like and respect' is a hint to us to start out assuming this is a hostile negotiation. (Whereas SDEs as a cohort over the last 20 years extended a lot of goodwill at first). We're far more likely to work somewhere, get enough domain knowledge, and then bounce to start our own thing, especially since as a population we're more likely to have devs who will work with us as non-technical founders. Someone who's decent at marketing/sales/the stupid 'people stuff', understands a domain, and understands when a proper dev tells them what is and isn't possible and can even help with some of the most boring, rote parts of the technical side if needed/in crunch is an excellent non-technical founder, and as a group we're also more likely to have access to the technical connections that we'd need if we wanted to build something beyond our ability.

3mo agoHN ↗

This is an underappreciated bit of insight and perspective, and I thank you for sharing it.

Thoughts that really stood out for congruence with my own experience:

Most people with the knack for programming and thinking in systems know they have that knack

Hiring is optimizing for exact matches and experience, and that's the opposite of how this skill set actually functions.

I've found these skills are best developed by being placed in a room where you know very little about what's going on and forcing you to develop heuristics and approaches over time for getting that context.

We're far more likely to work somewhere, get enough domain knowledge, and then bounce to start our own thing

3mo agoHN ↗

which has been really helpful for having an intuitive sense for what 'language as data' can accomplish and for a strong understanding of the difference between language as data and language as meaning.

100%. I think, intuitively, software developers understand that there's a strong connection here, but most fail to translate that into practice. It always amuses me when someone comments on the triviality of creating CRUD apps. Setting aside the fact that people usually get the mechanics of it wrong (despite it being a solved problem), they overlook the difficulty of producing a good information design.I've developed software in a variety of industries, and I would say maybe 5% of the designs I inherit are well-done and represent the concepts they're trying to model in an elegant, parsimonious way. Rather, most examples are replete with ambiguity, orthogonal concepts smashed together into single elements, and misleading naming and relationships.

3mo agoHN ↗

This is so true.

And even when there is a well laid out information design, it often is laid out from the wrong point of view. Elegant information design should create a pattern subconsciously enabling people to build a mental model of the tool they're using without realizing they're doing it. But software whose information design works wonderfully from the point of view of a SDE is not going to be approachable to the average user. There are so many tools I've used where I can very clearly see the reasoning behind the decisions and the design and use it well and also be aware I could never explain how they work to the average person.

3mo agoHN ↗

Working model suitable for an electronic computer.

3mo agoHN ↗

Domain expertise matters more than most bootcamp grads want to hear. Knowing how to phrase a query for a specific domain is half the battle.

3mo agoHN ↗

I think this neatly captures the gap in the article; it’s thinking of domain expertise as static, rather than something that needs to be built/extracted.

It also goes the other way; A a good engineer can build experiments and discover the domain even without an oracle on the team; reading protocols or manuals or specs, for example. In other words, learn to be a domain expert themselves.

Personally I find the most efficient way to learn a concept to be building it; you are immediately faced with your blind spots. AI for sure helps improve cycle time on these discoveries if you use it that way; time writing boilerplate goes to ~zero and you can spend your time figuring out how to answer the real questions.

I do think that we as a profession need to learn new architectural and craftsmanship patterns to make it easier to learn from our code; concepts like Literate Programming which were too fussy for fast-moving teams may end up accelerating in the agentic world; I need to read a lot more code than I write now. But also things like Acceptance Test Driven Design; not new concepts, just newly increased in value.

3mo agoHN ↗

But what they could do was tell him whether the handling of any particular transaction was right or wrong. So often times he would sit down with these accounting folks and go through lots of example transactions he came up with, and from there he essentially built up the requirements spec.

This combination of requirements is the business in most domains. Software or otherwise. Codefying different rules and executing them.

3mo agoHN ↗

I have found this with (mechanical) engineers. They know what they want to see but don’t understand the underlying details which are more mathematical than the average engineer is able to work with. So the people working on engineering software are often physicists or applied mathematicians.

3mo agoHN ↗

Ran into this, as well.

And they were really annoyed at being asked math questions.

3mo agoHN ↗

That is why coders who learn problem domains are where the money is at.

Works for me.

Already learned two or three problem domains well enough and now it is starting to compound.

3mo agoHN ↗

I very much agree here--the true job of us programmers is determining exactly what the problem is. The domain expert will fail because they haven't attempted to refine the details enough, they probably don't have the skill to anticipate the edge cases.

I've spent most of my career working with the same people--even people who have some coding experience but they never catch the low probability stuff. Or even not so low probability: business procedures were that the customer was quoted an all-inclusive price. Try to work backwards, what is the pre-tax amount? Um, that's not guaranteed to have a solution. My concerns get ignored, I go ahead and implement with code that will catch the offending penny and label it roundoff correction. While I'm not sure what happened I think some auditor hit that. I ended up having to walk them through the calculation, okay, what's the answer here? Only when they couldn't solve the problem could they accept that what I had done was the only answer. (The actual odds of such a failure are equal to the tax rate. I had not originally worked that out, just saw success was not guaranteed.)

The domain experts make this sort of mistake routinely in dealing with code. AI won't fix that.

3mo agoHN ↗

there is a big difference between being able to verify the output of a system is correct, and being able to tell a system how to generate the correct output to begin with.

There are attempts to avoid needing to explicitly construct the rules. This is often called "Programming by example".

https://en.wikipedia.org/wiki/Programming_by_example

On some level, even training an LLM to answer questions is this. I do like my determinism, though.

Vibecoding with human-managed acceptance is a very current-moment way of doing this. Just make sure the agent has to program within a framework, not changing it, and the results are actually pretty good.

One of the interesting things one can do with this mentality, if you set up your system well, is to reevaluate prior decisions with new rules, and decide whether any differing decisions are corrections for prior bad decisions, or newly-introduced bugs.

3mo agoHN ↗

they'd have a hell of a time prompting an AI system on how to grade a test for grammar correctness.

This isn't true. They can simply upload a whole bunch of completed and marked tests and say show me the rules. And follow that up with 'write me a prompt'

3mo agoHN ↗

what people miss is that software engineering is its own language, even the finance expert can code but doesn't mean they should.

3mo agoHN ↗

there is a big difference between seeing that pairs of input and output are correct, and knowing that the system is correct. there are invinitely many in and output pairs and only checking some while you vibe code your tool is never going to be a reliable method

3mo agoHN ↗

While the article is interesting, it makes assumptions that are not explicitly stated. And the one strong assumption that makes no sense to me is that they discuss team size = 1. Sure, a domain expert now can use an agent. But he might as well work with a development team, or a developer that uses an agent. That's pretty standard I would say.

3mo agoHN ↗

As a doctor who learned how to program, I started by writing useless Chrome extensions. One thing I learned early was that programmers generally do not like learning the nuances of medicine, and many are quite open about how little they want to learn it. I have tried convincing my fellow residents to learn a simple language like Lua or even just Python, but the resistance is even greater, despite the fact that they constantly express how they have always wanted to learn programming like I did.

I even went as far as setting up their IDEs, configuring their environments, and encouraging them to just vibe-code. It seems that the mental friction involved in switching domains is too high for most people to justify the reward. Perhaps the reward itself is not compelling enough, or perhaps this is simply the limit of adult motivation.

I started programming with Python around the time GPT-3 arrived, when Cursor had generous free tiers and excellent starter plans. A few Raspberry Pis, laptops, desktops, and countless hours of tinkering later, I discovered how much I enjoyed solving problems with software. There is so much to learn from the programming world: the concept of open-source software, the idea that people from anywhere in the world can collaborate on the same codebase, and the fact that many do so with little or no expectation of reward.

As this post points out, in the project I am currently working on—a comprehensive Clinical Decision Support System—it feels almost second nature to translate the rules, hidden rules, social dynamics of hospitals, and the common mistakes that we and our juniors make every day into software. Taking those observations and turning them into systems that work is surprisingly intuitive.

Perhaps the most valuable thing I gained from medical school, combined with my own personality, is the desire to keep learning. I naturally gravitated toward systems thinking, and the path forward seems clear to me: become a true expert in whichever specialties I ultimately practice, while simultaneously becoming highly skilled at systems thinking.

As for systems thinking itself, I find it useful to create rules not only for the codebase but also for the testing harnesses and development processes around it. The goal is to build systems that can enforce quality automatically as the codebase grows, ensuring that standards scale without requiring constant manual oversight.

3mo agoHN ↗

I think this misses something.

AI is going to struggle at building a consistent internal model of the domain into the software unless you’re able to give a structured explanation of the domain.

If you’re just giving it a set of inputs and expected outputs, it’s not going to generalise well and fail at out of sample input, unless the AI already understands the domain from its training set.

Being able to give a structured explanation of a domain (and being able to judge if the internal model of the software makes sense) is not the same as having experience in a domain.

Lots of ppl with domain experience can tell a right output from a false one, but can’t tell you why.

3mo agoHN ↗

blablabla AI usage has to be regulated. end of story

3mo agoHN ↗

From my experience what domain experts are often missing - and at least currently this is also an area where LLMs fail - is the ability to model data and interfaces in a sustainable way and factor in team and domain boundaries.

This is a failure mode that senior engineers have seen a few times throughout their career: They know how certain choices will play out over time... and the kind of problems and roadblocks these choices might cause.

3mo agoHN ↗

Knowing the correct answer to one million instances of a+b, and validating this, does not guarantee that an oracle will use the + operation that's correct over a domain billions of times larger, which you can't exhaustively check.

In the past few months, I've used agents to brute force and reverse engineer solutions to problems I would never have economically have figured out on my own. I did it by putting agents in loops, connected to hardware and the internet, reading technical documentation, and relentlessly trying.

The code was shit. But it's much better to start with working shit and make it correct than spend weeks frustrated that nothing works.

I get that being a domain expert and instantly knowing the output is shit is important, but even if the output looks great, the code can be shit, and it takes looking at the code and knowing something about it to figure that out.

The solution to shit output is not (always, sometimes it is) just another if statement.

Even in a very well specified OSS effort, where I have some expertise, and I carefully reviewed the AI's output every goddamn step of the way, bugs slip through that the agents confidently tell me can't happen, and when shown proof they… add just another if, instead of really questioning assumptions.

You either know what you're doing, or you don't.

3mo agoHN ↗

The article says that domain expertise is more valuable now because agents can code well, but not understand the domain well.

I believe there are domains that are very well encoded. The model very often can know that a shift can't be longer than 11h and if you ask an agent for scheduling software it can surprise the developer by encoding that rule.

Both domain knowledge and coding skills became cheaper.

It might depend on the domain. Highly regulated domains like finance have entire books around how they should work.

However, I agree that verification skills became more important in both areas. A domain expert needs to catch 12h work shifts and experienced programmer needs to catch when the LLM accidentally put a route in a section that doesn't require authentication.

Both require some kind of harness and automatic verifications methods.

3mo agoHN ↗

Highly regulated domains like finance have entire books around how they should work.

Ironically, LLMs are much better at understanding those than humans.

3mo agoHN ↗

Agentic coding favors senior generalists with a broad experience in many things rather than narrow experience in one or two things. I no longer think of myself as a backed engineer. That's what I was. I can do it all now. I've been building products and doing CTO jobs for a few decades now. I'm not a specialist in all layers of the software but I know enough about all layers of the stack to be able to do things with an agentic coding tool.

It helps if you can think at the system level and understand how everything is fitting together, why certain things are better than others, etc. Domain knowledge in multiple domains helps for that. That's what it means to be a generalist. And that includes having the prior experience with having built different types of software. Understanding architectural patterns. Being aware of pros/cons of different solutions. Etc. You don't have to be a specialist in any of this. But you do need to understand things at a high level.

Being a generalist equips you to enter new domains quickly. I've done lots of consulting on search projects in the past two decades. Every project is different. But the technology stays the same. I've built search engines for dating websites, maps, addresses, material scientists, art work, etc. Every project, most of the work is figuring out what the product is about. What good search looks like in that domain. And what they are doing that is sub-optimal that needs fixing. You can't work on search ranking unless you understand that. And you only have a few days to figure it out.

3mo agoHN ↗

Agentic coding favors senior generalists with a broad experience in many things rather than narrow experience in one or two things.

Is it? Agents are coming for generalists first.

3mo agoHN ↗

I would say agents will come for specialists equally hard. It takes a long time for a specialist to build up expertise in their domains. But given enough background material, an AI agent can absorb a lot of the essentials and do productive things in the same domain. And of course a lot of general purpose frontier models have been trained on an insane amount of research and documentation. The only difference between training data for generalists and specialists is that there's a lot more material for generalists out there.

If you are a generalist with a lot of experience, it's not that hard to "specialize" to different domains that you have no direct experience with the help of AI. Effectively that's what generalists do anyway even without AI support. If this includes proprietary stuff, the job is basically making sense of a lot of specs, documentation, etc. LLMs are pretty good at picking apart stuff like that.

A lot of projects I've been doing in the last 25 years have in common that they always require me to wrap my head around a new business domain, new technology, or framework. That makes me a generalist. I got good at figuring out new things and filtering out things not relevant to the job at hand. That's what makes me a senior (that and my age).

I've on purpose stepped out of my comfort zone and targeted a few tech stacks lately that I've not used before with AI. That works amazingly well. My experience as a generalist is helpful, a lot of concepts are not really that tech stack specific and port well across stacks. I don't need to be a Go specialist to be productive with Go anymore. Same with typescript, rust, and python. I've barely touched Kotlin (my go to tech stack until last year) in the last months.

3mo agoHN ↗

So the most valuable person in this new world is the one who has both skills

This has always been the most valuable person. A skilled software developer who is also deeply experienced in their target domain is untouchable. They can always move the ball forward at some rate, assuming they're making any attempt at all.

It takes a really long time to absorb some domains. The most painful one I've experienced is the banking industry. It took me a solid decade in the trenches before I felt comfortable running a status call with a bank's operations staff without a babysitter.

I like to think of this as a sort of cube of capability. The X axis is technical expertise, the Y axis is domain expertise and the Z is physics (ai/tools/computers). The volume of this space is what we are interested in. Scaling up to a wild amount of AI capability with the best developers on earth (infinite x-z plane) is still going to perform like shit (zero volume) if you have no practical domain expertise available.

Specificity, availability and recency are perhaps the most important parts of domain expertise. None of these tend to be in ample supply with frontier language models. You can get a general sense of how a bank operates from chatgpt, but the FDIC would take over your bank in the middle of the first night of operations because you didn't learn the secret handshake (how to interact with your customers, competitors, regulators, etc).

3mo agoHN ↗

There are two different type of domains to be aware of here;

1) Problem Domain Knowledge: This is what people generally mean when they say "domain expertise". This has always been and always will be the moat with/without AI. Simply because this is what understanding and modeling a problem is all about. It abstracts the key concepts/ideas and their relationships in the problem domain and builds a coherent model. This model embodies a set of functionalities with bounded scope and clear assumptions.

2) Solution Domain Knowledge: This is the implementation domain for the above problem. The model arrived at above gives the requirements which must be mapped to concepts/ideas and their relationships in the solution domain. When our implementation domain is a computer system, this takes the form of architecture, algorithms and data structures. The probability of a good solution here is directly proportional to how good a model we were able to construct in the problem domain above.

Albert Einstein;

"The mere formulation of a problem is far more essential than its solution, which may be merely a matter of mathematical or experimental skills."

"If I had an hour to solve a problem, I'd spend fifty-five minutes thinking about the problem and five minutes thinking about solutions."

3mo agoHN ↗

This is just generated slop from Claude.

3mo agoHN ↗

So "the real moat" are BIs and PMs equipped with LLMs? Man will I enjoy seeing this tower of babel crashing down on some heads. Unfortunately, software has tendency to survive for a long time even the shittiest conditions. Taking into account average turnover of 2 years, we're at least 3-5 generations before it collapses, so the people who started this madness will most likely be elsewhere and won't see the reckoning.

3mo agoHN ↗

I disagree.

Having worked across many disjunctive domains the value of "expert in domain" is greatly exaggerated. It's not like search engine doesn't exist nor that it cannot be easily absorbed. Quite often becoming expert is as simple as careful reading API documentation for existing, same domain system.

The piece is heavily one sided and don't recognize the problem of low reliability software: e.g. imagine a software designed in a way that it keeps critical piece of data as a global static variable. This will always work for a single user but will leak with two. Make it semi-critical and e.g. a part of profile loading.

Just as non-expert cannot verify if result is correct from a domain perspective, expert in domain cannot verify the output based on the basic principles (data security, safety, isolation, persistence, etc.) or even know that monetary values shouldn't be kept in floats.

Nothing like article claim had changed outside of a false promise of being productive.

Software engineers without domain expertise can fake it with unreliable results and experts without swe skills can fake it with unreliable results.

3mo agoHN ↗

Although the idea of the main promise of the article is correct - that teaching domain expert to use AI seems to be faster than teaching senior developer the domain, there is and will be a learning curve to learn AI. It still sounds like this article is trying to sell vibe coding in a fancy wording. However, domain expert working in team with senior developer that utilizes AI will be the ultimate combo.

3mo agoHN ↗

While agents are able to take over a large part of code writing, software development skills themselves are still a moat. How to design systems for the future, for team collaboration, for cost efficiency, hosting strategies, security… these are decisions that will still have to be made by a software expert.

3mo agoHN ↗

There is a separate aspect of having domain expertise in that it open paths for a software engineer to make a lateral switch to a Business Analyst role. That in turn opens paths to management track on the business side as one gains deeper knowledge. If you have business expertise AND direct SDLC experience, that is a different kind of value you bring to the table.

Obviously it is a very different kind of track, take a long time to develop and means you are no longer programming but then with LLMs, hand rolled programming has been massively reduced anyway.

3mo agoHN ↗

Sure, producing code has become cheap. Yet again the taste matters and LLMs do not have taste - they will apply patterns that are unnecessary or not extendible, producing unmaintainable systems that nobody understands. Capturing domain knowledge was the crux of development process, but so was verifying, documenting, ensuring that multiple systems work together, maintaining uniformity. I don't know where the assumptions, done by developers, that they only need to produce code that just works or goes brrr fast comes from.

Domain expert can develop working code, but they will not be able to ensure above.

3mo agoHN ↗

Sure, I think the article is basically correct, as things stand right now ... but the problem is that that wipes out software development as a career: software becomes just a tool that domain experts can spin up to make their jobs easier.

3mo agoHN ↗

I find this take off. In general, LLMs collapse a bit of all knowledge work, including many domain experts. I work with domain experts often and it’s usually the most difficult part of the process. Now, I can ask an LLM the questions I need to design the system and have an agentic system help me build parts. And it works, quite well.

The places it falls flat is domain expertise that isn’t well documented, like specific business processes. Knowing something will fail because X in dept A won’t like it and will undermine it (politics) or some silly process I didn’t know about forbids it.

So it’s not domain expertise, it’s idiosyncratic expertise that shines these days. Knowing where things deviate from a domain or the standard and being able to adapt around that. Years ago there’s a group I worked with and I was at the mercy of about 3 people I could ask questions to in order to make sure I was doing things correctly because digging into that domain was time prohibitive. Now, I can sit down one evening and dig fairly deep into a domain. I can understand common practice, approach, acronyms, nomenclature, so on. I can find other popular competing systems. I can rapidly figure out what I need.

The same is true for software, agents don’t collapse software they help people build fairly usable systems but they don’t find the expertise a senior level engineer has where designs or implementations may fail in practice. The idiosyncrasies of software and software systems, especially in your very specific set of constraints you need to operate in that may deviate from the rest of the world.

3mo agoHN ↗

How would you know the agent is correct in domain expertise if you’re not possessing domain expertise yourself?

3mo agoHN ↗

Shallow generic domain knowledge is not really a helpful domain expertise, is it.

Lets take banks - knowing how banks work in general means little for that one specific bank who is paying you, which has different portfolio than most, different processes because everything is homebrew over decades of doing business and they differentiate from rest of the market in many ways and thats their key proposition, different data infra, set of internal apps, protocols and so on. There is no general llm knowledge you can distill in few minutes that would help you much.

You need to know your specific company, no way around it. In fact, to be proficient in those deliveries, you need to know those internal politics, processes, their quirks and so on, 100x more than some code fast delivery since this is majority of any bigger project. You need some reputation to get things done effectively.

This, for some time, won't be something llm can massively improve, unless those companies change themselves.

3mo agoHN ↗

> You need to know your specific company, no way around it

Of course there are ways around it. For example you can build the foundation yourself (which will cover the 80% that is shared across every company in that industry) and give users the ability to build the rest themselves inside the software. This type of abstraction-based architecture is how platforms like Salesforce took off and became ubiquitous.

3mo agoHN ↗

I'm in the position of being shallow in the domain I code for--and I find it a very big help. Knowing what the real world implications of what the numbers become is a great help in understanding what truly is being requested. Just ran into that not too long ago--my code suddenly started slamming a side-cutting bit into the wood. Look into it....years ago there was a bug upstream of me that slammed the bit into the wood. Simple fix: spot the offending pattern, replace it with something sane. The upstream bug was "fixed" (not fully), my simple (lack of true knowledge of what was happening) fix proceeded to undo their fix. Then it got rewritten the way it should have been, a more general recognition of unacceptable movements and how to fix them.

3mo agoHN ↗

I work with domain experts often and it’s usually the most difficult part of the process. Now, I can ask an LLM the questions

And you will not notice the obvious errors in its answers to even basic questions, because you are no expert and should have really consulted with one.

When talking about their own area of expertise, almost everybody immediately notices the glaring faults. But then they are very impressed and take LLMs as gospel when talking about anything else. I do not get it.

3mo agoHN ↗

Domain Expertise Has Always Been the Real Moat

Yes, and the Big AI companies are currently hoarding data about all domains out there.

3mo agoHN ↗

Agentic AI severed the link between the two. You can now produce the software without ever building the model, and that breaks an assumption the whole profession was organized around.

Nah, we’ve always produced software without much understanding of the domain. It’s the premise behind lean: we don’t know much, so get something in front of customers and refine it.

So I don’t believe there’s been a strong decoupling here akin to the degree that understanding the code and writing the code has been.

3mo agoHN ↗

Network effect is the moat not domain expertise. Domain expertise build on network effect (for instance the knowledge of the network) yes, but just simple domain expertise is only a training round way.

3mo agoHN ↗

These kind of posts always miss the point that in a team of 10 not everyone needs to be a domain expert, and that now the same work can be delivered with a team of five or less.

Bad luck for the remaining ones.

3mo agoHN ↗

Software engineering is a domain on its own, just a technical, not a business one. Good luck with looking for a once in a million data race or deadlock bugs. Good luck with synchronizing system distributed over a whole globe. And good luck with keeping your domain knowledge up-to-date while developing and maintaining your vibecoded system. Assuming you can even provide enough details and deterministic specification to AI agent, because understanding business and having knowledge is not equal to being able to write down specific and concise rules to make a system out of it.

And if you think LLM are (or will be) good enough to not care about software part, what makes you think that your domain will not be completely resolved by AI?

3mo agoHN ↗

Very well articulated for sure. But, I do think the word _'expert'_ always tends to do a lot of heavy lifting.

What looks like _'expertise'_ may actually be pattern recognition built through repeated practice. I do believe that is what a model can already do faster than humans.

So, to me, we've got to be cautious here in that what this post implies is humanity must strive to be in the 99.99th percentile of domain knowledge to 'beat' the model. This is perhaps problematic.

I do think focusing on judgement is the only tact discourse here, and I do think that is fine. Once we have invariance well-defined and covered in suites of various types of testing strategies, and are focused on regulation, wouldn't that be a more doable objective?

3mo agoHN ↗

You're right, I'm still not as much of an expert as I would like to be in my field, and I've been doing it since dirt was rocks :0

Pattern recognition was exactly my first objective, but I only had kilobytes so language was out of the question.

The machine would ease the burden on me as far as the pattern recognition was concerned, but I expected to continue to do all of the judgment myself for the foreseeable future until someday when I had more powerful computers.

Very helpful to separate the recognition from the judgment, but I still found it best to perform both simultaneously. That was what I would have wanted AI for, to do both if I could get it good enough for reliable judgment one day.

The code was a transcription of that understanding. Acquiring the understanding was the job.

Well in the mid-1970's almost nobody had the title of Software Engineer or software product manager compared to today.

But "Coders" as a job title were as common as the professional "Programmers", they worked hand-in-hand. The Coders were the ones operating the keypunch machines which took the manuscripts from the programmers plus data from the users and turned it into code on the punch cards so it would quickly run on somebody else's out-of-reach machine without tying it up for very long. Those colossal remote mainframes were expensive. But there was nothing else so what were you going to do? It sucked to be tied to some huge data center though before you could do any programming at all :(

If AI makes some coders of the 21st century feel like they are being bumped down closer to keypunch operators than ever imagined, serving a massive machine they will never be able to own, that would not be too surprising.

You can now produce the software without ever building the model, and that breaks an assumption the whole profession was organized around.

This is exactly what I said back then, but with reverse angst. I was observing all the professions up to that point in time, almost all of which had nothing to do with software or computers at all. Since actual stand-alone "software companies" were still rarer than hen's teeth. With desktop computers beginning to take hold, Bill Gates and backers like that put maximum effort into getting software recognized under copyright and not just patent coverage.

Next thing you know there were two handfuls of software companies which is still pretty insignificant, but that is exponential growth and it can be quite tempting.

That's when I realized if that keeps up, people leading the first wave of computerization are going to start producing "the software without ever building the model", especially with a lot of professions that require decades of domain expertise which can sometimes be more infinitely rewarding to leverage with each accumulated decade.

If it was going to take decades anyway, might as well do it. The idea that computerization was going to take place using purchased software, without so many companies having their own home-grown programming expertise from the beginning, is what breaks the assumption that all other professions were organized around! That in itself was going to leave a lot of money on the table.

The domain expert had no equivalent path, because learning to build reliable software is years of work they were never going to do.

I had already spent years learning to build more reliable code than you could generally get from popular software, because reliability is what I needed more than anything. I wasn't going to spend the years of additional work making my frameworks into things that even resembled commercially appealing products though. If I ever decided to go that route, there were going to one day be high-performance teams having well-honed experience in that area if nothing else. Gave me more time to concentrate on other things.

Even though I had a teenage head start in programming itself similar to Gates during the same 1970's, by the mid-'80's it was not only programming but AI too was plainly going to only get more popular faster than I could keep up. I had already started to do a little ML a few years earlier which really worked, but it was expensive and "nobody" around here could afford it once the oil crash kicked in. It was plain to see that "all I had to do" was wait and any domain expertise I could develop in natural science could be leveraged later on if AI gets good someday. I even explored the neural networks of the 1990's but that wasn't going to cut it either.

And here we are.

If I got a wild hair and decided to launch a (non-mission-critical) "product" at this late date I guess I could consider the use of an AI agent not much differently than I would have engaged with a software team once they became an entity themselves. Same business model from my point of view over the long term.

The most artificial thing in the whole timeline is copyright which lots of massive sand castles have been built from, and that is where this language-model-approach to AI strikes the weakest foundation so far, as the tide finally rises too much to be denied.

One big artificial thing gets ugly when confronting another big artificial thing as they're vying for king of the artificial mountain :\

3mo agoHN ↗

Kernel developer is not the job same as a game developer or an ERP integrator...

But Generalizations aside I think people greatly under estimate how rare is the ability to reduce complex subjects into concrete steps that someone else can follow, human or machine.

Go ask your grandma for a recipe you will find that it never turns out the same, giving her Claude Code is not going to change that.

3mo agoHN ↗

"the binding constraint has moved from can you build it to can you tell whether it’s right."

The company I work for is currently trying to accelerate internal AI adoption, and recently laid off people to help force it. As I've written here before, this merely pools accountability (not removing it) and things will break in unexpected ways as people are not domain experts in these new areas added to their jobs.

I wonder if we will see a large reversal in a few years, or if AI will somehow be able to fix this too

3mo agoHN ↗

Until AI can take responsibility I don't see the accountability issue being solved, hopefully this doesn't just mean humans become responsibility machines.

3mo agoHN ↗

But there's nothing stopping AI from developing domain expertise. If you fine tune a model based on the records of all previous work (effectively "shadowing" the existing workers) then it can easily learn this domain knowledge. The only difference is that AI companies have gone after programming domain knowledge first. Others will come later.

3mo agoHN ↗

If you’re an experienced engineer betting on where to spend the next few years, this is the bet. The mechanical skill you sweated for, turning a clear idea into clean code, has gotten dramatically less valuable. The thing that’s still scarce is a deep, verified model of some real domain. Go get one. Pick an industry, an instrument, a regulatory regime, a physical process, and learn it the way you once learned a programming language or framework. That’s the part the agent can’t do for you, and it’s the part that’s now worth the most.

I'm not sure that even that will remain as valuable or work as a viable moat.

We live in an era of corporate consolidation and absolutely, positively having to meet the revenue target. We also have invested literal trillions of dollars into the AI technologies that made the first skill the author mentions less valuable. However, the result just isn't there. Like the author says, there's a need for domain expertise.

However, you had a bunch of investors plow that trillions of dollars into the current AI boom with the understanding that they could, at the very least, take anyone and have them create what used to take an experienced software engineer, and in far less time and cost, and they invested thinking that the corporate oligopoly would deliver this. They'll now do anything to get that money back. Anything.

If that means telling the corporate oligopoly to tell customers that they need to expect less in the way of domain expertise from the models, well, they'll do that. And since there are relatively few players (the literal meaning of oligopoly) and they all have incestuous financial relationships with each other, they have incentive to hold that line as an entire industry. Development of better tools to create better domain expertise models would take even more money, which the investors don't want to provide, and, short of soaking the public investment markets, can't even find the cash for. Thus, the customer has to lower their expectations if the investors are to not lose their asses on the AI bet.

Something has to break.

3mo agoHN ↗

Notice which way this cuts. Pre-agent, the engineer had a path the dispatcher didn’t: they could go learn the domain. Slowly, painfully, by shadowing experts and reading specs and getting things wrong in production, they would build the mental model and then they could build the system. That path was the whole career ladder in a lot of fields. The domain expert had no equivalent path, because learning to build reliable software is years of work they were never going to do.

Okay, but I've always gravitated towards working on tools and libraries and back-end stuff; as much as possible, the domain for me is software.

3mo agoHN ↗

Things the domain expert on the author's example cant tell (from the top of my head):

- is the app is properly deployed - how will the release cycle be - is it secure? - can we run two instances of it without messing up the orders/routes/whatever? - will we spend 5k/month in vercel if people start using it - how will we notice service degradation - if we change the data do we have downtime? how do we schedule that downtime window. - where is the code stored? can the team access it? - how are new contributors onboarded? - does the app use credentials and where to store them? - does the app manipulate or store PII? - if the user refreshes the app does it generate a duplicate order/route/whatever? - if there's an upstream service are we making sure our timeouts are properly configured? - if there's an upstream service are we making sure our connection pool is properly configured? - do we have a max connection lifetime so that middleware like AWS NAT or ALB don't leave us with dead connections in our pool?

I think that makes the point clearly. Also it may explain why software developer jobs are currently on the rise despite SWE-Bench-Pro-Ultra-Magic has been maxxed for months now.

3mo agoHN ↗

It's funny how out of touch AI is with seeing the big picture of problems.

Here's an example I encountered last week:

Someone in my neighborhood is a 75 year old chemical engineer who likes computers and got into Linux a few months ago. I see him from time to time when walking around, he's a nice guy and overall has a scientist's mindset. He doesn't make a lot of assumptions and tries to think things through but sometimes he has big blind spots in unfamiliar fields.

I helped him install Linux and also hook up an SSD to one of his older machines and now it flies.

On his own he had an old sound card that he wanted to use on that machine. He asked me if the card is compatible. I told him it almost certainly is because the Linux kernel has drivers for a ton of devices. His motherboard's built-in sound card was fine but he likes tinkering with audio in general.

He managed to physically install the card correctly but called me and said there's no sound playing. Then he says he spent 12 hours troubleshooting the issue, using ChatGPT and Googling for assistance.

Over the phone he told me he tried many different things. Installing, tweaking and configuration ALSA, PulseAudio and PipeWire related tools and tweaking everything you can imagine. Nothing worked, no matter what happened, it never played sound through his speakers.

He asked me if I could come over to help so I did.

In 30 seconds I solved the problem.

I went to his sound settings in his desktop environment and saw that his sound card was being picked up. I looked at the back of his machine and noticed this card had 2 black ports with the bigger style jack for headphones. There was no usual green port which is usually used for output. I shined a flashlight to look closer. One of the black ports was labeled headphones and the other was unlabeled. His was connected to the unlabeled one. I swapped it to the other port and everything worked right away.

All of that to say, as a software engineer I have second hand embarrassment that a trillion dollars invested into AI didn't think to respond with "did you double check to see which port you connected the speakers to?". I asked him if AI ever suggested that and he said no, it immediately went into polluting his system with a bunch of unnecessary tools and chasing incorrect rabbit hole after rabbit hole. AI understands nothing.

3mo agoHN ↗

It's funny how well this reflects the contrast in internet advice between Windows and Linux issues. All users deserve advice beginning with thorough sanity-checks and potential quick-fixes before having to dig deeper.

Searching about common Windows issues results in misleading blogspam. Suggested "solutions" resemble blindly applied folk remedies.

I'm no stranger to breaking my desktop Linux after an hour of misdirected troubleshooting and desperately messing with core libraries. I'm still glad I can quickly find my way to ArchWiki.

3mo agoHN ↗

A non technical domain expert might usually lack thought clarity. They might know what is right once they see it but they seldom know how to reach there, even with AI. They will write themselves into slop in 3 days.

The real moat I believe is the ability to hold the the problem in the head, isolate it and mentally design a way to structurally solve it iteratively.

Very few people have it. Much less common with domain experts.

I would rather bet on educating domain to the engineer than teaching a domain expert to architect software.

3mo agoHN ↗

'course, software development itself is a domain.

3mo agoHN ↗

I find the article interesting and (largely) correct in its analysis of how an individual can use AI. What I think is missing is that organizations (like enterprises, research labs, etc), have multiple people and multiple experts in different fields. So you can have BOTH the AI engineer and the domain expert in the field. Not only can you have this but this is actually common in most large companies. The difficulty lies in making the collaboration work and the information flow correctly so that the domain expertise of the expert can flow into the software product built by the engineer.

A mental model I use for this is that we have users, builders and experts when creating AI products. For most individual use cases a person is the user, builder and expert: I make a prompt about how to write code in a way that I like that I will later use. Coding agents moved into the direction of builders that were also experts in the field iterating on a product for third-party users. The next frontier will be finding the right patters for teams to capture expert knowledge handle the collaboration between engineer/builders and experts. Just having PMs handle that interaction will be a super bottleneck.

My cofounder and I are actually working on a project in that direction (https://www.getvalmar.com) --> we'd love any input on how engineers prefer performing feedback loops and getting input from subject matter experts :)

3mo agoHN ↗

My problem with such articles is that they mix the creation of software with the servicing of the software. It can be pretty complex to serve sophisticated software at scale in a cost-competitive and secure manner and it will remain so. So the engineering will remain important and domain expertise will remain important as well, as it has always been. Different business will rely on different combinations of these to create their own specific moats.

3mo agoHN ↗

I don't understand how people keep getting this wrong, a real moat is actually a wide ditch that's filled with water. Surrounding your fortress with this usually makes it more difficult to attack.

3mo agoHN ↗

I am slower than a computer at computation, so why would I compete against it?

While I can, at least partially, empathize with the fact that the changing tide is closing in very fast, maybe we as engineers should lean more into what makes us such, and focus on applying principles in order to build machines.