Writing is fundamentally the transfer of information from your brain to my brain. If you have 1000 bits of semantic information you want to transfer, you can't give 300 bits of semantic information to an LLM and have it fill in the remaining 700, because it doesn't know what those 700 bits are. If it's able to guess those 700 bits correctly, then they aren't true semantic information, and you really only have 300 bits you want to transfer. You might as well transfer those bits to me directly, rather than having the LLM add on an extra superfluous 700 bits that I then have to filter out.
isn't it more like: i have 1000 bits, i transfer 1000 bits but depending on the person, it might be lossy, so they only understand about 700. they then come up with the 300+- on their own, potentially putting them over 1000 or they come back and ask questions to fill in the blank. the bits don't ever have to be bit identical.
Sure, but that seems orthogonal to what I'm saying, no? We could continue clarifying the definitions of information in this context, but my fundamental argument is LLMs don't add information to my writing that couldn't be added by the reader themself.
This of course has the potential to change with personal LLMs that can have shared private context with me. However, that isn't a defense for sending people AI slop, it just turns it from "LLMs don't add value" to "LLMs may add value when used judiciously."
They're lossy. I might make an esoteric reference that no one gets, or an analogy that doesn't quite land, and then have the LLM help me come up with something a bit more understandable to a general audience. There's a difference between dumping the output that you spent 5 minutes with, and taking an hour to craft that perfect analogy.
Depends. If the 700 bits were arrived at by the LLM while spending a lot of tokens, and the result is "good", I may want it through you as a middleman because it used up your tokens and won't eat my subscription usage limit to ask the AI to supply those 700. If you spend the tokens and put the result online, plenty of people can spare their tokens because they don't have to ask the AI to derive it. Bonus if that result was run through some kind of testing and verification.
Obviously this doesn't really apply to super simple questions that the LLM can just spit out the answer to right away.
True. There is at least one more case: when LLM the other person is using has access to their context and information repositories that they don't want to share directly, and so the LLM text gives a peek at a slice of that, and that's not something I can recreate from thin air. In that case the LLM text may have utility for me.
I appreciate the direction of this article, and commend the author on publishing work, but the first sentence in the first paragraph is exactly what they lament.
A pattern I see is that people use AI to build something new, then they use AI to retrospectively summarize what they have already built into a design document. Reading a document like this isn’t just difficult—it is punishing.
That's a classic calling card of LLM prose but that doesn't mean they actually used an AI. Though sure, it would be nice if we gave this style a name and then abolished it.
No, usually humans write more than just a short unsubstantiated punchline in their "it's not x, it's y's", unless they're trying to sell you something.
Well, not quite the classic calling card - LLMs generally use a contrast of opposites. (e.g. "it wasn't a bug -- it was a feature", although that predates LLMs :)
TFA's use is more common in "normal" language: "it's not just [minor], it's [major]". (But, as others have pointed out, it was probably deliberately parodic anyway.)
These last few days, there has been a small stream of blogposts on HN expressing similar things, and I have enjoyed them all.
My question recently has been how to broach this subject with colleagues who really enjoy producing prose with AI. There is not yet a better cultural shorthand for this sort of thing than "slop" which is a harsh-sounding word and itself sort of a thought-terminating cliché. "I don't want to read what you didn't write" is maybe closer — but it needs a pithier and somewhat more encouraging encapsulation, like "I want to hear it from you".
Has anyone had good experiences setting up professional boundaries or team norms around AI-written docs?
There is one person who is so good at writing with AI assistance.
Everyone else, including me, not so much. I envy his talent and ability to so successfully use the new tools. It's just something to think and talk about regularly. Maybe one day we will all be able to use the tools as well as that guy.
This sentiment gets echoed over and over. While I can certainly see the value in human-created creative works, if the subject is pure facts, there are only so many ways to state the facts without being caught in the weeds and missing your entire point.
Moreover, people are finding it hard to differentiate what is an is not AI-generated with newer models, often attributing original work with those of LLMs. It has just become an easy scapegoat for lazy comprehension and a desire to do less. You are jumping at AI boogeymen.
Just about the only thing here I can level with you on is, yes, AI is far from perfect and will continue to advance. Otherwise, so much of this reads as fruity prose to excuse apathy.
It's curious that you're pinning the blame of "excusing apathy" on the reader and not the writer. Why doesn't it go both ways? Given that producing LLM text is so cheap, your proposal amounts to an asymmetric war which is ultimately a DDOS on my finite time and attention. Or in other words: if it wasn't worth your time to write it, it's not worth my time to read it.
Let us say someone had few good ideas, and seeded them into a prompt, and after few back and forth, web searches via agent, feedback from the author, a piece of work was produced and the author decided to share it as a blog.
This is not much different than how people are producing original work LLM in areas such as math.
Would you object to reading their work because it was a byproduct of collaboration between AI/Humans? What about songs? movies? math proves? and software produces as such?
A lot of my problem with AI writing is that the facts aren’t checked. You get a big cheesy dramatic arc but the core story isn’t factually correct. There’s only so much time in a lifetime, too little to waste fact checking someone else’s work because they couldn’t be bothered to.
The lazy ones are the people spending 60s prompting then hitting copy/paste. They dump it on me as is and call it a job well done, which leads to me doing their job for them or calling them out in a very public way to stop the behavior.
“Reading a document like this isn’t just difficult—it is punishing.”
I’d be curious whether the author composed this sentence himself or it was the output of AI. Personally I often find myself “it’s not X it’s Y” and then recoiling in disgust and rephrasing it simply because AI has made it so grating from overuse.
It's funny, i push back on pull requests because there is too much description now - a 20 line change has pages and pages of generated description, rationalisation for why it is safe, defense of each design decision, analysis of risks and side effects. People are indignant, you're rejecting my change because there is too much documentation? And my response is, I don't have time to read it and you put me in the position where I can't afford not to - because approving the PR implies I did and accepted it. The investment to read all that for the value of a code change that I'm one prompt away from doing myself if I cared is just not high enough. So it's rejected.
As I have been saying for years:
Writing is fundamentally the transfer of information from your brain to my brain. If you have 1000 bits of semantic information you want to transfer, you can't give 300 bits of semantic information to an LLM and have it fill in the remaining 700, because it doesn't know what those 700 bits are. If it's able to guess those 700 bits correctly, then they aren't true semantic information, and you really only have 300 bits you want to transfer. You might as well transfer those bits to me directly, rather than having the LLM add on an extra superfluous 700 bits that I then have to filter out.
isn't it more like: i have 1000 bits, i transfer 1000 bits but depending on the person, it might be lossy, so they only understand about 700. they then come up with the 300+- on their own, potentially putting them over 1000 or they come back and ask questions to fill in the blank. the bits don't ever have to be bit identical.
Sure, but that seems orthogonal to what I'm saying, no? We could continue clarifying the definitions of information in this context, but my fundamental argument is LLMs don't add information to my writing that couldn't be added by the reader themself.
This of course has the potential to change with personal LLMs that can have shared private context with me. However, that isn't a defense for sending people AI slop, it just turns it from "LLMs don't add value" to "LLMs may add value when used judiciously."
They're lossy. I might make an esoteric reference that no one gets, or an analogy that doesn't quite land, and then have the LLM help me come up with something a bit more understandable to a general audience. There's a difference between dumping the output that you spent 5 minutes with, and taking an hour to craft that perfect analogy.
Depends. If the 700 bits were arrived at by the LLM while spending a lot of tokens, and the result is "good", I may want it through you as a middleman because it used up your tokens and won't eat my subscription usage limit to ask the AI to supply those 700. If you spend the tokens and put the result online, plenty of people can spare their tokens because they don't have to ask the AI to derive it. Bonus if that result was run through some kind of testing and verification.
Obviously this doesn't really apply to super simple questions that the LLM can just spit out the answer to right away.
Sure, but then that's less "making an LLM write for you" and more "making an LLM research for you" which I don't think is what TFA is talking about
True. There is at least one more case: when LLM the other person is using has access to their context and information repositories that they don't want to share directly, and so the LLM text gives a peek at a slice of that, and that's not something I can recreate from thin air. In that case the LLM text may have utility for me.
It's tricky because I don't want to write what no one is going to read (but that for some reason I'm required to write).
I appreciate the direction of this article, and commend the author on publishing work, but the first sentence in the first paragraph is exactly what they lament.
To be quite generous, that could be tongue in cheek.
That was my assumption. The alternative is that the author is a blatant hypocrite, which seems less likely given their blog's history.
There are other AI smells later in the article, and the author talks about using AI to help with writing...
That's a classic calling card of LLM prose but that doesn't mean they actually used an AI. Though sure, it would be nice if we gave this style a name and then abolished it.
No, usually humans write more than just a short unsubstantiated punchline in their "it's not x, it's y's", unless they're trying to sell you something.
Well, not quite the classic calling card - LLMs generally use a contrast of opposites. (e.g. "it wasn't a bug -- it was a feature", although that predates LLMs :)
TFA's use is more common in "normal" language: "it's not just [minor], it's [major]". (But, as others have pointed out, it was probably deliberately parodic anyway.)
These last few days, there has been a small stream of blogposts on HN expressing similar things, and I have enjoyed them all.
My question recently has been how to broach this subject with colleagues who really enjoy producing prose with AI. There is not yet a better cultural shorthand for this sort of thing than "slop" which is a harsh-sounding word and itself sort of a thought-terminating cliché. "I don't want to read what you didn't write" is maybe closer — but it needs a pithier and somewhat more encouraging encapsulation, like "I want to hear it from you".
Has anyone had good experiences setting up professional boundaries or team norms around AI-written docs?
I’ve been away. Does anyone have a collection of these posts?
Here are the two I was thinking of:
- https://news.ycombinator.com/item?id=49767937
- https://news.ycombinator.com/item?id=49784816
There is one person who is so good at writing with AI assistance.
Everyone else, including me, not so much. I envy his talent and ability to so successfully use the new tools. It's just something to think and talk about regularly. Maybe one day we will all be able to use the tools as well as that guy.
This sentiment gets echoed over and over. While I can certainly see the value in human-created creative works, if the subject is pure facts, there are only so many ways to state the facts without being caught in the weeds and missing your entire point.
Moreover, people are finding it hard to differentiate what is an is not AI-generated with newer models, often attributing original work with those of LLMs. It has just become an easy scapegoat for lazy comprehension and a desire to do less. You are jumping at AI boogeymen.
Just about the only thing here I can level with you on is, yes, AI is far from perfect and will continue to advance. Otherwise, so much of this reads as fruity prose to excuse apathy.
It's curious that you're pinning the blame of "excusing apathy" on the reader and not the writer. Why doesn't it go both ways? Given that producing LLM text is so cheap, your proposal amounts to an asymmetric war which is ultimately a DDOS on my finite time and attention. Or in other words: if it wasn't worth your time to write it, it's not worth my time to read it.
Trying to understand your position.
Let us say someone had few good ideas, and seeded them into a prompt, and after few back and forth, web searches via agent, feedback from the author, a piece of work was produced and the author decided to share it as a blog.
This is not much different than how people are producing original work LLM in areas such as math.
Would you object to reading their work because it was a byproduct of collaboration between AI/Humans? What about songs? movies? math proves? and software produces as such?
A lot of my problem with AI writing is that the facts aren’t checked. You get a big cheesy dramatic arc but the core story isn’t factually correct. There’s only so much time in a lifetime, too little to waste fact checking someone else’s work because they couldn’t be bothered to.
The lazy ones are the people spending 60s prompting then hitting copy/paste. They dump it on me as is and call it a job well done, which leads to me doing their job for them or calling them out in a very public way to stop the behavior.
I don’t like doing either of these things.
“Reading a document like this isn’t just difficult—it is punishing.”
I’d be curious whether the author composed this sentence himself or it was the output of AI. Personally I often find myself “it’s not X it’s Y” and then recoiling in disgust and rephrasing it simply because AI has made it so grating from overuse.
It's funny, i push back on pull requests because there is too much description now - a 20 line change has pages and pages of generated description, rationalisation for why it is safe, defense of each design decision, analysis of risks and side effects. People are indignant, you're rejecting my change because there is too much documentation? And my response is, I don't have time to read it and you put me in the position where I can't afford not to - because approving the PR implies I did and accepted it. The investment to read all that for the value of a code change that I'm one prompt away from doing myself if I cared is just not high enough. So it's rejected.