"AI writing is vague and wrong in hard-to-notice ways"
This one felt to me, at work I lost a lot of time re-reading and correcting AI prose that was launched to "summarize" a collective white paper, and where subtlety and nuance disappeared in ways that harmed the initial ideas/arguments I was writing about, but in sneaky ways.
AI is very bad at properly handling statements that make heavy use of vague quantifiers (e.g. "some", "most") and also commits a lot of pretty serious logical fallacies. It is also bad at handling subtle logical negation, generally.
One of the most egregious negation issues I run into a lot is when I (or someone) makes a statement of the form: "not X" or "X is thus not true", and the AI then proceeds to interpret or summarize this as 'whatever is the opposite of X is the case'". This will cause it to go down a useless path investigating or disputing the opposite of X, which generally has no relevance or bearing on anything.
I don't find AI helpful for truly constructive or creative prose, it devolves to the median output very quickly and it's almost painful to hear in my inner voice when I read out an AI-ified idea. The "not this but that" formulation is especially bad or cloying attempt at pretending to refine an idea or lightly correct something to start from a position of authority, very annoying.
That said, I have a lot of situations at work where I am asked to simplify something I am an expert in or convey something for a different audience, particularly as I prepare for presentations and I do find it helpful in helping me step down my writing or work. YMMV.
I also skip words a lot and can miss that even after 2-3 editorial passes and it's very helpful at that vs. say normal spellcheck.
This advice is too coarse. I believe LLMs have made me a better writer of technical reports. I have a keen ear for language, and I can usually tell when a sentence or a paragraph is orbiting around a point rather than landing on it firmly. Some writers insist that unclear prose is dispositive proof of unclear ideas -- a sign the writer has not thought things through. My experience is different: I often have a clear idea in mind that I cannot quite find the right idiom to express. Sometimes I can find it if I keep revising, but staring at a sentence too long can entangle you in a particular linguistic frame that can be hard to escape.
LLMs are helpful because their idiom-list is vast and they are indefatigable and infinitely patient. You can keep iterating on a sentence and it will keep giving you fresh takes. Eventually, whether through careful steering or brute-force iteration, it will come up with something that has the right resonance. Like a word on the tip of your tongue, you recognize it when you hear it.
For me, the end result of this writing-process is often a document where much of the language first came from the agent, but the voice is recognizably mine, and I feel a clear sense of authorship. It is still my work because of the microscopic attention I paid to every word. The marble is the agent's, but the chisel and mallet are in my hands.
And also to think in different directions than you would have gone in isolation. Regardless, this is a great heuristic / rule that I will be sharing and keeping in mind.
"AI writing is vague and wrong in hard-to-notice ways" This one felt to me, at work I lost a lot of time re-reading and correcting AI prose that was launched to "summarize" a collective white paper, and where subtlety and nuance disappeared in ways that harmed the initial ideas/arguments I was writing about, but in sneaky ways.
AI is very bad at properly handling statements that make heavy use of vague quantifiers (e.g. "some", "most") and also commits a lot of pretty serious logical fallacies. It is also bad at handling subtle logical negation, generally.
One of the most egregious negation issues I run into a lot is when I (or someone) makes a statement of the form: "not X" or "X is thus not true", and the AI then proceeds to interpret or summarize this as 'whatever is the opposite of X is the case'". This will cause it to go down a useless path investigating or disputing the opposite of X, which generally has no relevance or bearing on anything.
I don't find AI helpful for truly constructive or creative prose, it devolves to the median output very quickly and it's almost painful to hear in my inner voice when I read out an AI-ified idea. The "not this but that" formulation is especially bad or cloying attempt at pretending to refine an idea or lightly correct something to start from a position of authority, very annoying.
That said, I have a lot of situations at work where I am asked to simplify something I am an expert in or convey something for a different audience, particularly as I prepare for presentations and I do find it helpful in helping me step down my writing or work. YMMV.
I also skip words a lot and can miss that even after 2-3 editorial passes and it's very helpful at that vs. say normal spellcheck.
This advice is too coarse. I believe LLMs have made me a better writer of technical reports. I have a keen ear for language, and I can usually tell when a sentence or a paragraph is orbiting around a point rather than landing on it firmly. Some writers insist that unclear prose is dispositive proof of unclear ideas -- a sign the writer has not thought things through. My experience is different: I often have a clear idea in mind that I cannot quite find the right idiom to express. Sometimes I can find it if I keep revising, but staring at a sentence too long can entangle you in a particular linguistic frame that can be hard to escape.
LLMs are helpful because their idiom-list is vast and they are indefatigable and infinitely patient. You can keep iterating on a sentence and it will keep giving you fresh takes. Eventually, whether through careful steering or brute-force iteration, it will come up with something that has the right resonance. Like a word on the tip of your tongue, you recognize it when you hear it.
For me, the end result of this writing-process is often a document where much of the language first came from the agent, but the voice is recognizably mine, and I feel a clear sense of authorship. It is still my work because of the microscopic attention I paid to every word. The marble is the agent's, but the chisel and mallet are in my hands.
If I may propose a broader rule, that I think this post presents a special case of;
Only ever use AI to make yourself think harder, and more.
And also to think in different directions than you would have gone in isolation. Regardless, this is a great heuristic / rule that I will be sharing and keeping in mind.